[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:08:39.288336 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:38749
I20260709 13:08:39.290275 29280 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:08:39.291316 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:39.306015 29287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:39.306432 29286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:39.308764 29280 server_base.cc:1061] running on GCE node
W20260709 13:08:39.308197 29289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:40.494148 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:40.494385 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:40.494644 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602520494601 us; error 0 us; skew 500 ppm
I20260709 13:08:40.495561 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:40.502030 29280 webserver.cc:533] Webserver started at http://127.28.152.62:40663/ using document root <none> and password file <none>
I20260709 13:08:40.502962 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:40.503201 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:40.503659 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:40.509721 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "819a825c6d174d9f80f60484a9cfe068"
format_stamp: "Formatted at 2026-07-09 13:08:40 on dist-test-slave-x7j4"
I20260709 13:08:40.517658 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.008s
I20260709 13:08:40.523123 29295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:40.524298 29280 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:08:40.524715 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "819a825c6d174d9f80f60484a9cfe068"
format_stamp: "Formatted at 2026-07-09 13:08:40 on dist-test-slave-x7j4"
I20260709 13:08:40.525157 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:40.579643 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:40.581192 29280 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:08:40.581650 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:40.653510 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:38749
I20260709 13:08:40.653578 29346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:38749 every 8 connection(s)
I20260709 13:08:40.661835 29347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:40.683262 29347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: Bootstrap starting.
I20260709 13:08:40.689085 29347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:40.691026 29347 log.cc:826] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: Log is configured to *not* fsync() on all Append() calls
I20260709 13:08:40.695621 29347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: No bootstrap required, opened a new log
I20260709 13:08:40.715871 29347 raft_consensus.cc:359] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER }
I20260709 13:08:40.716459 29347 raft_consensus.cc:385] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:40.716717 29347 raft_consensus.cc:740] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 819a825c6d174d9f80f60484a9cfe068, State: Initialized, Role: FOLLOWER
I20260709 13:08:40.717756 29347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER }
I20260709 13:08:40.718286 29347 raft_consensus.cc:399] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:40.718582 29347 raft_consensus.cc:493] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:40.719005 29347 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:40.723150 29347 raft_consensus.cc:515] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER }
I20260709 13:08:40.723927 29347 leader_election.cc:304] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 819a825c6d174d9f80f60484a9cfe068; no voters: 
I20260709 13:08:40.725677 29347 leader_election.cc:290] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:40.726073 29350 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:40.728739 29350 raft_consensus.cc:697] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 1 LEADER]: Becoming Leader. State: Replica: 819a825c6d174d9f80f60484a9cfe068, State: Running, Role: LEADER
I20260709 13:08:40.729553 29350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER }
I20260709 13:08:40.730120 29347 sys_catalog.cc:565] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:40.740758 29351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "819a825c6d174d9f80f60484a9cfe068" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER } }
I20260709 13:08:40.741340 29351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:40.742607 29352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 819a825c6d174d9f80f60484a9cfe068. Latest consensus state: current_term: 1 leader_uuid: "819a825c6d174d9f80f60484a9cfe068" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819a825c6d174d9f80f60484a9cfe068" member_type: VOTER } }
I20260709 13:08:40.743376 29352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:40.744735 29360 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:40.756140 29360 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:40.758402 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:40.772554 29360 catalog_manager.cc:1383] Generated new cluster ID: 292e1b63cd0e42faa93feaba7759e34b
I20260709 13:08:40.772892 29360 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:40.797683 29360 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:40.799322 29360 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:40.815443 29360 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: Generated new TSK 0
I20260709 13:08:40.816438 29360 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:40.825861 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:40.835467 29369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:40.836680 29370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:40.841419 29372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:40.842043 29280 server_base.cc:1061] running on GCE node
I20260709 13:08:40.842994 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:40.843256 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:40.843462 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602520843444 us; error 0 us; skew 500 ppm
I20260709 13:08:40.844255 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:40.848361 29280 webserver.cc:533] Webserver started at http://127.28.152.1:35765/ using document root <none> and password file <none>
I20260709 13:08:40.849063 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:40.849314 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:40.849651 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:40.851182 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "3644324927284bb3a0eb4c1c10f5e565"
format_stamp: "Formatted at 2026-07-09 13:08:40 on dist-test-slave-x7j4"
I20260709 13:08:40.858139 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:40.863358 29377 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:40.864238 29280 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:08:40.864566 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "3644324927284bb3a0eb4c1c10f5e565"
format_stamp: "Formatted at 2026-07-09 13:08:40 on dist-test-slave-x7j4"
I20260709 13:08:40.864964 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:40.904194 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:40.905603 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:40.908295 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:40.913394 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:40.913668 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:40.913952 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:40.914132 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.016456 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:35673
I20260709 13:08:41.016594 29439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:35673 every 8 connection(s)
I20260709 13:08:41.023866 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.041004 29444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:41.042826 29445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.050508 29280 server_base.cc:1061] running on GCE node
W20260709 13:08:41.052450 29447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.053510 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.053838 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.054055 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602521054038 us; error 0 us; skew 500 ppm
I20260709 13:08:41.054792 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.058319 29280 webserver.cc:533] Webserver started at http://127.28.152.2:38277/ using document root <none> and password file <none>
I20260709 13:08:41.059109 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.059389 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.059772 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.061147 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "b9122ed3bd39401dbb86fc07556fc78c"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-x7j4"
I20260709 13:08:41.063208 29440 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38749
I20260709 13:08:41.063705 29440 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.064911 29440 heartbeater.cc:507] Master 127.28.152.62:38749 requested a full tablet report, sending...
I20260709 13:08:41.068171 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:41.068840 29312 ts_manager.cc:194] Registered new tserver with Master: 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:41.071516 29312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34930
I20260709 13:08:41.073858 29452 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.075228 29280 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:08:41.075578 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "b9122ed3bd39401dbb86fc07556fc78c"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-x7j4"
I20260709 13:08:41.075911 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.110606 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.112294 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.115237 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.118994 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.119227 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.119519 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.119695 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.225827 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:43605
I20260709 13:08:41.225945 29514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:43605 every 8 connection(s)
I20260709 13:08:41.233261 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:41.240691 29518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.247702 29515 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38749
I20260709 13:08:41.248118 29515 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.249104 29515 heartbeater.cc:507] Master 127.28.152.62:38749 requested a full tablet report, sending...
W20260709 13:08:41.249148 29519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.251842 29312 ts_manager.cc:194] Registered new tserver with Master: b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:41.252940 29280 server_base.cc:1061] running on GCE node
I20260709 13:08:41.253808 29312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34940
W20260709 13:08:41.254371 29522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:41.255584 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:41.255841 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:41.256042 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602521256017 us; error 0 us; skew 500 ppm
I20260709 13:08:41.256778 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:41.259819 29280 webserver.cc:533] Webserver started at http://127.28.152.3:43643/ using document root <none> and password file <none>
I20260709 13:08:41.260289 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:41.260486 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:41.260754 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:41.261860 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "90cf0f51cc5249ad830ec0f497446b4d"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-x7j4"
I20260709 13:08:41.266358 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:41.269722 29526 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.270494 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:41.270839 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "90cf0f51cc5249ad830ec0f497446b4d"
format_stamp: "Formatted at 2026-07-09 13:08:41 on dist-test-slave-x7j4"
I20260709 13:08:41.271139 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:41.297166 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:41.298354 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:41.300510 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:41.303817 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:41.304049 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.304292 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:41.304463 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:41.399032 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:37127
I20260709 13:08:41.399183 29588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:37127 every 8 connection(s)
I20260709 13:08:41.417464 29589 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38749
I20260709 13:08:41.417908 29589 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:41.418903 29589 heartbeater.cc:507] Master 127.28.152.62:38749 requested a full tablet report, sending...
I20260709 13:08:41.421065 29312 ts_manager.cc:194] Registered new tserver with Master: 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:41.421792 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014427584s
I20260709 13:08:41.422832 29312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34950
I20260709 13:08:41.475350 29312 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34954:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:41.479058 29312 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:41.584914 29554 tablet_service.cc:1511] Processing CreateTablet for tablet e24e3637d70b4632878a145dd0fc92f9 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:41.585440 29553 tablet_service.cc:1511] Processing CreateTablet for tablet 43256921af5e4beaa7bce2892492dfd7 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:41.586594 29554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24e3637d70b4632878a145dd0fc92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.587262 29553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43256921af5e4beaa7bce2892492dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.588917 29552 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:41.590430 29552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.588860 29551 tablet_service.cc:1511] Processing CreateTablet for tablet 2567ad9f73664416afe7819a900da08a (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:41.592734 29551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567ad9f73664416afe7819a900da08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.598846 29550 tablet_service.cc:1511] Processing CreateTablet for tablet 92a2a8b4f04846e4a401a80cc92a637b (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:41.600220 29550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a2a8b4f04846e4a401a80cc92a637b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.603716 29549 tablet_service.cc:1511] Processing CreateTablet for tablet 4cdae9576e3b4cf6978eb766eb8d1b04 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:41.605031 29549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cdae9576e3b4cf6978eb766eb8d1b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.612012 29548 tablet_service.cc:1511] Processing CreateTablet for tablet 030a9864f0dd497586523806864a7dbb (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:41.615092 29548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030a9864f0dd497586523806864a7dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.633044 29607 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:41.634737 29547 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2ac8ecb6434d7b8ef8462c59c01717 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:41.637579 29547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2ac8ecb6434d7b8ef8462c59c01717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.644484 29550 tablet_service.cc:1511] Processing CreateTablet for tablet cb49d868fd4742eabaaf062f2291a437 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:41.647096 29550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb49d868fd4742eabaaf062f2291a437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.646533 29480 tablet_service.cc:1511] Processing CreateTablet for tablet e24e3637d70b4632878a145dd0fc92f9 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:41.645970 29405 tablet_service.cc:1511] Processing CreateTablet for tablet e24e3637d70b4632878a145dd0fc92f9 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:41.664002 29405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24e3637d70b4632878a145dd0fc92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.662896 29479 tablet_service.cc:1511] Processing CreateTablet for tablet 43256921af5e4beaa7bce2892492dfd7 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:41.653220 29404 tablet_service.cc:1511] Processing CreateTablet for tablet 43256921af5e4beaa7bce2892492dfd7 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:41.669394 29480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24e3637d70b4632878a145dd0fc92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.662796 29403 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:41.673265 29475 tablet_service.cc:1511] Processing CreateTablet for tablet 4cdae9576e3b4cf6978eb766eb8d1b04 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:41.678375 29479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43256921af5e4beaa7bce2892492dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.680531 29478 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:41.682560 29404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43256921af5e4beaa7bce2892492dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.683446 29477 tablet_service.cc:1511] Processing CreateTablet for tablet 2567ad9f73664416afe7819a900da08a (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:41.685513 29399 tablet_service.cc:1511] Processing CreateTablet for tablet 030a9864f0dd497586523806864a7dbb (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:41.689670 29476 tablet_service.cc:1511] Processing CreateTablet for tablet 92a2a8b4f04846e4a401a80cc92a637b (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:41.696602 29403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.701282 29475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cdae9576e3b4cf6978eb766eb8d1b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.688118 29402 tablet_service.cc:1511] Processing CreateTablet for tablet 2567ad9f73664416afe7819a900da08a (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:41.706430 29478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9b1fa464614b3c86e5f7a01f9cd5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.688222 29400 tablet_service.cc:1511] Processing CreateTablet for tablet 4cdae9576e3b4cf6978eb766eb8d1b04 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:41.688251 29401 tablet_service.cc:1511] Processing CreateTablet for tablet 92a2a8b4f04846e4a401a80cc92a637b (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:41.696657 29473 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2ac8ecb6434d7b8ef8462c59c01717 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:41.701612 29474 tablet_service.cc:1511] Processing CreateTablet for tablet 030a9864f0dd497586523806864a7dbb (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:41.712742 29399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030a9864f0dd497586523806864a7dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.715348 29397 tablet_service.cc:1511] Processing CreateTablet for tablet cb49d868fd4742eabaaf062f2291a437 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:41.717224 29398 tablet_service.cc:1511] Processing CreateTablet for tablet 4a2ac8ecb6434d7b8ef8462c59c01717 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:41.715247 29472 tablet_service.cc:1511] Processing CreateTablet for tablet cb49d868fd4742eabaaf062f2291a437 (DEFAULT_TABLE table=test-workload [id=c200c43807ea4413b6b2d0785082ade3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:41.723063 29476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a2a8b4f04846e4a401a80cc92a637b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.726342 29472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb49d868fd4742eabaaf062f2291a437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.731688 29473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2ac8ecb6434d7b8ef8462c59c01717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.732506 29397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb49d868fd4742eabaaf062f2291a437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.734035 29400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cdae9576e3b4cf6978eb766eb8d1b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.737644 29398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a2ac8ecb6434d7b8ef8462c59c01717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.740319 29401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a2a8b4f04846e4a401a80cc92a637b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.744621 29477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567ad9f73664416afe7819a900da08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.747620 29402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567ad9f73664416afe7819a900da08a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:41.749923 29359 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:41.752146 29474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030a9864f0dd497586523806864a7dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.858609 29607 tablet_bootstrap.cc:654] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.877867 29608 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:41.900796 29609 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:41.912001 29608 tablet_bootstrap.cc:654] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.918205 29607 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:41.918720 29607 ts_tablet_manager.cc:1403] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.286s	user 0.011s	sys 0.011s
I20260709 13:08:41.919569 29609 tablet_bootstrap.cc:654] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.921870 29608 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:41.921643 29607 raft_consensus.cc:359] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.922448 29607 raft_consensus.cc:385] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.922530 29608 ts_tablet_manager.cc:1403] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.000s
I20260709 13:08:41.922840 29607 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.923764 29607 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.928004 29608 raft_consensus.cc:359] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.929234 29608 raft_consensus.cc:385] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.929791 29608 raft_consensus.cc:740] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.930886 29608 consensus_queue.cc:260] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.933368 29607 ts_tablet_manager.cc:1434] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.002s
I20260709 13:08:41.934185 29589 heartbeater.cc:499] Master 127.28.152.62:38749 was elected leader, sending a full tablet report...
I20260709 13:08:41.939460 29607 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:41.945981 29607 tablet_bootstrap.cc:654] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.949316 29440 heartbeater.cc:499] Master 127.28.152.62:38749 was elected leader, sending a full tablet report...
I20260709 13:08:41.950374 29608 ts_tablet_manager.cc:1434] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.017s
I20260709 13:08:41.951390 29608 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:41.958369 29608 tablet_bootstrap.cc:654] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.966116 29607 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:41.966761 29607 ts_tablet_manager.cc:1403] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:08:41.968708 29609 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:41.969316 29609 ts_tablet_manager.cc:1403] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.007s
I20260709 13:08:41.969910 29607 raft_consensus.cc:359] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.970679 29607 raft_consensus.cc:385] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.971045 29607 raft_consensus.cc:740] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.971961 29607 consensus_queue.cc:260] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.974509 29607 ts_tablet_manager.cc:1434] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:41.975602 29607 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:41.975898 29609 raft_consensus.cc:359] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.976585 29609 raft_consensus.cc:385] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.976840 29609 raft_consensus.cc:740] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.977679 29608 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:41.977519 29609 consensus_queue.cc:260] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.978111 29608 ts_tablet_manager.cc:1403] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 13:08:41.980931 29608 raft_consensus.cc:359] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.981592 29608 raft_consensus.cc:385] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:41.981875 29608 raft_consensus.cc:740] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:41.982510 29608 consensus_queue.cc:260] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:41.984517 29608 ts_tablet_manager.cc:1434] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:41.986260 29515 heartbeater.cc:499] Master 127.28.152.62:38749 was elected leader, sending a full tablet report...
I20260709 13:08:41.987875 29609 ts_tablet_manager.cc:1434] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:08:41.988763 29609 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:41.994540 29607 tablet_bootstrap.cc:654] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:41.995424 29608 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:41.995431 29609 tablet_bootstrap.cc:654] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.004078 29608 tablet_bootstrap.cc:654] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.004242 29609 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.004766 29609 ts_tablet_manager.cc:1403] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:08:42.008107 29609 raft_consensus.cc:359] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.008847 29609 raft_consensus.cc:385] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.009178 29609 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.009984 29614 raft_consensus.cc:493] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.009908 29609 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.010476 29614 raft_consensus.cc:515] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.013559 29607 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.017639 29614 leader_election.cc:290] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.014096 29607 ts_tablet_manager.cc:1403] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.011s
I20260709 13:08:42.023840 29609 ts_tablet_manager.cc:1434] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:08:42.024744 29609 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
W20260709 13:08:42.027060 29441 tablet.cc:2406] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:42.026113 29607 raft_consensus.cc:359] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.033813 29607 raft_consensus.cc:385] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.034114 29607 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.034833 29607 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.038159 29609 tablet_bootstrap.cc:654] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.042979 29607 ts_tablet_manager.cc:1434] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:08:42.043951 29607 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:42.052389 29608 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.052886 29608 ts_tablet_manager.cc:1403] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.002s
I20260709 13:08:42.055653 29608 raft_consensus.cc:359] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.056349 29608 raft_consensus.cc:385] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.056627 29608 raft_consensus.cc:740] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.057300 29608 consensus_queue.cc:260] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.066022 29607 tablet_bootstrap.cc:654] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.071458 29608 ts_tablet_manager.cc:1434] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:08:42.071588 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.072567 29608 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.073308 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
W20260709 13:08:42.073820 29379 leader_election.cc:343] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.078995 29608 tablet_bootstrap.cc:654] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:42.083858 29381 leader_election.cc:343] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.084470 29381 leader_election.cc:304] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565; no voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.085520 29614 raft_consensus.cc:2749] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.088069 29613 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.088608 29613 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.090761 29613 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.098803 29609 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.099386 29609 ts_tablet_manager.cc:1403] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.033s
I20260709 13:08:42.099524 29608 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.099989 29608 ts_tablet_manager.cc:1403] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:08:42.102634 29608 raft_consensus.cc:359] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.103320 29608 raft_consensus.cc:385] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.103765 29608 raft_consensus.cc:740] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.103266 29609 raft_consensus.cc:359] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.104420 29609 raft_consensus.cc:385] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.104957 29609 raft_consensus.cc:740] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.104454 29608 consensus_queue.cc:260] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.105718 29609 consensus_queue.cc:260] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.107028 29607 tablet_bootstrap.cc:492] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.107450 29607 ts_tablet_manager.cc:1403] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.014s
I20260709 13:08:42.108577 29609 ts_tablet_manager.cc:1434] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:08:42.109498 29609 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.110409 29607 raft_consensus.cc:359] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.112192 29607 raft_consensus.cc:385] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.112469 29607 raft_consensus.cc:740] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.113114 29607 consensus_queue.cc:260] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.115031 29608 ts_tablet_manager.cc:1434] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:08:42.116035 29608 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.117995 29609 tablet_bootstrap.cc:654] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.121325 29607 ts_tablet_manager.cc:1434] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:08:42.123860 29607 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:42.129940 29608 tablet_bootstrap.cc:654] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.133333 29607 tablet_bootstrap.cc:654] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.143953 29607 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.146944 29608 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.147492 29608 ts_tablet_manager.cc:1403] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.007s
I20260709 13:08:42.144383 29607 ts_tablet_manager.cc:1403] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:08:42.155215 29608 raft_consensus.cc:359] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.155962 29608 raft_consensus.cc:385] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.156241 29608 raft_consensus.cc:740] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.156922 29608 consensus_queue.cc:260] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.162433 29608 ts_tablet_manager.cc:1434] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:08:42.163369 29608 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.169692 29608 tablet_bootstrap.cc:654] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.170981 29607 raft_consensus.cc:359] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.171687 29607 raft_consensus.cc:385] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.171981 29607 raft_consensus.cc:740] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.172806 29607 consensus_queue.cc:260] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.175194 29607 ts_tablet_manager.cc:1434] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:08:42.176127 29607 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:42.182330 29607 tablet_bootstrap.cc:654] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.190073 29617 raft_consensus.cc:493] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.190745 29617 raft_consensus.cc:515] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.193912 29608 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.194358 29608 ts_tablet_manager.cc:1403] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.031s	user 0.000s	sys 0.011s
I20260709 13:08:42.196149 29617 leader_election.cc:290] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.197151 29608 raft_consensus.cc:359] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.197858 29608 raft_consensus.cc:385] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.198132 29608 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.200376 29607 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.200824 29607 ts_tablet_manager.cc:1403] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:08:42.203517 29607 raft_consensus.cc:359] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.204157 29607 raft_consensus.cc:385] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.204427 29607 raft_consensus.cc:740] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.205003 29607 consensus_queue.cc:260] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.205889 29608 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.208186 29608 ts_tablet_manager.cc:1434] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.006s
I20260709 13:08:42.209087 29608 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.215137 29607 ts_tablet_manager.cc:1434] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:08:42.216213 29607 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:42.222540 29614 raft_consensus.cc:493] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.223063 29614 raft_consensus.cc:515] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.226562 29614 leader_election.cc:290] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.229115 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.232165 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.240494 29613 raft_consensus.cc:493] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.241133 29613 raft_consensus.cc:515] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.246599 29617 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.247218 29617 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
W20260709 13:08:42.254609 29381 leader_election.cc:343] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.255496 29617 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.256601 29608 tablet_bootstrap.cc:654] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.258834 29607 tablet_bootstrap.cc:654] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.256836 29564 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 0.
I20260709 13:08:42.266786 29379 leader_election.cc:304] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.272212 29614 raft_consensus.cc:2804] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.278919 29614 raft_consensus.cc:493] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.275120 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.281081 29614 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.286630 29613 leader_election.cc:290] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.292773 29613 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.294629 29609 tablet_bootstrap.cc:492] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.297608 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.298182 29609 ts_tablet_manager.cc:1403] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.189s	user 0.040s	sys 0.074s
I20260709 13:08:42.300494 29489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.300611 29413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.296958 29613 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.302109 29490 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 0.
I20260709 13:08:42.301888 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.304786 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.330461 29614 raft_consensus.cc:515] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.336313 29614 leader_election.cc:290] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.337016 29614 raft_consensus.cc:493] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.337553 29614 raft_consensus.cc:515] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.340091 29614 leader_election.cc:290] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
W20260709 13:08:42.324937 29530 leader_election.cc:343] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.325081 29613 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
W20260709 13:08:42.330613 29456 leader_election.cc:343] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.340945 29609 raft_consensus.cc:359] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.343376 29609 raft_consensus.cc:385] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.344853 29609 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.345232 29489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.348942 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.353359 29488 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 0.
W20260709 13:08:42.352941 29456 leader_election.cc:343] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.353645 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.354456 29564 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.353446 29609 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
W20260709 13:08:42.344316 29530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:35673, user_credentials={real_user=slave}} blocked reactor thread for 49209us
W20260709 13:08:42.354776 29381 leader_election.cc:343] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.356532 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.359686 29563 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 0.
I20260709 13:08:42.358847 29381 leader_election.cc:304] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.361681 29613 raft_consensus.cc:493] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.362753 29637 raft_consensus.cc:2804] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.363159 29637 raft_consensus.cc:493] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.362903 29613 raft_consensus.cc:515] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.363292 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.363525 29637 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.363941 29415 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 0.
I20260709 13:08:42.365029 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.365433 29613 leader_election.cc:290] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.365607 29488 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 0.
W20260709 13:08:42.364477 29530 leader_election.cc:343] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.367250 29614 raft_consensus.cc:493] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.367125 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.367089 29609 ts_tablet_manager.cc:1434] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 13:08:42.368472 29530 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:42.369051 29609 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.369324 29613 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.369676 29613 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.369995 29613 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.368721 29608 tablet_bootstrap.cc:492] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.371563 29608 ts_tablet_manager.cc:1403] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.015s
I20260709 13:08:42.370913 29563 raft_consensus.cc:2468] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.370754 29614 raft_consensus.cc:515] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.374511 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.377148 29454 leader_election.cc:304] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:42.377971 29617 raft_consensus.cc:2804] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.378343 29617 raft_consensus.cc:493] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.375469 29564 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 1.
I20260709 13:08:42.379314 29617 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.378831 29614 leader_election.cc:290] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.374672 29530 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.379830 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.381348 29607 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.382242 29636 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.382920 29636 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.383145 29381 leader_election.cc:343] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.383337 29636 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:42.384189 29530 leader_election.cc:343] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.384620 29607 ts_tablet_manager.cc:1403] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.019s
I20260709 13:08:42.382925 29379 leader_election.cc:304] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.387423 29614 raft_consensus.cc:2804] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.385349 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.390179 29613 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
W20260709 13:08:42.391110 29379 leader_election.cc:343] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.391793 29562 raft_consensus.cc:2393] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9122ed3bd39401dbb86fc07556fc78c in current term 1: Already voted for candidate 90cf0f51cc5249ad830ec0f497446b4d in this term.
I20260709 13:08:42.391686 29379 leader_election.cc:304] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565; no voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.392688 29613 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.386417 29530 leader_election.cc:304] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d; no voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.393898 29613 raft_consensus.cc:2749] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.395902 29454 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9122ed3bd39401dbb86fc07556fc78c; no voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:42.396138 29607 raft_consensus.cc:359] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.399631 29607 raft_consensus.cc:385] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.401841 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.401289 29607 raft_consensus.cc:740] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.399930 29617 raft_consensus.cc:515] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.406809 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.407106 29607 consensus_queue.cc:260] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
W20260709 13:08:42.407851 29530 leader_election.cc:343] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.408537 29617 leader_election.cc:290] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.407684 29608 raft_consensus.cc:359] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.410043 29608 raft_consensus.cc:385] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.410159 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.410174 29617 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.410372 29608 raft_consensus.cc:740] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.411429 29608 consensus_queue.cc:260] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.412317 29415 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.411911 29607 ts_tablet_manager.cc:1434] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
W20260709 13:08:42.414579 29530 leader_election.cc:343] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.422099 29607 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
I20260709 13:08:42.401458 29637 raft_consensus.cc:515] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.430543 29641 raft_consensus.cc:2749] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.426440 29614 raft_consensus.cc:697] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:42.435076 29636 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.437386 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.438350 29562 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.439554 29609 tablet_bootstrap.cc:654] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.440611 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.441623 29490 raft_consensus.cc:2393] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90cf0f51cc5249ad830ec0f497446b4d in current term 1: Already voted for candidate b9122ed3bd39401dbb86fc07556fc78c in this term.
I20260709 13:08:42.445830 29636 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.446393 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.446995 29414 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.448930 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.449987 29530 leader_election.cc:304] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d; no voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.450058 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.451550 29488 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.450860 29489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.453974 29489 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.454078 29562 raft_consensus.cc:2468] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.432986 29614 consensus_queue.cc:237] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.456938 29607 tablet_bootstrap.cc:654] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.457098 29454 leader_election.cc:304] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.455129 29636 raft_consensus.cc:2749] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.457327 29637 leader_election.cc:290] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.459122 29640 raft_consensus.cc:2804] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.456236 29617 raft_consensus.cc:2749] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:42.458436 29379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:37127, user_credentials={real_user=slave}} blocked reactor thread for 67379.1us
I20260709 13:08:42.465037 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.466756 29562 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.471285 29489 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 1.
I20260709 13:08:42.460654 29415 raft_consensus.cc:2468] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.477478 29608 ts_tablet_manager.cc:1434] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.004s
I20260709 13:08:42.478490 29608 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.479744 29562 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 1.
I20260709 13:08:42.484721 29530 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.484726 29379 leader_election.cc:304] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:42.486202 29613 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.486443 29637 raft_consensus.cc:2804] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.487092 29637 raft_consensus.cc:697] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:42.491233 29637 consensus_queue.cc:237] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.492300 29490 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 1.
I20260709 13:08:42.493010 29488 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 1.
I20260709 13:08:42.498991 29530 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:42.499941 29414 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 1.
I20260709 13:08:42.500471 29636 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.501041 29636 raft_consensus.cc:697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:42.483292 29640 raft_consensus.cc:697] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:42.501891 29636 consensus_queue.cc:237] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.503252 29640 consensus_queue.cc:237] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.507473 29609 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.507557 29613 raft_consensus.cc:697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:42.513540 29613 consensus_queue.cc:237] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.515664 29608 tablet_bootstrap.cc:654] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.516650 29609 ts_tablet_manager.cc:1403] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.014s
I20260709 13:08:42.518750 29614 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.516687 29310 catalog_manager.cc:5697] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.531239 29607 tablet_bootstrap.cc:492] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.531713 29607 ts_tablet_manager.cc:1403] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.002s
I20260709 13:08:42.523524 29614 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.540343 29607 raft_consensus.cc:359] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.541047 29607 raft_consensus.cc:385] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.541320 29607 raft_consensus.cc:740] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.542107 29607 consensus_queue.cc:260] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.542595 29312 catalog_manager.cc:5697] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 0 to 1, leader changed from <none> to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 1 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.544140 29607 ts_tablet_manager.cc:1434] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:08:42.552063 29614 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:42.557140 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.555552 29607 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: Bootstrap starting.
W20260709 13:08:42.572460 29381 leader_election.cc:343] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.548923 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
W20260709 13:08:42.579995 29379 leader_election.cc:343] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:42.580674 29379 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565; no voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.581584 29614 raft_consensus.cc:2749] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.587301 29607 tablet_bootstrap.cc:654] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.567701 29609 raft_consensus.cc:359] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.589303 29609 raft_consensus.cc:385] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.590633 29609 raft_consensus.cc:740] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.591434 29609 consensus_queue.cc:260] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.593750 29609 ts_tablet_manager.cc:1434] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:08:42.594657 29609 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.595074 29311 catalog_manager.cc:5697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 1 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.605753 29608 tablet_bootstrap.cc:492] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.606244 29608 ts_tablet_manager.cc:1403] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.014s
I20260709 13:08:42.608072 29607 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: No bootstrap required, opened a new log
I20260709 13:08:42.608578 29607 ts_tablet_manager.cc:1403] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.005s
I20260709 13:08:42.609583 29608 raft_consensus.cc:359] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.611238 29607 raft_consensus.cc:359] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.611943 29607 raft_consensus.cc:385] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.612234 29609 tablet_bootstrap.cc:654] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.612247 29607 raft_consensus.cc:740] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.613379 29607 consensus_queue.cc:260] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.615581 29607 ts_tablet_manager.cc:1434] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:42.610494 29608 raft_consensus.cc:385] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.617054 29608 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.619159 29608 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.624027 29608 ts_tablet_manager.cc:1434] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:08:42.625038 29608 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: Bootstrap starting.
I20260709 13:08:42.629374 29609 tablet_bootstrap.cc:492] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.629863 29609 ts_tablet_manager.cc:1403] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:08:42.632993 29609 raft_consensus.cc:359] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.633764 29609 raft_consensus.cc:385] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.634032 29609 raft_consensus.cc:740] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.634752 29609 consensus_queue.cc:260] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.638271 29312 catalog_manager.cc:5697] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.640465 29608 tablet_bootstrap.cc:654] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.641237 29311 catalog_manager.cc:5697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 1 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.649574 29608 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: No bootstrap required, opened a new log
I20260709 13:08:42.650125 29608 ts_tablet_manager.cc:1403] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.006s
I20260709 13:08:42.642715 29609 ts_tablet_manager.cc:1434] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:08:42.651752 29609 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.653155 29608 raft_consensus.cc:359] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.653889 29608 raft_consensus.cc:385] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.654201 29608 raft_consensus.cc:740] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.654938 29608 consensus_queue.cc:260] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.656967 29608 ts_tablet_manager.cc:1434] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:42.666175 29609 tablet_bootstrap.cc:654] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.673797 29609 tablet_bootstrap.cc:492] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.674238 29609 ts_tablet_manager.cc:1403] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 13:08:42.676544 29609 raft_consensus.cc:359] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.677151 29609 raft_consensus.cc:385] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.677417 29609 raft_consensus.cc:740] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.678130 29609 consensus_queue.cc:260] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.679898 29609 ts_tablet_manager.cc:1434] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:08:42.680755 29609 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.686767 29609 tablet_bootstrap.cc:654] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.692281 29609 tablet_bootstrap.cc:492] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.692730 29609 ts_tablet_manager.cc:1403] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:08:42.694576 29609 raft_consensus.cc:359] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.695127 29609 raft_consensus.cc:385] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.695402 29609 raft_consensus.cc:740] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.696046 29609 consensus_queue.cc:260] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.697515 29609 ts_tablet_manager.cc:1434] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:42.698189 29609 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: Bootstrap starting.
I20260709 13:08:42.702422 29609 tablet_bootstrap.cc:654] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:42.707151 29609 tablet_bootstrap.cc:492] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: No bootstrap required, opened a new log
I20260709 13:08:42.707588 29609 ts_tablet_manager.cc:1403] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:42.710155 29609 raft_consensus.cc:359] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.710621 29609 raft_consensus.cc:385] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:42.710930 29609 raft_consensus.cc:740] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Initialized, Role: FOLLOWER
I20260709 13:08:42.711464 29609 consensus_queue.cc:260] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.712975 29609 ts_tablet_manager.cc:1434] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 13:08:42.751960 29359 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:42.785111 29640 raft_consensus.cc:493] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.785706 29640 raft_consensus.cc:515] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.787377 29640 leader_election.cc:290] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.788352 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.788552 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.788893 29414 raft_consensus.cc:2468] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.789213 29562 raft_consensus.cc:2468] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.790028 29456 leader_election.cc:304] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.790881 29640 raft_consensus.cc:2804] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.791226 29640 raft_consensus.cc:493] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.791558 29640 raft_consensus.cc:3060] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.798375 29640 raft_consensus.cc:515] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.800449 29640 leader_election.cc:290] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.800721 29643 raft_consensus.cc:493] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.801282 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.801154 29643 raft_consensus.cc:515] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.801559 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a2ac8ecb6434d7b8ef8462c59c01717" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.801913 29414 raft_consensus.cc:3060] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.802052 29562 raft_consensus.cc:3060] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.803184 29643 leader_election.cc:290] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.804824 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.805426 29564 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.806595 29454 leader_election.cc:304] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.807339 29643 raft_consensus.cc:493] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.807739 29643 raft_consensus.cc:515] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.808271 29414 raft_consensus.cc:2468] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.808271 29562 raft_consensus.cc:2468] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.809563 29643 leader_election.cc:290] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.809510 29454 leader_election.cc:304] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.810166 29643 raft_consensus.cc:2804] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.810626 29643 raft_consensus.cc:493] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.810994 29640 raft_consensus.cc:2804] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.811193 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.811561 29640 raft_consensus.cc:697] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:42.812623 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.812428 29640 consensus_queue.cc:237] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.813647 29562 raft_consensus.cc:2393] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9122ed3bd39401dbb86fc07556fc78c in current term 1: Already voted for candidate 3644324927284bb3a0eb4c1c10f5e565 in this term.
I20260709 13:08:42.814323 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.815162 29414 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.815227 29454 leader_election.cc:304] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9122ed3bd39401dbb86fc07556fc78c; no voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:42.810994 29643 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.816315 29617 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.823228 29643 raft_consensus.cc:515] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.823711 29617 raft_consensus.cc:2749] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.824910 29310 catalog_manager.cc:5697] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 0 to 1, leader changed from <none> to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 1 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.826140 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.826457 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.826795 29414 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.827051 29562 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.833336 29414 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.833446 29562 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.834581 29456 leader_election.cc:304] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.834789 29643 leader_election.cc:290] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.835456 29643 raft_consensus.cc:2804] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.836107 29643 raft_consensus.cc:697] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:42.836912 29643 consensus_queue.cc:237] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.845243 29613 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.844913 29310 catalog_manager.cc:5697] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 0 to 1, leader changed from <none> to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 1 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.845712 29613 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.847756 29613 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:42.849210 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.849849 29414 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 0.
I20260709 13:08:42.851207 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.851799 29490 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 0.
I20260709 13:08:42.852702 29530 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:42.854254 29614 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:42.854991 29613 raft_consensus.cc:2804] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.855376 29613 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.855784 29613 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.855836 29643 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.856364 29643 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.859074 29643 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127), 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:42.859575 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.861994 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565" is_pre_election: true
I20260709 13:08:42.862632 29414 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 0.
I20260709 13:08:42.864488 29456 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.865268 29643 raft_consensus.cc:2804] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.865619 29643 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.865945 29643 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.867550 29613 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.868685 29562 raft_consensus.cc:2393] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9122ed3bd39401dbb86fc07556fc78c in current term 1: Already voted for candidate 90cf0f51cc5249ad830ec0f497446b4d in this term.
I20260709 13:08:42.873217 29642 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:42.873878 29643 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.876531 29643 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Requested vote from peers 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127), 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:42.878321 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.878377 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.879001 29414 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.879474 29564 raft_consensus.cc:2393] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9122ed3bd39401dbb86fc07556fc78c in current term 1: Already voted for candidate 90cf0f51cc5249ad830ec0f497446b4d in this term.
I20260709 13:08:42.886744 29414 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 1.
I20260709 13:08:42.888113 29456 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:42.889029 29643 raft_consensus.cc:2804] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.891259 29643 raft_consensus.cc:697] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:42.892104 29643 consensus_queue.cc:237] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:42.893838 29640 consensus_queue.cc:1048] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:42.894667 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.898041 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:42.898622 29613 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:42.899032 29415 raft_consensus.cc:2393] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 90cf0f51cc5249ad830ec0f497446b4d in current term 1: Already voted for candidate b9122ed3bd39401dbb86fc07556fc78c in this term.
I20260709 13:08:42.900760 29530 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d; no voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.901760 29613 raft_consensus.cc:2749] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.910665 29637 raft_consensus.cc:493] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.911455 29637 raft_consensus.cc:515] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.915264 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.916157 29488 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 0.
I20260709 13:08:42.917541 29381 leader_election.cc:304] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:42.918859 29642 raft_consensus.cc:2804] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:42.919204 29642 raft_consensus.cc:493] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.919538 29642 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.921517 29637 leader_election.cc:290] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.928824 29642 raft_consensus.cc:515] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.938164 29642 leader_election.cc:290] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.936228 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.939039 29562 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 0.
I20260709 13:08:42.940125 29613 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:42.941690 29562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:42.942297 29562 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.946023 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:42.946820 29490 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.949208 29562 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 1.
I20260709 13:08:42.952896 29642 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.953348 29642 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.955828 29642 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:42.957185 29379 leader_election.cc:304] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:42.957818 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d" is_pre_election: true
I20260709 13:08:42.958390 29642 raft_consensus.cc:2804] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:42.959101 29489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c" is_pre_election: true
I20260709 13:08:42.959573 29490 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 1.
I20260709 13:08:42.959698 29642 raft_consensus.cc:697] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:42.959899 29489 raft_consensus.cc:2393] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3644324927284bb3a0eb4c1c10f5e565 in current term 1: Already voted for candidate 90cf0f51cc5249ad830ec0f497446b4d in this term.
I20260709 13:08:42.961311 29381 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565; no voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:42.962325 29614 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:42.964742 29640 consensus_queue.cc:1048] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:42.969802 29614 raft_consensus.cc:2749] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:42.961463 29642 consensus_queue.cc:237] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:42.983194 29310 catalog_manager.cc:5697] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 0 to 1, leader changed from <none> to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 1 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.006246 29613 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.008683 29312 catalog_manager.cc:5697] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.061347 29642 consensus_queue.cc:1048] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.073141 29637 consensus_queue.cc:1048] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.081467 29636 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.091477 29636 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.217514 29617 consensus_queue.cc:1048] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.218295 29643 consensus_queue.cc:1048] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.240582 29684 consensus_queue.cc:1048] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.248679 29640 consensus_queue.cc:1048] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.276253 29640 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.287286 29684 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:43.362674 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55028
I20260709 13:08:43.363337 29490 raft_consensus.cc:606] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Received request to transfer leadership to TS 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:43.381846 29564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
mode: GRACEFUL
new_leader_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:08:43.382413 29564 raft_consensus.cc:606] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Received request to transfer leadership to TS 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:43.394203 29564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:08:43.394748 29564 raft_consensus.cc:606] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:43.410871 29415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030a9864f0dd497586523806864a7dbb"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:08:43.411487 29415 raft_consensus.cc:606] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:43.419296 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:55028
I20260709 13:08:43.419821 29490 raft_consensus.cc:606] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Received request to transfer leadership to TS 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:43.513638 29637 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.520754 29642 raft_consensus.cc:993] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:43.521265 29642 raft_consensus.cc:1081] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:43.526356 29641 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:43.528628 29490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030a9864f0dd497586523806864a7dbb"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55014
I20260709 13:08:43.530191 29490 raft_consensus.cc:493] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.530663 29490 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.541378 29490 raft_consensus.cc:515] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.544570 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:43.545235 29415 raft_consensus.cc:3055] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.545603 29415 raft_consensus.cc:740] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:43.546550 29415 consensus_queue.cc:260] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.547999 29415 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.550040 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:43.550686 29564 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.555675 29415 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:43.557055 29456 leader_election.cc:304] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:43.557614 29564 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:43.557879 29684 raft_consensus.cc:2804] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.558420 29684 raft_consensus.cc:697] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:43.559125 29490 leader_election.cc:290] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:43.559594 29684 consensus_queue.cc:237] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.566597 29312 catalog_manager.cc:5697] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 1 to 2, leader changed from 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 2 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.688999 29647 raft_consensus.cc:993] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: : Instructing follower 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:43.689476 29636 raft_consensus.cc:1081] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Signalling peer 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:43.691039 29415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55092
I20260709 13:08:43.691571 29415 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.691903 29415 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.698127 29415 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.700802 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:43.701149 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:43.701436 29490 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.701716 29564 raft_consensus.cc:3055] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.702023 29564 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:43.702996 29415 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:43.702878 29564 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.703962 29564 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.707082 29490 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:43.708214 29381 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:43.708870 29641 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.709296 29641 raft_consensus.cc:697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:43.709935 29564 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:43.709996 29641 consensus_queue.cc:237] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.716462 29312 catalog_manager.cc:5697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 1 to 2, leader changed from 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3) to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.830255 29647 raft_consensus.cc:993] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:43.830734 29636 raft_consensus.cc:1081] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:43.832263 29490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55020
I20260709 13:08:43.832770 29490 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.833068 29490 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.837481 29490 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.839027 29490 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:43.840040 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:43.840188 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:43.840503 29415 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.840713 29564 raft_consensus.cc:3055] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.841063 29564 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:43.841684 29564 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.842540 29564 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.845347 29415 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:43.846475 29456 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:43.847309 29684 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.847690 29684 raft_consensus.cc:697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:43.848623 29564 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:43.848469 29684 consensus_queue.cc:237] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.854424 29312 catalog_manager.cc:5697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 1 to 2, leader changed from 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 2 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.856755 29617 raft_consensus.cc:993] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:43.857175 29684 raft_consensus.cc:1081] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Signalling peer 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:43.858778 29415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:08:43.859334 29415 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.859692 29415 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.861773 29643 raft_consensus.cc:993] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:43.862260 29643 raft_consensus.cc:1081] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Signalling peer 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:43.864068 29564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:08:43.864537 29564 raft_consensus.cc:493] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.864848 29564 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.865818 29415 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:43.867916 29415 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Requested vote from peers 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:43.868548 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:43.868954 29563 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.870676 29564 raft_consensus.cc:515] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.871824 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:43.872388 29490 raft_consensus.cc:3055] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.873503 29490 raft_consensus.cc:740] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:43.873595 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:43.873840 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb49d868fd4742eabaaf062f2291a437" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:43.874142 29415 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.874420 29488 raft_consensus.cc:3055] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:43.874593 29563 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:43.872862 29564 leader_election.cc:290] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 2 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:43.874889 29488 raft_consensus.cc:740] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:43.874334 29490 consensus_queue.cc:260] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:43.875783 29379 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:43.875761 29488 consensus_queue.cc:260] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.876446 29490 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.876869 29488 raft_consensus.cc:3060] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.878880 29641 raft_consensus.cc:2804] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.879252 29641 raft_consensus.cc:697] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:43.879855 29641 consensus_queue.cc:237] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:43.880622 29415 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 2.
I20260709 13:08:43.881917 29530 leader_election.cc:304] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:43.882746 29636 raft_consensus.cc:2804] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:43.883198 29636 raft_consensus.cc:697] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:43.883463 29490 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:43.883865 29636 consensus_queue.cc:237] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:43.889428 29488 raft_consensus.cc:2468] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 2.
I20260709 13:08:43.889042 29312 catalog_manager.cc:5697] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 1 to 2, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.891583 29309 catalog_manager.cc:5697] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 1 to 2, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 2 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.065908 29563 raft_consensus.cc:1275] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.067361 29643 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.076443 29415 raft_consensus.cc:1275] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.078135 29643 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.190043 29563 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.191339 29641 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.200359 29488 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.202410 29702 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.275041 29563 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.276269 29643 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.284756 29415 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.286959 29617 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.312774 29488 raft_consensus.cc:1275] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.314077 29647 consensus_queue.cc:1048] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.322525 29415 raft_consensus.cc:1275] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.324087 29636 consensus_queue.cc:1048] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.391098 29488 raft_consensus.cc:1275] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.391280 29563 raft_consensus.cc:1275] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.392585 29614 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:44.393381 29702 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.451092 29280 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:08:46.451956 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.473414 29415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
mode: GRACEFUL
new_leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:55110
I20260709 13:08:46.474009 29415 raft_consensus.cc:606] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Received request to transfer leadership to TS 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:46.484555 29488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:46.485128 29488 raft_consensus.cc:606] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Received request to transfer leadership to TS 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:46.486338 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:46.486866 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:46.715746 29713 raft_consensus.cc:993] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: : Instructing follower 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:46.716316 29614 raft_consensus.cc:1081] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Signalling peer 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:46.717936 29564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:58362
I20260709 13:08:46.718502 29564 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.718904 29564 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.725195 29564 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.727330 29564 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:46.727866 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:46.728580 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:46.728766 29415 raft_consensus.cc:3055] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.729116 29488 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.729110 29415 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:46.730082 29415 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.731304 29415 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.736161 29488 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:46.737449 29530 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:46.737668 29415 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:46.738161 29712 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.739362 29712 raft_consensus.cc:697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:46.740038 29712 consensus_queue.cc:237] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.748337 29309 catalog_manager.cc:5697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 2 to 3, leader changed from 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1) to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 3 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:46.806258 29617 raft_consensus.cc:993] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:46.806666 29723 raft_consensus.cc:1081] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Signalling peer 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:46.808019 29563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:08:46.808549 29563 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.808871 29563 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.813319 29563 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.814939 29563 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:46.815757 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:46.815997 29488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:46.816354 29415 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.816502 29488 raft_consensus.cc:3055] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.816833 29488 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:46.817502 29488 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.818365 29488 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.820969 29415 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:46.821949 29530 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:46.822633 29712 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.823012 29488 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:46.823117 29712 raft_consensus.cc:697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:46.824018 29712 consensus_queue.cc:237] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:46.830369 29309 catalog_manager.cc:5697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 2 to 3, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 3 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.234871 29488 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.235013 29415 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.236256 29712 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.236501 29717 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.257715 29414 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.261557 29490 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:47.264535 29727 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:47.269272 29727 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:47.487740 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.497438 29414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:08:47.497987 29414 raft_consensus.cc:606] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:47.502578 29414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:08:47.503120 29414 raft_consensus.cc:606] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:47.507411 29563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:08:47.507926 29563 raft_consensus.cc:606] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:47.512446 29414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2567ad9f73664416afe7819a900da08a"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:08:47.512985 29414 raft_consensus.cc:606] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:47.520108 29563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
mode: GRACEFUL
new_leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:58374
I20260709 13:08:47.520628 29563 raft_consensus.cc:606] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Received request to transfer leadership to TS b9122ed3bd39401dbb86fc07556fc78c
I20260709 13:08:47.552557 29614 raft_consensus.cc:993] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.553013 29735 raft_consensus.cc:1081] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.554371 29488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55014
I20260709 13:08:47.554876 29488 raft_consensus.cc:493] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.555190 29488 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.559620 29488 raft_consensus.cc:515] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.561414 29488 leader_election.cc:290] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:47.562263 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:47.562418 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:47.562983 29414 raft_consensus.cc:3055] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:47.563078 29563 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.563306 29414 raft_consensus.cc:740] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:47.564024 29414 consensus_queue.cc:260] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.564915 29414 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.567963 29563 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:47.569126 29454 leader_election.cc:304] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:47.569748 29414 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:47.569988 29723 raft_consensus.cc:2804] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:47.571063 29723 raft_consensus.cc:697] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:47.571913 29723 consensus_queue.cc:237] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.578547 29310 catalog_manager.cc:5697] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 1 to 2, leader changed from 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 2 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.789965 29729 raft_consensus.cc:993] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.790400 29741 raft_consensus.cc:1081] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.791812 29488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55020
I20260709 13:08:47.792275 29488 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.792550 29488 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.797487 29488 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.799127 29488 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 4 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:47.800001 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:47.800124 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:47.800573 29414 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.800621 29563 raft_consensus.cc:3055] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:47.801023 29563 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:47.801800 29563 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.803064 29563 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.805325 29414 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 4.
I20260709 13:08:47.806298 29456 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:47.807032 29723 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.807458 29723 raft_consensus.cc:697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:47.808249 29723 consensus_queue.cc:237] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.809603 29563 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 4.
I20260709 13:08:47.814718 29310 catalog_manager.cc:5697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 3 to 4, leader changed from 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 4 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.817173 29735 raft_consensus.cc:993] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.817565 29735 raft_consensus.cc:1081] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.819237 29490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55014
I20260709 13:08:47.819777 29490 raft_consensus.cc:493] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.820130 29490 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.826848 29490 raft_consensus.cc:515] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:47.829485 29741 raft_consensus.cc:993] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.829553 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:47.829875 29490 leader_election.cc:290] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 3 election: Requested vote from peers 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127), 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673)
I20260709 13:08:47.830063 29741 raft_consensus.cc:1081] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:47.830271 29563 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.830039 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24e3637d70b4632878a145dd0fc92f9" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:47.830926 29414 raft_consensus.cc:3055] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:47.831207 29414 raft_consensus.cc:740] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:47.831835 29490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55020
I20260709 13:08:47.831899 29414 consensus_queue.cc:260] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:47.832376 29490 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.832655 29490 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.832893 29414 raft_consensus.cc:3060] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.837584 29414 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 3.
I20260709 13:08:47.838256 29490 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.838670 29456 leader_election.cc:304] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:47.839483 29723 raft_consensus.cc:2804] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:47.839916 29723 raft_consensus.cc:697] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 3 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:47.840823 29490 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 4 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:47.840973 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:47.841477 29563 raft_consensus.cc:2468] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 3.
I20260709 13:08:47.841642 29414 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.841856 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:47.842450 29564 raft_consensus.cc:3055] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:47.842856 29564 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:47.842675 29723 consensus_queue.cc:237] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } }
I20260709 13:08:47.843686 29564 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.845031 29564 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.849624 29414 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 4.
I20260709 13:08:47.851172 29456 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:47.852036 29564 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 4.
I20260709 13:08:47.852998 29723 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.853497 29723 raft_consensus.cc:697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:47.854178 29723 consensus_queue.cc:237] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:47.856431 29310 catalog_manager.cc:5697] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 2 to 3, leader changed from 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 3 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.867851 29310 catalog_manager.cc:5697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 3 to 4, leader changed from 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 4 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.005373 29564 raft_consensus.cc:1275] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.006613 29723 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.017561 29414 raft_consensus.cc:1275] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.019438 29723 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.052517 29735 raft_consensus.cc:993] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: : Instructing follower b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:48.052963 29614 raft_consensus.cc:1081] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Signalling peer b9122ed3bd39401dbb86fc07556fc78c to start an election
I20260709 13:08:48.054359 29490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2567ad9f73664416afe7819a900da08a"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
 from {username='slave'} at 127.0.0.1:55014
I20260709 13:08:48.054884 29490 raft_consensus.cc:493] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:48.055198 29490 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.059712 29490 raft_consensus.cc:515] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:48.061295 29490 leader_election.cc:290] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:48.062407 29414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:48.062496 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567ad9f73664416afe7819a900da08a" candidate_uuid: "b9122ed3bd39401dbb86fc07556fc78c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:48.063076 29414 raft_consensus.cc:3055] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.063143 29564 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.063441 29414 raft_consensus.cc:740] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:48.064239 29414 consensus_queue.cc:260] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:48.065413 29414 raft_consensus.cc:3060] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.068786 29564 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:48.069721 29454 leader_election.cc:304] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90cf0f51cc5249ad830ec0f497446b4d, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:48.070524 29723 raft_consensus.cc:2804] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.071027 29723 raft_consensus.cc:697] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Leader. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:48.071832 29414 raft_consensus.cc:2468] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9122ed3bd39401dbb86fc07556fc78c in term 2.
I20260709 13:08:48.071782 29723 consensus_queue.cc:237] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:48.078989 29312 catalog_manager.cc:5697] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c reported cstate change: term changed from 1 to 2, leader changed from 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1) to b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2). New cstate: current_term: 2 leader_uuid: "b9122ed3bd39401dbb86fc07556fc78c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.260562 29564 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.261497 29414 raft_consensus.cc:1275] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.261904 29723 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.262964 29736 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.276954 29414 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.277058 29563 raft_consensus.cc:1275] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.282831 29746 consensus_queue.cc:1048] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.284278 29736 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.378015 29414 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.379422 29723 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.387827 29563 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:48.389909 29723 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:48.648434 29414 raft_consensus.cc:1275] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.649742 29723 consensus_queue.cc:1048] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.657234 29563 raft_consensus.cc:1275] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer b9122ed3bd39401dbb86fc07556fc78c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.659356 29723 consensus_queue.cc:1048] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.530629 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:50.539076 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030a9864f0dd497586523806864a7dbb"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:50.539718 29490 raft_consensus.cc:606] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Received request to transfer leadership to TS 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:50.542181 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:50.542580 29490 raft_consensus.cc:606] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Received request to transfer leadership to TS 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:50.544745 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:50.545130 29490 raft_consensus.cc:606] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Received request to transfer leadership to TS 90cf0f51cc5249ad830ec0f497446b4d
I20260709 13:08:50.547276 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:50.547657 29490 raft_consensus.cc:606] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Received request to transfer leadership to TS 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:50.549786 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b"
dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
mode: GRACEFUL
new_leader_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55038
I20260709 13:08:50.550168 29490 raft_consensus.cc:606] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Received request to transfer leadership to TS 3644324927284bb3a0eb4c1c10f5e565
I20260709 13:08:50.551271 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:50.551760 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.553929 29760 raft_consensus.cc:993] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:50.554406 29752 raft_consensus.cc:1081] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Signalling peer 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:50.555920 29564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030a9864f0dd497586523806864a7dbb"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:08:50.556377 29564 raft_consensus.cc:493] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.556686 29564 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.561318 29564 raft_consensus.cc:515] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.563050 29564 leader_election.cc:290] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:50.564078 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:50.564271 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030a9864f0dd497586523806864a7dbb" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:50.564731 29415 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.564851 29490 raft_consensus.cc:3055] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.565228 29490 raft_consensus.cc:740] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:50.565869 29490 consensus_queue.cc:260] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.566907 29490 raft_consensus.cc:3060] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.569499 29415 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:50.570655 29530 leader_election.cc:304] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:50.571451 29741 raft_consensus.cc:2804] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.571877 29490 raft_consensus.cc:2468] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:50.572530 29741 raft_consensus.cc:697] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:50.573582 29741 consensus_queue.cc:237] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.580585 29309 catalog_manager.cc:5697] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 2 to 3, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 3 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.761389 29760 raft_consensus.cc:993] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:50.761920 29752 raft_consensus.cc:1081] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Signalling peer 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:50.763397 29415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:08:50.763835 29415 raft_consensus.cc:493] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.764110 29415 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.768478 29415 raft_consensus.cc:515] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.770108 29415 leader_election.cc:290] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 5 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:50.771018 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:50.771428 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cdae9576e3b4cf6978eb766eb8d1b04" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:50.771623 29490 raft_consensus.cc:3055] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.771942 29564 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.771958 29490 raft_consensus.cc:740] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:50.773025 29490 consensus_queue.cc:260] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.774201 29490 raft_consensus.cc:3060] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.774660 29760 raft_consensus.cc:993] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:50.775170 29752 raft_consensus.cc:1081] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Signalling peer 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:50.776515 29415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:08:50.776930 29415 raft_consensus.cc:493] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.777284 29415 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.778272 29564 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 5.
I20260709 13:08:50.779651 29379 leader_election.cc:304] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:50.780884 29490 raft_consensus.cc:2468] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 5.
I20260709 13:08:50.783257 29767 raft_consensus.cc:2804] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.784108 29415 raft_consensus.cc:515] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.784523 29767 raft_consensus.cc:697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 5 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:50.785472 29767 consensus_queue.cc:237] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.786355 29415 leader_election.cc:290] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 5 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:50.786633 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:50.787091 29564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9b1fa464614b3c86e5f7a01f9cd5ba" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:50.787221 29490 raft_consensus.cc:3055] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.787652 29490 raft_consensus.cc:740] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:50.787645 29564 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.788442 29490 consensus_queue.cc:260] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.789742 29490 raft_consensus.cc:3060] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.794397 29490 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 5.
I20260709 13:08:50.794126 29309 catalog_manager.cc:5697] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 4 to 5, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 5 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.794955 29564 raft_consensus.cc:2468] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 5.
I20260709 13:08:50.795547 29381 leader_election.cc:304] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, b9122ed3bd39401dbb86fc07556fc78c; no voters: 
I20260709 13:08:50.796387 29767 raft_consensus.cc:2804] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.797384 29767 raft_consensus.cc:697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 5 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:50.798247 29767 consensus_queue.cc:237] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.806990 29309 catalog_manager.cc:5697] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 4 to 5, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 5 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.977341 29752 raft_consensus.cc:993] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:50.978048 29760 raft_consensus.cc:1081] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Signalling peer 90cf0f51cc5249ad830ec0f497446b4d to start an election
I20260709 13:08:50.979641 29563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7"
dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
 from {username='slave'} at 127.0.0.1:58366
I20260709 13:08:50.980137 29563 raft_consensus.cc:493] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.980412 29563 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.985129 29563 raft_consensus.cc:515] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.986675 29563 leader_election.cc:290] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Requested vote from peers 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673), b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605)
I20260709 13:08:50.987428 29415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
I20260709 13:08:50.987799 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43256921af5e4beaa7bce2892492dfd7" candidate_uuid: "90cf0f51cc5249ad830ec0f497446b4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:50.987999 29415 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.988322 29490 raft_consensus.cc:3055] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.988631 29490 raft_consensus.cc:740] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:50.989351 29490 consensus_queue.cc:260] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:50.990444 29490 raft_consensus.cc:3060] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.994061 29415 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:50.995247 29530 leader_election.cc:304] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:50.996104 29741 raft_consensus.cc:2804] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.996426 29490 raft_consensus.cc:2468] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90cf0f51cc5249ad830ec0f497446b4d in term 3.
I20260709 13:08:50.996570 29741 raft_consensus.cc:697] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Becoming Leader. State: Replica: 90cf0f51cc5249ad830ec0f497446b4d, State: Running, Role: LEADER
I20260709 13:08:50.997503 29741 consensus_queue.cc:237] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:51.005513 29309 catalog_manager.cc:5697] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d reported cstate change: term changed from 2 to 3, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3). New cstate: current_term: 3 leader_uuid: "90cf0f51cc5249ad830ec0f497446b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.081624 29752 raft_consensus.cc:993] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: : Instructing follower 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:51.082211 29771 raft_consensus.cc:1081] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Signalling peer 3644324927284bb3a0eb4c1c10f5e565 to start an election
I20260709 13:08:51.083700 29415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b"
dest_uuid: "3644324927284bb3a0eb4c1c10f5e565"
 from {username='slave'} at 127.0.0.1:55102
I20260709 13:08:51.084172 29415 raft_consensus.cc:493] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.084477 29415 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.088424 29415 raft_consensus.cc:515] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:51.089923 29415 leader_election.cc:290] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Requested vote from peers b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2:43605), 90cf0f51cc5249ad830ec0f497446b4d (127.28.152.3:37127)
I20260709 13:08:51.090878 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9122ed3bd39401dbb86fc07556fc78c"
I20260709 13:08:51.091014 29563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a2a8b4f04846e4a401a80cc92a637b" candidate_uuid: "3644324927284bb3a0eb4c1c10f5e565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90cf0f51cc5249ad830ec0f497446b4d"
I20260709 13:08:51.091427 29490 raft_consensus.cc:3055] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.091496 29563 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.091831 29490 raft_consensus.cc:740] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9122ed3bd39401dbb86fc07556fc78c, State: Running, Role: LEADER
I20260709 13:08:51.092581 29490 consensus_queue.cc:260] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:51.093741 29490 raft_consensus.cc:3060] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.097713 29563 raft_consensus.cc:2468] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:51.098865 29379 leader_election.cc:304] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3644324927284bb3a0eb4c1c10f5e565, 90cf0f51cc5249ad830ec0f497446b4d; no voters: 
I20260709 13:08:51.099700 29490 raft_consensus.cc:2468] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3644324927284bb3a0eb4c1c10f5e565 in term 2.
I20260709 13:08:51.099658 29767 raft_consensus.cc:2804] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:51.100329 29767 raft_consensus.cc:697] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Becoming Leader. State: Replica: 3644324927284bb3a0eb4c1c10f5e565, State: Running, Role: LEADER
I20260709 13:08:51.101243 29767 consensus_queue.cc:237] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } }
I20260709 13:08:51.103525 29490 raft_consensus.cc:1275] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.104938 29741 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.109921 29309 catalog_manager.cc:5697] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 reported cstate change: term changed from 1 to 2, leader changed from b9122ed3bd39401dbb86fc07556fc78c (127.28.152.2) to 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3644324927284bb3a0eb4c1c10f5e565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.122772 29415 raft_consensus.cc:1275] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.124585 29777 consensus_queue.cc:1048] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.183024 29490 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:51.184115 29767 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:51.193100 29563 raft_consensus.cc:1275] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:51.195081 29767 consensus_queue.cc:1048] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:51.384037 29415 raft_consensus.cc:1275] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.385303 29777 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3644324927284bb3a0eb4c1c10f5e565" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.386616 29563 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:51.388203 29781 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:51.394237 29490 raft_consensus.cc:1275] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:51.396121 29781 consensus_queue.cc:1048] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:51.396452 29490 raft_consensus.cc:1275] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Refusing update from remote peer 90cf0f51cc5249ad830ec0f497446b4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.398378 29761 consensus_queue.cc:1048] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:51.482311 29490 raft_consensus.cc:1275] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:51.483474 29781 consensus_queue.cc:1048] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9122ed3bd39401dbb86fc07556fc78c" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.494210 29563 raft_consensus.cc:1275] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Refusing update from remote peer 3644324927284bb3a0eb4c1c10f5e565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:51.495604 29788 consensus_queue.cc:1048] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90cf0f51cc5249ad830ec0f497446b4d" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.552773 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.558579 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
W20260709 13:08:51.565608 29530 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:51.585230 29530 consensus_peers.cc:597] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d -> Peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Couldn't send request to peer 3644324927284bb3a0eb4c1c10f5e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.597018 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.597936 29280 tablet_replica.cc:333] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.598660 29280 raft_consensus.cc:2243] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.599359 29280 raft_consensus.cc:2272] T 030a9864f0dd497586523806864a7dbb P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.602061 29280 tablet_replica.cc:333] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.602567 29280 raft_consensus.cc:2243] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.603348 29280 raft_consensus.cc:2272] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.606015 29280 tablet_replica.cc:333] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.606488 29280 raft_consensus.cc:2243] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.607208 29280 raft_consensus.cc:2272] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 3644324927284bb3a0eb4c1c10f5e565 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.609091 29280 tablet_replica.cc:333] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.609580 29280 raft_consensus.cc:2243] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.609978 29280 raft_consensus.cc:2272] T e24e3637d70b4632878a145dd0fc92f9 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.611629 29280 tablet_replica.cc:333] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.612116 29280 raft_consensus.cc:2243] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.612493 29280 raft_consensus.cc:2272] T cb49d868fd4742eabaaf062f2291a437 P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.614125 29280 tablet_replica.cc:333] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.614604 29280 raft_consensus.cc:2243] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.615173 29280 raft_consensus.cc:2272] T 2567ad9f73664416afe7819a900da08a P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.617167 29280 tablet_replica.cc:333] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.617683 29280 raft_consensus.cc:2243] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.618144 29280 raft_consensus.cc:2272] T 43256921af5e4beaa7bce2892492dfd7 P 3644324927284bb3a0eb4c1c10f5e565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.620716 29280 tablet_replica.cc:333] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
W20260709 13:08:51.620617 29456 consensus_peers.cc:597] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c -> Peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Couldn't send request to peer 3644324927284bb3a0eb4c1c10f5e565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.621493 29280 raft_consensus.cc:2243] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.622239 29280 raft_consensus.cc:2272] T 92a2a8b4f04846e4a401a80cc92a637b P 3644324927284bb3a0eb4c1c10f5e565 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.624280 29280 tablet_replica.cc:333] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565: stopping tablet replica
I20260709 13:08:51.624715 29280 raft_consensus.cc:2243] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.625073 29280 raft_consensus.cc:2272] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 3644324927284bb3a0eb4c1c10f5e565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.724393 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
I20260709 13:08:51.744239 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
I20260709 13:08:51.774326 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.775131 29280 tablet_replica.cc:333] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.775746 29280 raft_consensus.cc:2243] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.776183 29280 raft_consensus.cc:2272] T 030a9864f0dd497586523806864a7dbb P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.778390 29280 tablet_replica.cc:333] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.778927 29280 raft_consensus.cc:2243] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.779332 29280 raft_consensus.cc:2272] T cb49d868fd4742eabaaf062f2291a437 P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.780905 29280 tablet_replica.cc:333] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.781378 29280 raft_consensus.cc:2243] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.782104 29280 raft_consensus.cc:2272] T e24e3637d70b4632878a145dd0fc92f9 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.783776 29280 tablet_replica.cc:333] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.784337 29280 raft_consensus.cc:2243] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.784734 29280 raft_consensus.cc:2272] T 4cdae9576e3b4cf6978eb766eb8d1b04 P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.786618 29280 tablet_replica.cc:333] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.787220 29280 raft_consensus.cc:2243] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.787611 29280 raft_consensus.cc:2272] T 92a2a8b4f04846e4a401a80cc92a637b P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.789418 29280 tablet_replica.cc:333] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.789885 29280 raft_consensus.cc:2243] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.790570 29280 raft_consensus.cc:2272] T 4a2ac8ecb6434d7b8ef8462c59c01717 P b9122ed3bd39401dbb86fc07556fc78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.792050 29280 tablet_replica.cc:333] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.792501 29280 raft_consensus.cc:2243] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.792892 29280 raft_consensus.cc:2272] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P b9122ed3bd39401dbb86fc07556fc78c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.794826 29280 tablet_replica.cc:333] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.795284 29280 raft_consensus.cc:2243] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.795666 29280 raft_consensus.cc:2272] T 43256921af5e4beaa7bce2892492dfd7 P b9122ed3bd39401dbb86fc07556fc78c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.797788 29280 tablet_replica.cc:333] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c: stopping tablet replica
I20260709 13:08:51.798255 29280 raft_consensus.cc:2243] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.799134 29280 raft_consensus.cc:2272] T 2567ad9f73664416afe7819a900da08a P b9122ed3bd39401dbb86fc07556fc78c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.802127 29530 consensus_peers.cc:597] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d -> Peer 3644324927284bb3a0eb4c1c10f5e565 (127.28.152.1:35673): Couldn't send request to peer 3644324927284bb3a0eb4c1c10f5e565. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:35673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.826639 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:08:51.843076 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
I20260709 13:08:51.865621 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:51.866349 29280 tablet_replica.cc:333] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.867132 29280 raft_consensus.cc:2243] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.867585 29280 raft_consensus.cc:2272] T e24e3637d70b4632878a145dd0fc92f9 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.869199 29280 tablet_replica.cc:333] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.869653 29280 raft_consensus.cc:2243] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.870534 29280 raft_consensus.cc:2272] T cb49d868fd4742eabaaf062f2291a437 P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.872982 29280 tablet_replica.cc:333] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.873454 29280 raft_consensus.cc:2243] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.874109 29280 raft_consensus.cc:2272] T 030a9864f0dd497586523806864a7dbb P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.876662 29280 tablet_replica.cc:333] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.877103 29280 raft_consensus.cc:2243] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.877466 29280 raft_consensus.cc:2272] T 4cdae9576e3b4cf6978eb766eb8d1b04 P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.880041 29280 tablet_replica.cc:333] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.880492 29280 raft_consensus.cc:2243] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.880844 29280 raft_consensus.cc:2272] T 4a2ac8ecb6434d7b8ef8462c59c01717 P 90cf0f51cc5249ad830ec0f497446b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.882262 29280 tablet_replica.cc:333] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.882668 29280 raft_consensus.cc:2243] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.883065 29280 raft_consensus.cc:2272] T 92a2a8b4f04846e4a401a80cc92a637b P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.885094 29280 tablet_replica.cc:333] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.885526 29280 raft_consensus.cc:2243] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:51.886173 29280 raft_consensus.cc:2272] T 43256921af5e4beaa7bce2892492dfd7 P 90cf0f51cc5249ad830ec0f497446b4d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.887944 29280 tablet_replica.cc:333] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.888362 29280 raft_consensus.cc:2243] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.888702 29280 raft_consensus.cc:2272] T 2567ad9f73664416afe7819a900da08a P 90cf0f51cc5249ad830ec0f497446b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.890043 29280 tablet_replica.cc:333] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d: stopping tablet replica
I20260709 13:08:51.890424 29280 raft_consensus.cc:2243] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.890863 29280 raft_consensus.cc:2272] T 2c9b1fa464614b3c86e5f7a01f9cd5ba P 90cf0f51cc5249ad830ec0f497446b4d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.917244 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:08:51.935257 29280 master.cc:562] Master@127.28.152.62:38749 shutting down...
I20260709 13:08:52.066505 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:52.067126 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.067487 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 819a825c6d174d9f80f60484a9cfe068: stopping tablet replica
I20260709 13:08:52.088701 29280 master.cc:584] Master@127.28.152.62:38749 shutdown complete.
3644324927284bb3a0eb4c1c10f5e565  4
90cf0f51cc5249ad830ec0f497446b4d  1
b9122ed3bd39401dbb86fc07556fc78c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12842 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:08:52.128280 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:35589
I20260709 13:08:52.129345 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.134656 29793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.135787 29794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.136390 29796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.137202 29280 server_base.cc:1061] running on GCE node
I20260709 13:08:52.137974 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.138183 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.138357 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602532138337 us; error 0 us; skew 500 ppm
I20260709 13:08:52.138926 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.141278 29280 webserver.cc:533] Webserver started at http://127.28.152.62:43841/ using document root <none> and password file <none>
I20260709 13:08:52.141785 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.141988 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.142256 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.143735 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "204e49316a284becb4bf97d2812f10cc"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.148097 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:08:52.151429 29801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.152261 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:52.152487 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "204e49316a284becb4bf97d2812f10cc"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.152740 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.165771 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.167019 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.205436 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:35589
I20260709 13:08:52.205528 29852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:35589 every 8 connection(s)
I20260709 13:08:52.209491 29853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.218775 29853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc: Bootstrap starting.
I20260709 13:08:52.223301 29853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.227396 29853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc: No bootstrap required, opened a new log
I20260709 13:08:52.229517 29853 raft_consensus.cc:359] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER }
I20260709 13:08:52.229918 29853 raft_consensus.cc:385] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.230168 29853 raft_consensus.cc:740] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 204e49316a284becb4bf97d2812f10cc, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.230808 29853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER }
I20260709 13:08:52.231262 29853 raft_consensus.cc:399] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:52.231478 29853 raft_consensus.cc:493] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:52.231742 29853 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:52.235659 29853 raft_consensus.cc:515] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER }
I20260709 13:08:52.236114 29853 leader_election.cc:304] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 204e49316a284becb4bf97d2812f10cc; no voters: 
I20260709 13:08:52.237190 29853 leader_election.cc:290] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:52.237552 29856 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:52.238912 29856 raft_consensus.cc:697] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 1 LEADER]: Becoming Leader. State: Replica: 204e49316a284becb4bf97d2812f10cc, State: Running, Role: LEADER
I20260709 13:08:52.239537 29856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER }
I20260709 13:08:52.240173 29853 sys_catalog.cc:565] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:52.244380 29857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "204e49316a284becb4bf97d2812f10cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER } }
I20260709 13:08:52.245481 29858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 204e49316a284becb4bf97d2812f10cc. Latest consensus state: current_term: 1 leader_uuid: "204e49316a284becb4bf97d2812f10cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "204e49316a284becb4bf97d2812f10cc" member_type: VOTER } }
I20260709 13:08:52.246109 29857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.246273 29858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:52.249253 29865 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:52.254643 29865 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:52.257381 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:52.263387 29865 catalog_manager.cc:1383] Generated new cluster ID: 591fb8b4f02849db9561b6276a06977d
I20260709 13:08:52.263671 29865 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:52.285473 29865 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:52.286651 29865 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:52.301367 29865 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc: Generated new TSK 0
I20260709 13:08:52.301930 29865 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:52.324489 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.330124 29874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.331447 29875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.332944 29877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.333299 29280 server_base.cc:1061] running on GCE node
I20260709 13:08:52.334232 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.334407 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.334621 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602532334588 us; error 0 us; skew 500 ppm
I20260709 13:08:52.335202 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.337527 29280 webserver.cc:533] Webserver started at http://127.28.152.1:39093/ using document root <none> and password file <none>
I20260709 13:08:52.338032 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.338222 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.338519 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.339579 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.344069 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:52.347265 29882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.348016 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:52.348313 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.348593 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.373386 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.374722 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.376209 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.378397 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.378621 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.378947 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.379140 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.420006 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:35047
I20260709 13:08:52.420240 29944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:35047 every 8 connection(s)
I20260709 13:08:52.424674 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.432307 29949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.434235 29950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.436053 29952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.436856 29280 server_base.cc:1061] running on GCE node
I20260709 13:08:52.437731 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.437906 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.438102 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602532438087 us; error 0 us; skew 500 ppm
I20260709 13:08:52.438673 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.441606 29280 webserver.cc:533] Webserver started at http://127.28.152.2:40581/ using document root <none> and password file <none>
I20260709 13:08:52.442274 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.442533 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.442924 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.443358 29945 heartbeater.cc:344] Connected to a master server at 127.28.152.62:35589
I20260709 13:08:52.443753 29945 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.444283 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.444492 29945 heartbeater.cc:507] Master 127.28.152.62:35589 requested a full tablet report, sending...
I20260709 13:08:52.446587 29818 ts_manager.cc:194] Registered new tserver with Master: b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047)
I20260709 13:08:52.448326 29818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35656
I20260709 13:08:52.449852 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:52.453362 29957 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.454133 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:52.454452 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.454810 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.472184 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.473353 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.475023 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.477226 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.477402 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.477700 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.477864 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.520941 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:35743
I20260709 13:08:52.521049 30019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:35743 every 8 connection(s)
I20260709 13:08:52.525777 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:52.532500 30023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:52.532855 30024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.536862 29280 server_base.cc:1061] running on GCE node
W20260709 13:08:52.537460 30026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:52.537804 30020 heartbeater.cc:344] Connected to a master server at 127.28.152.62:35589
I20260709 13:08:52.538206 30020 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.538482 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:52.538697 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:52.538893 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602532538860 us; error 0 us; skew 500 ppm
I20260709 13:08:52.539021 30020 heartbeater.cc:507] Master 127.28.152.62:35589 requested a full tablet report, sending...
I20260709 13:08:52.539522 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:52.541280 29818 ts_manager.cc:194] Registered new tserver with Master: 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:52.542232 29280 webserver.cc:533] Webserver started at http://127.28.152.3:41331/ using document root <none> and password file <none>
I20260709 13:08:52.542809 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:52.542833 29818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35662
I20260709 13:08:52.543112 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:52.543465 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:52.544742 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "9f3a31f929584b969c86987c43ecfde5"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.549185 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:52.552559 30031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.553350 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:08:52.553640 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "9f3a31f929584b969c86987c43ecfde5"
format_stamp: "Formatted at 2026-07-09 13:08:52 on dist-test-slave-x7j4"
I20260709 13:08:52.553941 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:52.572386 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:52.573571 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:52.575543 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:52.577658 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:52.577875 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.578140 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:52.578322 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:52.617916 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:42111
I20260709 13:08:52.618011 30093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:42111 every 8 connection(s)
I20260709 13:08:52.631726 30094 heartbeater.cc:344] Connected to a master server at 127.28.152.62:35589
I20260709 13:08:52.632126 30094 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:52.632805 30094 heartbeater.cc:507] Master 127.28.152.62:35589 requested a full tablet report, sending...
I20260709 13:08:52.634804 29818 ts_manager.cc:194] Registered new tserver with Master: 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:52.635468 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01449055s
I20260709 13:08:52.636163 29818 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35666
I20260709 13:08:52.661114 29818 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35682:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:52.664037 29818 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:52.746256 30059 tablet_service.cc:1511] Processing CreateTablet for tablet acc3c1c51cdc453482436f718d2c9d7e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:52.747257 30056 tablet_service.cc:1511] Processing CreateTablet for tablet 4653ae5fe77b418cb0366ec6eba673b0 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:52.747850 30059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3c1c51cdc453482436f718d2c9d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.747834 30058 tablet_service.cc:1511] Processing CreateTablet for tablet f7fbae70e418471fb0a5c1dc9635fc9a (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:52.748728 30056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4653ae5fe77b418cb0366ec6eba673b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.750049 30057 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac63ad409e04df9a25566ed47412a88 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:52.751410 30057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac63ad409e04df9a25566ed47412a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.755750 30055 tablet_service.cc:1511] Processing CreateTablet for tablet d5016a1a05974aa3b9dd02041adf900e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:52.756181 29910 tablet_service.cc:1511] Processing CreateTablet for tablet acc3c1c51cdc453482436f718d2c9d7e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:52.756830 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fbae70e418471fb0a5c1dc9635fc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.757434 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5016a1a05974aa3b9dd02041adf900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.757531 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3c1c51cdc453482436f718d2c9d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.759759 29907 tablet_service.cc:1511] Processing CreateTablet for tablet 4653ae5fe77b418cb0366ec6eba673b0 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:52.760164 29909 tablet_service.cc:1511] Processing CreateTablet for tablet f7fbae70e418471fb0a5c1dc9635fc9a (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:52.760905 29907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4653ae5fe77b418cb0366ec6eba673b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.761499 29909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fbae70e418471fb0a5c1dc9635fc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.761340 29906 tablet_service.cc:1511] Processing CreateTablet for tablet d5016a1a05974aa3b9dd02041adf900e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:52.762609 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5016a1a05974aa3b9dd02041adf900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.762758 29908 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac63ad409e04df9a25566ed47412a88 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:52.764014 29908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac63ad409e04df9a25566ed47412a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.802203 30109 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:52.808768 30110 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:52.812724 30109 tablet_bootstrap.cc:654] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.815692 29906 tablet_service.cc:1511] Processing CreateTablet for tablet ba2d0a2d206743e7ad1e3b432b8fd03e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:52.816486 30110 tablet_bootstrap.cc:654] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.817245 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2d0a2d206743e7ad1e3b432b8fd03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.818450 30055 tablet_service.cc:1511] Processing CreateTablet for tablet ba2d0a2d206743e7ad1e3b432b8fd03e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:52.819815 30055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2d0a2d206743e7ad1e3b432b8fd03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.828243 29985 tablet_service.cc:1511] Processing CreateTablet for tablet acc3c1c51cdc453482436f718d2c9d7e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:52.829095 29982 tablet_service.cc:1511] Processing CreateTablet for tablet 4653ae5fe77b418cb0366ec6eba673b0 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:52.829769 29985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc3c1c51cdc453482436f718d2c9d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.829696 29984 tablet_service.cc:1511] Processing CreateTablet for tablet f7fbae70e418471fb0a5c1dc9635fc9a (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:52.830467 29982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4653ae5fe77b418cb0366ec6eba673b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.831300 29984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fbae70e418471fb0a5c1dc9635fc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.832793 29980 tablet_service.cc:1511] Processing CreateTablet for tablet ba2d0a2d206743e7ad1e3b432b8fd03e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:52.834029 29980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2d0a2d206743e7ad1e3b432b8fd03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.835871 29983 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac63ad409e04df9a25566ed47412a88 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:52.837209 29983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac63ad409e04df9a25566ed47412a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.839582 29981 tablet_service.cc:1511] Processing CreateTablet for tablet d5016a1a05974aa3b9dd02041adf900e (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:52.840927 29981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5016a1a05974aa3b9dd02041adf900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.851192 29979 tablet_service.cc:1511] Processing CreateTablet for tablet 55f2e4dfe9c947a9b191ec7487f84575 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:52.853608 29979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f2e4dfe9c947a9b191ec7487f84575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.855094 30056 tablet_service.cc:1511] Processing CreateTablet for tablet 55f2e4dfe9c947a9b191ec7487f84575 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:52.856452 30056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f2e4dfe9c947a9b191ec7487f84575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.851480 29906 tablet_service.cc:1511] Processing CreateTablet for tablet 55f2e4dfe9c947a9b191ec7487f84575 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:52.867095 29908 tablet_service.cc:1511] Processing CreateTablet for tablet 985c4742a3034ccebabbf2e6154986b1 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:52.868424 29908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985c4742a3034ccebabbf2e6154986b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.878584 29978 tablet_service.cc:1511] Processing CreateTablet for tablet 985c4742a3034ccebabbf2e6154986b1 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:52.879359 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 985c4742a3034ccebabbf2e6154986b1 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:52.880621 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985c4742a3034ccebabbf2e6154986b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.888996 30109 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:52.889102 29910 tablet_service.cc:1511] Processing CreateTablet for tablet ce685fd8d02c4517a9645975113edf3d (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:52.890504 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce685fd8d02c4517a9645975113edf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.891099 30110 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:52.891563 30110 ts_tablet_manager.cc:1403] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.000s
I20260709 13:08:52.892815 29977 tablet_service.cc:1511] Processing CreateTablet for tablet ce685fd8d02c4517a9645975113edf3d (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:52.895406 30057 tablet_service.cc:1511] Processing CreateTablet for tablet ce685fd8d02c4517a9645975113edf3d (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:52.889567 30109 ts_tablet_manager.cc:1403] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.010s
I20260709 13:08:52.896690 30057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce685fd8d02c4517a9645975113edf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.899415 30109 raft_consensus.cc:359] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.900123 30109 raft_consensus.cc:385] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.900408 30109 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.901393 30109 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.903362 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55f2e4dfe9c947a9b191ec7487f84575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.909385 29978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985c4742a3034ccebabbf2e6154986b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.910986 29909 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd6f9127ae748e2a1809528ad41e510 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:52.912297 29909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd6f9127ae748e2a1809528ad41e510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.913429 29984 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd6f9127ae748e2a1809528ad41e510 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:52.914733 29984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd6f9127ae748e2a1809528ad41e510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.919378 30109 ts_tablet_manager.cc:1434] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:08:52.920166 30094 heartbeater.cc:499] Master 127.28.152.62:35589 was elected leader, sending a full tablet report...
I20260709 13:08:52.920431 30109 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:52.894543 30110 raft_consensus.cc:359] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.925880 30110 raft_consensus.cc:385] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.927017 30110 raft_consensus.cc:740] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.930285 30109 tablet_bootstrap.cc:654] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.930819 29977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce685fd8d02c4517a9645975113edf3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.926852 30113 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:52.933741 30110 consensus_queue.cc:260] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.947089 29945 heartbeater.cc:499] Master 127.28.152.62:35589 was elected leader, sending a full tablet report...
I20260709 13:08:52.951536 30109 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:52.952095 30109 ts_tablet_manager.cc:1403] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.002s
I20260709 13:08:52.954686 30110 ts_tablet_manager.cc:1434] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.063s	user 0.000s	sys 0.009s
I20260709 13:08:52.956168 30109 raft_consensus.cc:359] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:52.957125 30109 raft_consensus.cc:385] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.957497 30109 raft_consensus.cc:740] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.955726 30110 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:52.958428 30109 consensus_queue.cc:260] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:52.960677 30109 ts_tablet_manager.cc:1434] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:52.961668 30109 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:52.958531 30058 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd6f9127ae748e2a1809528ad41e510 (DEFAULT_TABLE table=test-workload [id=eb7cccbecdaa43fc846558521fc37e12]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:52.965390 30058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd6f9127ae748e2a1809528ad41e510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.968578 30109 tablet_bootstrap.cc:654] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.970324 30113 tablet_bootstrap.cc:654] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.974263 30109 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:52.974759 30109 ts_tablet_manager.cc:1403] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:08:52.968578 30110 tablet_bootstrap.cc:654] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.977488 30109 raft_consensus.cc:359] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.978191 30109 raft_consensus.cc:385] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.978479 30109 raft_consensus.cc:740] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.979337 30109 consensus_queue.cc:260] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.981145 30113 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:52.981642 30113 ts_tablet_manager.cc:1403] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 13:08:52.981674 30109 ts_tablet_manager.cc:1434] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:52.983093 30109 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:52.984907 30113 raft_consensus.cc:359] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.985729 30113 raft_consensus.cc:385] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.986083 30113 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.987028 30113 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.989883 30110 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:52.990370 30110 ts_tablet_manager.cc:1403] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
I20260709 13:08:52.990859 30109 tablet_bootstrap.cc:654] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:52.993412 30110 raft_consensus.cc:359] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.994328 30110 raft_consensus.cc:385] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:52.994982 30110 raft_consensus.cc:740] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:52.996156 30110 consensus_queue.cc:260] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:52.999338 30110 ts_tablet_manager.cc:1434] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:08:53.000288 30110 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.005928 30020 heartbeater.cc:499] Master 127.28.152.62:35589 was elected leader, sending a full tablet report...
I20260709 13:08:53.006429 30113 ts_tablet_manager.cc:1434] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.011s
I20260709 13:08:53.007550 30113 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.008976 30110 tablet_bootstrap.cc:654] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.014264 30113 tablet_bootstrap.cc:654] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.016122 30109 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.016749 30109 ts_tablet_manager.cc:1403] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.005s
I20260709 13:08:53.020134 30109 raft_consensus.cc:359] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.020850 30109 raft_consensus.cc:385] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.021148 30109 raft_consensus.cc:740] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.021576 30110 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.022028 30110 ts_tablet_manager.cc:1403] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:08:53.021961 30109 consensus_queue.cc:260] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.024217 30109 ts_tablet_manager.cc:1434] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:08:53.025205 30110 raft_consensus.cc:359] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.025835 30109 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.026007 30110 raft_consensus.cc:385] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.026312 30110 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.027271 30110 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.031177 30113 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.031656 30113 ts_tablet_manager.cc:1403] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:08:53.032303 30109 tablet_bootstrap.cc:654] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.034543 30113 raft_consensus.cc:359] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.035280 30113 raft_consensus.cc:385] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.035581 30113 raft_consensus.cc:740] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.036669 30110 ts_tablet_manager.cc:1434] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:08:53.036309 30113 consensus_queue.cc:260] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.037819 30110 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.038761 30113 ts_tablet_manager.cc:1434] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:53.039891 30113 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.044832 30110 tablet_bootstrap.cc:654] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.047549 30113 tablet_bootstrap.cc:654] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.050400 30116 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.052102 30116 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.047923 30109 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.066563 30109 ts_tablet_manager.cc:1403] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:08:53.066901 30110 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.067387 30110 ts_tablet_manager.cc:1403] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.010s
I20260709 13:08:53.057139 30116 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.070174 30110 raft_consensus.cc:359] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.070988 30110 raft_consensus.cc:385] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.071301 30110 raft_consensus.cc:740] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.072104 30110 consensus_queue.cc:260] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.072835 30113 tablet_bootstrap.cc:492] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.073531 30113 ts_tablet_manager.cc:1403] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.025s
I20260709 13:08:53.074721 30110 ts_tablet_manager.cc:1434] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:08:53.083051 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.083586 30110 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
W20260709 13:08:53.084841 29886 leader_election.cc:343] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.072782 30109 raft_consensus.cc:359] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.085603 30109 raft_consensus.cc:385] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.085930 30109 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.085964 30113 raft_consensus.cc:359] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.086896 30113 raft_consensus.cc:385] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.087134 30114 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.087255 30113 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.087800 30114 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.088366 30113 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.090415 30110 tablet_bootstrap.cc:654] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.090603 30109 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.093561 30113 ts_tablet_manager.cc:1434] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:08:53.094594 30113 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.101868 30113 tablet_bootstrap.cc:654] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.105026 30109 ts_tablet_manager.cc:1434] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 13:08:53.107905 30114 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.114008 30113 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.117019 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.118043 29920 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.119554 30032 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.120537 30109 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.120563 30113 ts_tablet_manager.cc:1403] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:08:53.121155 30114 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.121675 30114 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.122120 30114 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.123845 30113 raft_consensus.cc:359] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.124646 30113 raft_consensus.cc:385] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.125013 30113 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.125931 30113 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.128356 30110 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.128528 30113 ts_tablet_manager.cc:1434] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:53.128952 30110 ts_tablet_manager.cc:1403] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.021s
I20260709 13:08:53.129580 30113 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.131085 30109 tablet_bootstrap.cc:654] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.132149 30110 raft_consensus.cc:359] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.132934 30110 raft_consensus.cc:385] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.133311 30110 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.134202 30110 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.135761 30129 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.136231 30129 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.136830 30110 ts_tablet_manager.cc:1434] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:53.137038 30113 tablet_bootstrap.cc:654] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.137982 30110 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.145030 30110 tablet_bootstrap.cc:654] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.144774 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.138494 30129 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.145612 29920 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.147396 30032 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.148541 30129 raft_consensus.cc:2804] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.149008 30129 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.149441 30129 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.168489 30114 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.172441 30116 raft_consensus.cc:493] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.172986 30116 raft_consensus.cc:515] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.175338 30116 leader_election.cc:290] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.177155 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
W20260709 13:08:53.178648 29886 leader_election.cc:343] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.181488 30129 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.183983 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.184751 29920 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.188099 30136 raft_consensus.cc:493] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.188720 30136 raft_consensus.cc:515] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.192250 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.193363 30069 raft_consensus.cc:2393] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b56dd23a863c46f39e7ca5db4ca94f43 in current term 1: Already voted for candidate 9f3a31f929584b969c86987c43ecfde5 in this term.
I20260709 13:08:53.193993 29920 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.195199 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.196112 30069 raft_consensus.cc:2468] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.195271 30032 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.199433 30114 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.199958 30114 raft_consensus.cc:493] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.200371 30114 raft_consensus.cc:515] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.201036 30110 tablet_bootstrap.cc:492] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.201563 30110 ts_tablet_manager.cc:1403] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.064s	user 0.032s	sys 0.016s
I20260709 13:08:53.201946 29884 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b56dd23a863c46f39e7ca5db4ca94f43; no voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5
I20260709 13:08:53.202392 30114 leader_election.cc:290] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.202970 30114 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.203447 30114 raft_consensus.cc:697] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.203537 30116 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.204401 30114 consensus_queue.cc:237] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.206625 30110 raft_consensus.cc:359] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.208485 30110 raft_consensus.cc:385] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.209452 30110 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.211509 30110 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.218437 30116 raft_consensus.cc:2749] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.220273 29884 leader_election.cc:304] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:08:53.222189 30140 raft_consensus.cc:2804] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.222748 30140 raft_consensus.cc:493] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.223184 30140 raft_consensus.cc:3060] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.224520 30110 ts_tablet_manager.cc:1434] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:08:53.228931 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.231323 29918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.230520 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.232362 29918 raft_consensus.cc:2468] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.232268 29818 catalog_manager.cc:5697] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.235153 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.235276 29994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.235857 29995 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.236959 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.237447 30032 leader_election.cc:304] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.237816 29993 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.238458 30137 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.239359 29919 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.239619 30138 raft_consensus.cc:2804] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.240010 30138 raft_consensus.cc:493] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.241019 29992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.241811 30138 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.241073 30032 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.244309 30114 raft_consensus.cc:2804] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.238957 30137 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.248265 30137 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.248335 30120 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.249030 30120 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
W20260709 13:08:53.252230 29866 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:53.255934 30110 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.266620 30136 leader_election.cc:290] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.254491 30120 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.269176 30116 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.269845 30116 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.272535 30116 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.276643 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
W20260709 13:08:53.279412 29884 leader_election.cc:343] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.279320 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.280153 29919 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.283888 30109 tablet_bootstrap.cc:492] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.283645 30140 raft_consensus.cc:515] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.284384 30109 ts_tablet_manager.cc:1403] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.005s
W20260709 13:08:53.285226 30035 leader_election.cc:343] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:53.286669 30035 leader_election.cc:343] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.287230 30032 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.291301 30110 tablet_bootstrap.cc:654] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.291613 29920 raft_consensus.cc:2393] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f3a31f929584b969c86987c43ecfde5 in current term 1: Already voted for candidate b56dd23a863c46f39e7ca5db4ca94f43 in this term.
I20260709 13:08:53.281683 30114 raft_consensus.cc:697] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.291849 30141 raft_consensus.cc:2804] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.292315 30141 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.292714 30141 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.292753 30114 consensus_queue.cc:237] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.294963 30129 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.295964 30113 tablet_bootstrap.cc:492] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.284297 29993 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.290117 30138 raft_consensus.cc:515] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.299685 30113 ts_tablet_manager.cc:1403] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.170s	user 0.051s	sys 0.078s
I20260709 13:08:53.288729 30109 raft_consensus.cc:359] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.302165 30109 raft_consensus.cc:385] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.302608 30032 leader_election.cc:304] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5; no voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:53.305323 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.306053 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:53.306388 30129 raft_consensus.cc:3060] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.306069 29920 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.307719 30138 leader_election.cc:290] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.302595 30109 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.313154 30140 leader_election.cc:290] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.316167 30109 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.318810 30138 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.319407 30138 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.330090 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.330819 29919 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.333562 30129 raft_consensus.cc:2749] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.335800 29992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.336131 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.335409 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.337018 29994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.337419 29993 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.337235 30113 raft_consensus.cc:359] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.338146 30113 raft_consensus.cc:385] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:53.338143 30035 leader_election.cc:343] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.338833 30113 raft_consensus.cc:740] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
W20260709 13:08:53.339386 30035 leader_election.cc:343] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:53.340293 30035 leader_election.cc:343] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.340229 30113 consensus_queue.cc:260] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.344388 30069 raft_consensus.cc:2468] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.344883 30032 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.345638 30113 ts_tablet_manager.cc:1434] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.011s
I20260709 13:08:53.345830 30114 raft_consensus.cc:2804] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.346418 30114 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.346832 30114 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.345979 30138 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.347710 30113 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.348625 29994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5016a1a05974aa3b9dd02041adf900e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.349272 29994 raft_consensus.cc:3060] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.347936 30109 ts_tablet_manager.cc:1434] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:08:53.350732 30109 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.353986 30114 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.357306 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.358186 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.365167 29919 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.365607 29993 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.357497 30114 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.360584 30110 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.367378 30110 ts_tablet_manager.cc:1403] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.011s
I20260709 13:08:53.368376 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.368417 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.369161 29995 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.370639 29919 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.372473 30032 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.357568 29994 raft_consensus.cc:2468] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.373133 29886 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 9f3a31f929584b969c86987c43ecfde5
I20260709 13:08:53.373476 30114 raft_consensus.cc:2804] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.374080 30114 raft_consensus.cc:697] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.374245 30140 raft_consensus.cc:2764] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:53.375567 30114 consensus_queue.cc:237] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.376309 30113 tablet_bootstrap.cc:654] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.376333 29886 leader_election.cc:304] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.377315 30140 raft_consensus.cc:2804] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.377912 30140 raft_consensus.cc:697] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:53.378769 30140 consensus_queue.cc:237] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.370355 30110 raft_consensus.cc:359] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.382490 30110 raft_consensus.cc:385] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.397941 30110 raft_consensus.cc:740] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.399039 30110 consensus_queue.cc:260] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.402192 30110 ts_tablet_manager.cc:1434] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 13:08:53.383893 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.381774 29920 raft_consensus.cc:2468] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.389051 30141 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.406769 30032 leader_election.cc:304] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:08:53.407894 30138 raft_consensus.cc:2804] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.408408 30068 raft_consensus.cc:2393] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in current term 1: Already voted for candidate 9f3a31f929584b969c86987c43ecfde5 in this term.
I20260709 13:08:53.408365 30138 raft_consensus.cc:697] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.409329 30138 consensus_queue.cc:237] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.409266 30141 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.415688 30110 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.413525 29995 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.419709 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.418917 29817 catalog_manager.cc:5697] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.420918 29919 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 0.
I20260709 13:08:53.423714 30109 tablet_bootstrap.cc:654] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.426368 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.427091 29993 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.429529 29958 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 9f3a31f929584b969c86987c43ecfde5
I20260709 13:08:53.425089 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.432415 30113 tablet_bootstrap.cc:492] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.432412 29920 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.433037 30113 ts_tablet_manager.cc:1403] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.086s	user 0.032s	sys 0.021s
I20260709 13:08:53.432932 29816 catalog_manager.cc:5697] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.435405 29816 catalog_manager.cc:5697] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.436887 30113 raft_consensus.cc:359] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.437577 30113 raft_consensus.cc:385] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.437876 30113 raft_consensus.cc:740] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.438614 30113 consensus_queue.cc:260] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.451253 30110 tablet_bootstrap.cc:654] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.457772 29920 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.459334 30032 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.460649 30138 raft_consensus.cc:2804] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.461128 30138 raft_consensus.cc:697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.461953 30138 consensus_queue.cc:237] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.467236 30153 raft_consensus.cc:493] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.469075 30109 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.467787 30153 raft_consensus.cc:515] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.469894 30109 ts_tablet_manager.cc:1403] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.000s
I20260709 13:08:53.472704 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.474433 30113 ts_tablet_manager.cc:1434] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.019s
W20260709 13:08:53.474674 29959 leader_election.cc:343] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.474548 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.475646 30113 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.476507 29993 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.478128 30109 raft_consensus.cc:359] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.479102 30109 raft_consensus.cc:385] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.479480 30109 raft_consensus.cc:740] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.479775 30153 leader_election.cc:290] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.480082 30120 raft_consensus.cc:2764] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:08:53.478544 29958 leader_election.cc:343] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:53.483141 29958 leader_election.cc:304] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd; no voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:53.485239 30113 tablet_bootstrap.cc:654] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.485759 30109 consensus_queue.cc:260] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.487004 30120 raft_consensus.cc:2749] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.485332 29817 catalog_manager.cc:5697] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.490895 29817 catalog_manager.cc:5697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.497184 30109 ts_tablet_manager.cc:1434] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:08:53.498587 30109 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.506569 30110 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.507072 30110 ts_tablet_manager.cc:1403] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.015s
I20260709 13:08:53.508248 30109 tablet_bootstrap.cc:654] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.509703 30110 raft_consensus.cc:359] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.510389 30110 raft_consensus.cc:385] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.510660 30110 raft_consensus.cc:740] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.512868 30110 consensus_queue.cc:260] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.514858 30110 ts_tablet_manager.cc:1434] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:53.515441 30113 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.516052 30113 ts_tablet_manager.cc:1403] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.017s
I20260709 13:08:53.516836 30110 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.517990 30109 tablet_bootstrap.cc:492] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.518389 30109 ts_tablet_manager.cc:1403] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:08:53.518817 30113 raft_consensus.cc:359] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.519515 30113 raft_consensus.cc:385] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.519794 30113 raft_consensus.cc:740] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.520676 30113 consensus_queue.cc:260] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.520957 30109 raft_consensus.cc:359] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.521564 30109 raft_consensus.cc:385] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.521831 30109 raft_consensus.cc:740] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.522611 30110 tablet_bootstrap.cc:654] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.522578 30109 consensus_queue.cc:260] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.527449 30120 raft_consensus.cc:493] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.527966 30109 ts_tablet_manager.cc:1434] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:53.527906 30120 raft_consensus.cc:515] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.528879 30109 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.529989 30120 leader_election.cc:290] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.531548 30113 ts_tablet_manager.cc:1434] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:08:53.535085 30109 tablet_bootstrap.cc:654] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.535446 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.536242 29920 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 0.
I20260709 13:08:53.538264 30113 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.538385 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.539690 30069 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 0.
I20260709 13:08:53.538681 29958 leader_election.cc:304] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.541584 30120 raft_consensus.cc:2804] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.541836 30120 raft_consensus.cc:493] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.542120 30120 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.548044 30109 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.548240 30113 tablet_bootstrap.cc:654] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.548496 30109 ts_tablet_manager.cc:1403] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 13:08:53.548753 30120 raft_consensus.cc:515] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.551565 30110 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.551301 30109 raft_consensus.cc:359] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.551913 30109 raft_consensus.cc:385] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.552203 30109 raft_consensus.cc:740] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.551972 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.552842 29920 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.553092 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:53.553042 30109 consensus_queue.cc:260] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.553715 30069 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.555215 30109 ts_tablet_manager.cc:1434] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:53.556183 30109 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: Bootstrap starting.
I20260709 13:08:53.560719 30069 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 1.
I20260709 13:08:53.561936 29959 leader_election.cc:304] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:53.562462 30109 tablet_bootstrap.cc:654] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.562950 30154 raft_consensus.cc:2804] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.563529 30154 raft_consensus.cc:697] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:53.564414 30154 consensus_queue.cc:237] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.551970 30110 ts_tablet_manager.cc:1403] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.000s
I20260709 13:08:53.574862 30120 leader_election.cc:290] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.576699 29920 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 1.
I20260709 13:08:53.573956 30110 raft_consensus.cc:359] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.581290 30110 raft_consensus.cc:385] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.581537 30113 tablet_bootstrap.cc:492] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.581727 30110 raft_consensus.cc:740] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.582048 30113 ts_tablet_manager.cc:1403] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.020s
I20260709 13:08:53.583195 30110 consensus_queue.cc:260] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.585253 30113 raft_consensus.cc:359] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.585933 30113 raft_consensus.cc:385] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.586196 30113 raft_consensus.cc:740] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.586972 30113 consensus_queue.cc:260] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.586716 29817 catalog_manager.cc:5697] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 1 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.589931 30110 ts_tablet_manager.cc:1434] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:08:53.591176 30110 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: Bootstrap starting.
I20260709 13:08:53.593235 30113 ts_tablet_manager.cc:1434] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:08:53.594120 30113 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.599586 30113 tablet_bootstrap.cc:654] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.604640 30113 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.605026 30113 ts_tablet_manager.cc:1403] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:08:53.607141 30109 tablet_bootstrap.cc:492] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: No bootstrap required, opened a new log
I20260709 13:08:53.607228 30113 raft_consensus.cc:359] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.607630 30110 tablet_bootstrap.cc:654] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.607636 30109 ts_tablet_manager.cc:1403] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.027s
I20260709 13:08:53.607889 30113 raft_consensus.cc:385] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.608253 30113 raft_consensus.cc:740] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.608824 30113 consensus_queue.cc:260] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.610546 30113 ts_tablet_manager.cc:1434] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:53.610587 30109 raft_consensus.cc:359] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.611544 30113 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: Bootstrap starting.
I20260709 13:08:53.611547 30109 raft_consensus.cc:385] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.612082 30109 raft_consensus.cc:740] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.616039 30113 tablet_bootstrap.cc:654] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:53.616727 30109 consensus_queue.cc:260] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.618652 30110 tablet_bootstrap.cc:492] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: No bootstrap required, opened a new log
I20260709 13:08:53.619108 30110 ts_tablet_manager.cc:1403] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:08:53.622010 30110 raft_consensus.cc:359] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.622655 30110 raft_consensus.cc:385] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.622965 30110 raft_consensus.cc:740] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.623783 30110 consensus_queue.cc:260] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.628285 30110 ts_tablet_manager.cc:1434] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 13:08:53.628388 30109 ts_tablet_manager.cc:1434] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:08:53.631352 30113 tablet_bootstrap.cc:492] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: No bootstrap required, opened a new log
I20260709 13:08:53.631832 30113 ts_tablet_manager.cc:1403] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:08:53.634485 30113 raft_consensus.cc:359] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.635149 30113 raft_consensus.cc:385] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:53.635426 30113 raft_consensus.cc:740] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Initialized, Role: FOLLOWER
I20260709 13:08:53.636075 30113 consensus_queue.cc:260] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.638077 30113 ts_tablet_manager.cc:1434] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:53.639479 30138 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.656517 30114 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.706890 30138 raft_consensus.cc:493] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.707372 30138 raft_consensus.cc:515] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.709017 30138 leader_election.cc:290] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.709983 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd6f9127ae748e2a1809528ad41e510" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.709950 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd6f9127ae748e2a1809528ad41e510" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.710843 29920 raft_consensus.cc:2468] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.710804 29993 raft_consensus.cc:2468] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 0.
I20260709 13:08:53.712023 30035 leader_election.cc:304] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:53.712710 30138 raft_consensus.cc:2804] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.713016 30138 raft_consensus.cc:493] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.713306 30138 raft_consensus.cc:3060] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.717645 30138 raft_consensus.cc:515] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.719174 30138 leader_election.cc:290] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:53.720085 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd6f9127ae748e2a1809528ad41e510" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:53.720227 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd6f9127ae748e2a1809528ad41e510" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.720625 29920 raft_consensus.cc:3060] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.720815 29993 raft_consensus.cc:3060] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.725318 29920 raft_consensus.cc:2468] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.725318 29993 raft_consensus.cc:2468] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 1.
I20260709 13:08:53.726644 30032 leader_election.cc:304] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.727413 30138 raft_consensus.cc:2804] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.727900 30138 raft_consensus.cc:697] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:53.728678 30138 consensus_queue.cc:237] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.735380 29817 catalog_manager.cc:5697] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.772876 30116 raft_consensus.cc:493] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.773391 30116 raft_consensus.cc:515] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.775197 30116 leader_election.cc:290] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.775913 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.776228 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.776511 29993 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.776904 30069 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.777513 29886 leader_election.cc:304] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.778143 30116 raft_consensus.cc:2804] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.778491 30116 raft_consensus.cc:493] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.778808 30116 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.781780 30154 raft_consensus.cc:493] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.782244 30154 raft_consensus.cc:515] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:53.783946 30116 raft_consensus.cc:515] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.784438 30154 leader_election.cc:290] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111), b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047)
I20260709 13:08:53.785230 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.786242 30116 leader_election.cc:290] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.786326 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.787122 29920 raft_consensus.cc:2393] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in current term 1: Already voted for candidate 9f3a31f929584b969c86987c43ecfde5 in this term.
I20260709 13:08:53.787317 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:53.787817 30069 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.787986 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.788137 29958 leader_election.cc:304] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd; no voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:53.788578 29993 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.788892 30154 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.793658 29993 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.794795 30069 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.794744 29886 leader_election.cc:304] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.795699 30116 raft_consensus.cc:2804] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.796185 30116 raft_consensus.cc:697] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:53.796445 30138 consensus_queue.cc:1048] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.797124 30154 raft_consensus.cc:2749] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.797353 30116 consensus_queue.cc:237] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.805819 29817 catalog_manager.cc:5697] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.807929 30141 consensus_queue.cc:1048] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.824704 30116 raft_consensus.cc:493] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.825177 30116 raft_consensus.cc:515] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.827033 30116 leader_election.cc:290] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.827764 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" is_pre_election: true
I20260709 13:08:53.828121 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.828385 29995 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.828356 30116 consensus_queue.cc:1048] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.828685 30069 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 0.
I20260709 13:08:53.829536 29886 leader_election.cc:304] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.830221 30116 raft_consensus.cc:2804] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:53.830574 30116 raft_consensus.cc:493] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.830946 30116 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.836848 30116 raft_consensus.cc:515] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.839946 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:53.840231 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:53.840559 30069 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.840999 29995 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.843277 30116 leader_election.cc:290] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.850471 30140 consensus_queue.cc:1048] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.850805 29995 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.849874 30069 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 1.
I20260709 13:08:53.852210 29884 leader_election.cc:304] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:53.852914 30140 raft_consensus.cc:2804] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:53.853364 30140 raft_consensus.cc:697] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:53.854178 30140 consensus_queue.cc:237] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.863884 29816 catalog_manager.cc:5697] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.870976 30154 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.871420 30154 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:53.873449 30154 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:53.874285 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" is_pre_election: true
I20260709 13:08:53.875069 29919 raft_consensus.cc:2393] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in current term 1: Already voted for candidate 9f3a31f929584b969c86987c43ecfde5 in this term.
I20260709 13:08:53.875952 30114 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.876482 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3a31f929584b969c86987c43ecfde5" is_pre_election: true
I20260709 13:08:53.877362 30114 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.878033 29959 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd; no voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:53.878000 30138 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:53.878793 30154 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:53.888491 30154 raft_consensus.cc:2749] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:53.895711 30114 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:53.985590 30114 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.988502 30154 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:53.999271 30138 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.000471 30154 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.147533 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:54.148082 30069 raft_consensus.cc:606] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:54.153082 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:54.153560 30069 raft_consensus.cc:606] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:54.158205 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:54.158675 30069 raft_consensus.cc:606] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:54.163200 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:54.163666 30069 raft_consensus.cc:606] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:54.171048 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:54.171526 30069 raft_consensus.cc:606] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Received request to transfer leadership to TS 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:08:54.184046 29919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:49718
I20260709 13:08:54.184554 29919 raft_consensus.cc:606] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Received request to transfer leadership to TS 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:08:54.191691 29919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:49718
I20260709 13:08:54.192216 29919 raft_consensus.cc:606] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Received request to transfer leadership to TS 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:08:54.212576 30116 consensus_queue.cc:1048] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.222837 30178 consensus_queue.cc:1048] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.231256 30178 raft_consensus.cc:993] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.231727 30194 raft_consensus.cc:1081] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Signalling peer 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.233647 29995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:53426
I20260709 13:08:54.234207 29995 raft_consensus.cc:493] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.234575 29995 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.240893 29995 raft_consensus.cc:515] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.243109 29995 leader_election.cc:290] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.243711 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.243942 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce685fd8d02c4517a9645975113edf3d" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:54.244323 30069 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.244534 29919 raft_consensus.cc:3055] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.244890 29919 raft_consensus.cc:740] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.245657 29919 consensus_queue.cc:260] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.246906 29919 raft_consensus.cc:3060] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.249766 30069 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.250967 29959 leader_election.cc:304] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:54.251760 30154 raft_consensus.cc:2804] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.252204 30154 raft_consensus.cc:697] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:54.252372 29919 raft_consensus.cc:2468] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.253010 30154 consensus_queue.cc:237] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.257871 30138 raft_consensus.cc:993] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.258392 30114 raft_consensus.cc:1081] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.259882 29919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:54.260332 29919 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.260643 29919 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.261206 29817 catalog_manager.cc:5697] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 1 to 2, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 2 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.266134 29919 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.268082 29919 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.269289 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.269855 30069 raft_consensus.cc:3055] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.270174 30069 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:54.270406 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:54.270991 29995 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.271008 30069 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.272078 30069 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.275804 29995 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.276872 29886 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:54.276993 30069 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.277647 30194 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.278116 30194 raft_consensus.cc:697] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.278211 30114 consensus_queue.cc:1048] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.278936 30194 consensus_queue.cc:237] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.285482 29817 catalog_manager.cc:5697] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 1 to 2, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.290808 30114 consensus_queue.cc:1048] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.335911 30141 raft_consensus.cc:993] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.336318 30114 raft_consensus.cc:1081] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.337682 29919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:54.338171 29919 raft_consensus.cc:493] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.338476 29919 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.343086 29919 raft_consensus.cc:515] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:54.344712 29919 leader_election.cc:290] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Requested vote from peers 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:54.345605 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.345762 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc3c1c51cdc453482436f718d2c9d7e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:54.346094 30069 raft_consensus.cc:3055] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.346307 29995 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.346415 30069 raft_consensus.cc:740] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:54.347168 30069 consensus_queue.cc:260] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:54.348037 30069 raft_consensus.cc:3060] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.351394 29995 raft_consensus.cc:2468] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.352489 29886 leader_election.cc:304] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:54.353333 30194 raft_consensus.cc:2804] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.353302 30069 raft_consensus.cc:2468] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.353713 30141 raft_consensus.cc:993] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.354018 30194 raft_consensus.cc:697] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.354184 30114 raft_consensus.cc:1081] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.354964 30194 consensus_queue.cc:237] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } }
I20260709 13:08:54.355867 29919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:54.356325 29919 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.356673 29919 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.361399 29816 catalog_manager.cc:5697] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 1 to 2, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.361655 29919 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.363303 29919 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.364344 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.364369 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:54.365046 30069 raft_consensus.cc:3055] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.365070 29995 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.365496 30069 raft_consensus.cc:740] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:54.366307 30069 consensus_queue.cc:260] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.367549 30069 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.371871 29995 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.372951 29886 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:54.373596 30194 raft_consensus.cc:2804] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.373775 30069 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.373986 30194 raft_consensus.cc:697] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.374835 30194 consensus_queue.cc:237] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.380626 29816 catalog_manager.cc:5697] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 1 to 2, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.454594 30194 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.461372 30140 raft_consensus.cc:993] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.461874 30116 raft_consensus.cc:1081] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Signalling peer 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.463474 29993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:53426
I20260709 13:08:54.464740 29993 raft_consensus.cc:493] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.465149 29993 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.466913 30178 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:54.472002 29993 raft_consensus.cc:515] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.475615 29993 leader_election.cc:290] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.476265 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:54.476889 29919 raft_consensus.cc:3055] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.477217 29919 raft_consensus.cc:740] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.477356 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.477934 30069 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.478214 29919 consensus_queue.cc:260] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.479481 29919 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.485095 30069 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.486111 29919 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.487320 29959 leader_election.cc:304] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:54.488541 30154 raft_consensus.cc:2804] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.488965 30154 raft_consensus.cc:697] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:54.489703 30154 consensus_queue.cc:237] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.495734 29817 catalog_manager.cc:5697] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 1 to 2, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 2 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.531080 30138 raft_consensus.cc:993] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.531482 30114 raft_consensus.cc:1081] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Signalling peer 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:08:54.532892 29993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:53428
I20260709 13:08:54.533313 29993 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.533558 29993 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.537896 29993 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.539402 29993 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.540215 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:54.540432 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.540808 29919 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.540936 30069 raft_consensus.cc:3055] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.541276 30069 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:54.542088 30069 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.543242 30069 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.547468 29919 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.548791 29958 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:54.549490 30154 raft_consensus.cc:2804] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.549522 30069 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 2.
I20260709 13:08:54.550168 30154 raft_consensus.cc:697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:54.551026 30154 consensus_queue.cc:237] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.557446 29817 catalog_manager.cc:5697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 1 to 2, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 2 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.621594 30138 raft_consensus.cc:993] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.621995 30114 raft_consensus.cc:1081] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:54.623327 29919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:54.623878 29919 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.624181 29919 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.628710 29919 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.630394 29919 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:54.631193 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:54.631497 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:54.631785 29993 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.632019 30069 raft_consensus.cc:3055] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.632339 30069 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:54.633013 30069 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.633868 30069 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.636574 29993 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.637591 29886 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:54.638378 30194 raft_consensus.cc:2804] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.638530 30069 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:54.638876 30194 raft_consensus.cc:697] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:54.639881 29919 raft_consensus.cc:1275] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.639726 30194 consensus_queue.cc:237] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:54.641238 30199 consensus_queue.cc:1048] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.643980 30069 raft_consensus.cc:1275] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.645241 30199 consensus_queue.cc:1048] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.651361 29817 catalog_manager.cc:5697] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 1 to 2, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.810796 30069 raft_consensus.cc:1275] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.811986 30194 consensus_queue.cc:1048] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.821005 29993 raft_consensus.cc:1275] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.822307 30194 consensus_queue.cc:1048] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.849000 29993 raft_consensus.cc:1275] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.850311 30194 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.861819 30069 raft_consensus.cc:1275] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.863154 30116 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.888969 30069 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.890094 30116 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.899765 29993 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.901144 30194 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.020920 29919 raft_consensus.cc:1275] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.022097 30199 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.029165 30069 raft_consensus.cc:1275] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.031273 30154 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.031545 29993 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.033010 30194 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.042277 30069 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.043661 30178 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.059167 30068 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.060367 30154 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.069444 29919 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.070953 30199 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:57.224751 29280 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:08:57.225445 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.240505 29919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:08:57.241022 29919 raft_consensus.cc:606] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Received request to transfer leadership to TS 9f3a31f929584b969c86987c43ecfde5
I20260709 13:08:57.243724 29919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:08:57.244185 29919 raft_consensus.cc:606] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Received request to transfer leadership to TS 9f3a31f929584b969c86987c43ecfde5
I20260709 13:08:57.245206 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:57.245638 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:57.246443 30215 raft_consensus.cc:993] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:08:57.246881 30140 raft_consensus.cc:1081] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Signalling peer 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:08:57.248107 30069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:41368
I20260709 13:08:57.248514 30069 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.248775 30069 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.252972 30069 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.255182 30069 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:57.255455 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:57.255999 29919 raft_consensus.cc:3055] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.255858 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:57.256376 29919 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:57.256549 29993 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.257102 29919 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.258205 29919 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.263087 29993 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:08:57.264269 29919 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:08:57.264358 30035 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:57.265190 30211 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.266291 30211 raft_consensus.cc:697] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:57.267028 30211 consensus_queue.cc:237] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.273293 29816 catalog_manager.cc:5697] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 2 to 3, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 3 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.456847 30215 raft_consensus.cc:993] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:08:57.457311 30140 raft_consensus.cc:1081] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Signalling peer 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:08:57.458714 30069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:41368
I20260709 13:08:57.459192 30069 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.459489 30069 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.463776 30069 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.465121 30069 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:08:57.465936 29919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:08:57.466156 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:57.466492 29919 raft_consensus.cc:3055] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.466753 29993 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.466854 29919 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:57.467736 29919 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.468907 29919 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.473981 29993 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:08:57.474174 29919 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:08:57.475128 30035 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:08:57.475952 30211 raft_consensus.cc:2804] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.476400 30211 raft_consensus.cc:697] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:57.477118 30211 consensus_queue.cc:237] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:57.483383 29816 catalog_manager.cc:5697] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 2 to 3, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 3 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.683104 29993 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.684249 30211 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.695765 29919 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.697170 30216 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.885766 29993 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.886950 30216 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:57.896984 29919 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:57.899101 30230 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:58.246526 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:58.262120 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:58.262605 30069 raft_consensus.cc:606] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:58.267343 30069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:41388
I20260709 13:08:58.267786 30069 raft_consensus.cc:606] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:58.284723 29993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:08:58.285338 29993 raft_consensus.cc:606] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:58.289167 30216 raft_consensus.cc:993] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.289605 30230 raft_consensus.cc:1081] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.291189 29920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:58.291646 29920 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.291646 29993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:08:58.292101 29920 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.292253 29993 raft_consensus.cc:606] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:58.296765 29993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
mode: GRACEFUL
new_leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:53430
I20260709 13:08:58.297248 29993 raft_consensus.cc:606] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 LEADER]: Received request to transfer leadership to TS b56dd23a863c46f39e7ca5db4ca94f43
I20260709 13:08:58.297998 29920 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.299798 29920 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 4 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:58.300796 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:58.301265 30069 raft_consensus.cc:3055] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:58.301430 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:58.301589 30069 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:58.301993 29993 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.302366 30069 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.303256 30069 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.305917 29993 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 4.
I20260709 13:08:58.306958 29886 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:58.307263 30069 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 4.
I20260709 13:08:58.307655 30215 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:58.308787 30215 raft_consensus.cc:697] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:58.309491 30215 consensus_queue.cc:237] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.315198 29816 catalog_manager.cc:5697] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 3 to 4, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.406855 30216 raft_consensus.cc:993] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.407315 30230 raft_consensus.cc:1081] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.408826 29920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49700
I20260709 13:08:58.409371 29920 raft_consensus.cc:493] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.409739 29920 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.414237 29920 raft_consensus.cc:515] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.415855 29920 leader_election.cc:290] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 4 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:58.416699 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:58.416831 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac63ad409e04df9a25566ed47412a88" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:58.417260 29993 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.417303 30069 raft_consensus.cc:3055] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:58.417728 30069 raft_consensus.cc:740] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:08:58.418467 30069 consensus_queue.cc:260] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.419597 30069 raft_consensus.cc:3060] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.423465 29993 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 4.
I20260709 13:08:58.424542 29886 leader_election.cc:304] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:58.425335 30215 raft_consensus.cc:2804] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:58.425385 30069 raft_consensus.cc:2468] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 4.
I20260709 13:08:58.425808 30215 raft_consensus.cc:697] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:58.426610 30215 consensus_queue.cc:237] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.432864 29816 catalog_manager.cc:5697] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 3 to 4, leader changed from 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.442536 30208 raft_consensus.cc:993] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.443019 30238 raft_consensus.cc:1081] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.444449 29920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49712
I20260709 13:08:58.444895 29920 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.445196 29920 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.450522 29920 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.452123 29920 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 3 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:58.452970 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:58.453055 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:58.453351 30069 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.453612 29993 raft_consensus.cc:3055] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.453891 29993 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:58.454519 29993 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.455497 29993 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.459466 30069 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 3.
I20260709 13:08:58.460507 29884 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:58.461055 29993 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 3.
I20260709 13:08:58.461163 30234 raft_consensus.cc:2804] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.461685 30234 raft_consensus.cc:697] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:58.462458 30234 consensus_queue.cc:237] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.472525 29816 catalog_manager.cc:5697] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 2 to 3, leader changed from 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 3 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.514068 30208 raft_consensus.cc:993] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.514526 30238 raft_consensus.cc:1081] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.515900 29920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49712
I20260709 13:08:58.516304 29920 raft_consensus.cc:493] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.516541 29920 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.520783 29920 raft_consensus.cc:515] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.522364 29920 leader_election.cc:290] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 3 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:58.523164 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:58.523343 30069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55f2e4dfe9c947a9b191ec7487f84575" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:58.523694 29993 raft_consensus.cc:3055] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.523861 30069 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.524003 29993 raft_consensus.cc:740] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:58.524778 29993 consensus_queue.cc:260] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.525938 29993 raft_consensus.cc:3060] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.528452 30069 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 3.
I20260709 13:08:58.529356 29884 leader_election.cc:304] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:58.529856 29993 raft_consensus.cc:2468] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 3.
I20260709 13:08:58.530016 30234 raft_consensus.cc:2804] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.530475 30234 raft_consensus.cc:697] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:58.531378 30234 consensus_queue.cc:237] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.537791 29816 catalog_manager.cc:5697] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 2 to 3, leader changed from 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 3 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.860359 30069 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:58.861688 30234 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.862998 30208 raft_consensus.cc:993] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: : Instructing follower b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.863472 30238 raft_consensus.cc:1081] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 LEADER]: Signalling peer b56dd23a863c46f39e7ca5db4ca94f43 to start an election
I20260709 13:08:58.865427 29920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
 from {username='slave'} at 127.0.0.1:49712
I20260709 13:08:58.866041 29920 raft_consensus.cc:493] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.866516 29920 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.871394 29920 raft_consensus.cc:515] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.873751 29920 leader_election.cc:290] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Requested vote from peers 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:08:58.874248 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:08:58.874847 30068 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.874639 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:08:58.875556 29995 raft_consensus.cc:3055] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.875890 29995 raft_consensus.cc:740] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:08:58.876643 29995 consensus_queue.cc:260] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.877831 29995 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.878566 29993 raft_consensus.cc:1275] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:58.879917 30234 consensus_queue.cc:1048] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.882227 30068 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:58.883616 29884 leader_election.cc:304] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f3a31f929584b969c86987c43ecfde5, b56dd23a863c46f39e7ca5db4ca94f43; no voters: 
I20260709 13:08:58.884375 30234 raft_consensus.cc:2804] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.884825 30234 raft_consensus.cc:697] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Leader. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:08:58.885594 30234 consensus_queue.cc:237] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:08:58.887924 29995 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56dd23a863c46f39e7ca5db4ca94f43 in term 2.
I20260709 13:08:58.895011 29816 catalog_manager.cc:5697] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 reported cstate change: term changed from 1 to 2, leader changed from 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2) to b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.910164 30068 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:58.911500 30234 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.911845 29993 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:58.913056 30234 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.917981 29995 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.919864 30234 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:58.934775 30068 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.936383 30247 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:58.967548 30068 raft_consensus.cc:1275] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.968884 30247 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:58.977638 29993 raft_consensus.cc:1275] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:58.979043 30247 consensus_queue.cc:1048] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:59.414062 30068 raft_consensus.cc:1275] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.415887 30247 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:59.429378 29993 raft_consensus.cc:1275] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Refusing update from remote peer b56dd23a863c46f39e7ca5db4ca94f43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:59.431949 30215 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:01.313935 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.322065 29920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:09:01.322687 29920 raft_consensus.cc:606] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Received request to transfer leadership to TS 9f3a31f929584b969c86987c43ecfde5
I20260709 13:09:01.325054 29920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:09:01.325519 29920 raft_consensus.cc:606] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Received request to transfer leadership to TS 9f3a31f929584b969c86987c43ecfde5
I20260709 13:09:01.327572 29920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:09:01.328008 29920 raft_consensus.cc:606] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Received request to transfer leadership to TS 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:09:01.329931 29920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
mode: GRACEFUL
new_leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:49734
I20260709 13:09:01.330348 29920 raft_consensus.cc:606] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Received request to transfer leadership to TS 6d65a2b4a9d1425dbb0d60de1f9328dd
I20260709 13:09:01.331333 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:01.331764 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:01.442803 30256 raft_consensus.cc:993] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:09:01.443324 30257 raft_consensus.cc:1081] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Signalling peer 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:09:01.445003 30068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:41368
I20260709 13:09:01.445520 30068 raft_consensus.cc:493] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.445851 30068 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.451696 30068 raft_consensus.cc:515] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.453646 30068 leader_election.cc:290] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:09:01.454408 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:09:01.454903 29993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985c4742a3034ccebabbf2e6154986b1" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:09:01.455157 29920 raft_consensus.cc:3055] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.455415 29993 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.455524 29920 raft_consensus.cc:740] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:09:01.456447 29920 consensus_queue.cc:260] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.457700 29920 raft_consensus.cc:3060] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.462145 29993 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:09:01.463497 30035 leader_election.cc:304] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:09:01.464337 30230 raft_consensus.cc:2804] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.465488 30230 raft_consensus.cc:697] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:09:01.466351 30230 consensus_queue.cc:237] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.466958 29920 raft_consensus.cc:2468] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:09:01.473558 29818 catalog_manager.cc:5697] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 2 to 3, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 3 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.516086 30256 raft_consensus.cc:993] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:09:01.516599 30257 raft_consensus.cc:1081] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Signalling peer 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:09:01.517970 29993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:53426
I20260709 13:09:01.518414 29993 raft_consensus.cc:493] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.518674 29993 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.524015 30256 raft_consensus.cc:993] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:09:01.523978 29993 raft_consensus.cc:515] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.524534 30256 raft_consensus.cc:1081] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Signalling peer 6d65a2b4a9d1425dbb0d60de1f9328dd to start an election
I20260709 13:09:01.526100 29993 leader_election.cc:290] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 4 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:09:01.526521 29995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a"
dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
 from {username='slave'} at 127.0.0.1:53426
I20260709 13:09:01.526888 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:09:01.527134 29995 raft_consensus.cc:493] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.527495 29920 raft_consensus.cc:3055] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:01.527550 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2d0a2d206743e7ad1e3b432b8fd03e" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:09:01.528038 29920 raft_consensus.cc:740] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:09:01.528236 30068 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.528815 29920 consensus_queue.cc:260] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.529680 29920 raft_consensus.cc:3060] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.532932 30068 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 4.
I20260709 13:09:01.527521 29995 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.533974 29920 raft_consensus.cc:2468] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 4.
I20260709 13:09:01.534201 29959 leader_election.cc:304] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:09:01.535545 30238 raft_consensus.cc:2804] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:01.536872 30238 raft_consensus.cc:697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:09:01.537721 30238 consensus_queue.cc:237] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.538950 29995 raft_consensus.cc:515] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.540719 29995 leader_election.cc:290] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 5 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3:42111)
I20260709 13:09:01.541914 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:09:01.541910 30068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fbae70e418471fb0a5c1dc9635fc9a" candidate_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
I20260709 13:09:01.542608 29920 raft_consensus.cc:3055] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:01.542801 30068 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.543078 29920 raft_consensus.cc:740] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:09:01.543992 29920 consensus_queue.cc:260] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.545065 29920 raft_consensus.cc:3060] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.547978 29818 catalog_manager.cc:5697] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 3 to 4, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 4 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.549206 30068 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 5.
I20260709 13:09:01.550313 29959 leader_election.cc:304] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:09:01.551193 30238 raft_consensus.cc:2804] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:01.551532 29920 raft_consensus.cc:2468] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d65a2b4a9d1425dbb0d60de1f9328dd in term 5.
I20260709 13:09:01.551705 30238 raft_consensus.cc:697] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 5 LEADER]: Becoming Leader. State: Replica: 6d65a2b4a9d1425dbb0d60de1f9328dd, State: Running, Role: LEADER
I20260709 13:09:01.552810 30238 consensus_queue.cc:237] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.558327 30257 raft_consensus.cc:993] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: : Instructing follower 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:09:01.558842 30256 raft_consensus.cc:1081] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Signalling peer 9f3a31f929584b969c86987c43ecfde5 to start an election
I20260709 13:09:01.560467 30068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0"
dest_uuid: "9f3a31f929584b969c86987c43ecfde5"
 from {username='slave'} at 127.0.0.1:41368
I20260709 13:09:01.561013 30068 raft_consensus.cc:493] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.561460 30068 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.564152 29818 catalog_manager.cc:5697] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd reported cstate change: term changed from 4 to 5, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2). New cstate: current_term: 5 leader_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:01.568148 30068 raft_consensus.cc:515] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.570643 30068 leader_election.cc:290] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Requested vote from peers b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047), 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743)
I20260709 13:09:01.570744 29920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56dd23a863c46f39e7ca5db4ca94f43"
I20260709 13:09:01.571403 29920 raft_consensus.cc:3055] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.571725 29995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4653ae5fe77b418cb0366ec6eba673b0" candidate_uuid: "9f3a31f929584b969c86987c43ecfde5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd"
I20260709 13:09:01.572297 29995 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.571714 29920 raft_consensus.cc:740] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56dd23a863c46f39e7ca5db4ca94f43, State: Running, Role: LEADER
I20260709 13:09:01.573657 29920 consensus_queue.cc:260] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.574770 29920 raft_consensus.cc:3060] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.578676 29995 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:09:01.579725 30035 leader_election.cc:304] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d65a2b4a9d1425dbb0d60de1f9328dd, 9f3a31f929584b969c86987c43ecfde5; no voters: 
I20260709 13:09:01.580472 30230 raft_consensus.cc:2804] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.580869 30230 raft_consensus.cc:697] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f3a31f929584b969c86987c43ecfde5, State: Running, Role: LEADER
I20260709 13:09:01.580902 29920 raft_consensus.cc:2468] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3a31f929584b969c86987c43ecfde5 in term 3.
I20260709 13:09:01.581730 30230 consensus_queue.cc:237] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } }
I20260709 13:09:01.588315 29818 catalog_manager.cc:5697] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 reported cstate change: term changed from 2 to 3, leader changed from b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1) to 9f3a31f929584b969c86987c43ecfde5 (127.28.152.3). New cstate: current_term: 3 leader_uuid: "9f3a31f929584b969c86987c43ecfde5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.951804 30068 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 5 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:01.953100 30238 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:01.964969 29920 raft_consensus.cc:1275] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 5 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:01.966718 30238 consensus_queue.cc:1048] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:01.978826 29995 raft_consensus.cc:1275] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:01.979723 30068 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:01.980208 30230 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:01.981254 30238 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3a31f929584b969c86987c43ecfde5" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:01.987251 29920 raft_consensus.cc:1275] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Refusing update from remote peer 6d65a2b4a9d1425dbb0d60de1f9328dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:01.988534 30238 consensus_queue.cc:1048] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:01.998291 29919 raft_consensus.cc:1275] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:02.000728 30230 consensus_queue.cc:1048] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.037922 29995 raft_consensus.cc:1275] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:02.039224 30230 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65a2b4a9d1425dbb0d60de1f9328dd" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.047847 29919 raft_consensus.cc:1275] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Refusing update from remote peer 9f3a31f929584b969c86987c43ecfde5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:02.050424 30258 consensus_queue.cc:1048] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56dd23a863c46f39e7ca5db4ca94f43" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:02.332568 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.339057 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
I20260709 13:09:02.371207 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:02.372157 29280 tablet_replica.cc:333] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.372866 29280 raft_consensus.cc:2243] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.373659 29280 raft_consensus.cc:2272] T 55f2e4dfe9c947a9b191ec7487f84575 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.375636 29280 tablet_replica.cc:333] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.376305 29280 raft_consensus.cc:2243] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.376796 29280 raft_consensus.cc:2272] T ba2d0a2d206743e7ad1e3b432b8fd03e P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.379470 29280 tablet_replica.cc:333] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.379905 29280 raft_consensus.cc:2243] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.380246 29280 raft_consensus.cc:2272] T 7dd6f9127ae748e2a1809528ad41e510 P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.381871 29280 tablet_replica.cc:333] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.382331 29280 raft_consensus.cc:2243] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.383040 29280 raft_consensus.cc:2272] T acc3c1c51cdc453482436f718d2c9d7e P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.384562 29280 tablet_replica.cc:333] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.384969 29280 raft_consensus.cc:2243] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.385293 29280 raft_consensus.cc:2272] T f7fbae70e418471fb0a5c1dc9635fc9a P b56dd23a863c46f39e7ca5db4ca94f43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.387324 29280 tablet_replica.cc:333] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.387815 29280 raft_consensus.cc:2243] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.388226 29280 raft_consensus.cc:2272] T 4653ae5fe77b418cb0366ec6eba673b0 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.390026 29280 tablet_replica.cc:333] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.390513 29280 raft_consensus.cc:2243] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.391300 29280 raft_consensus.cc:2272] T 1ac63ad409e04df9a25566ed47412a88 P b56dd23a863c46f39e7ca5db4ca94f43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.392966 29280 tablet_replica.cc:333] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.393452 29280 raft_consensus.cc:2243] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.393859 29280 raft_consensus.cc:2272] T ce685fd8d02c4517a9645975113edf3d P b56dd23a863c46f39e7ca5db4ca94f43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.395556 29280 tablet_replica.cc:333] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.396010 29280 raft_consensus.cc:2243] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.396390 29280 raft_consensus.cc:2272] T 985c4742a3034ccebabbf2e6154986b1 P b56dd23a863c46f39e7ca5db4ca94f43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.398255 29280 tablet_replica.cc:333] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43: stopping tablet replica
I20260709 13:09:02.398746 29280 raft_consensus.cc:2243] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.399479 29280 raft_consensus.cc:2272] T d5016a1a05974aa3b9dd02041adf900e P b56dd23a863c46f39e7ca5db4ca94f43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.427986 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
W20260709 13:09:02.439565 30032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.1:35047: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:09:02.443462 30032 consensus_peers.cc:597] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 -> Peer b56dd23a863c46f39e7ca5db4ca94f43 (127.28.152.1:35047): Couldn't send request to peer b56dd23a863c46f39e7ca5db4ca94f43. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:35047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.450519 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
I20260709 13:09:02.475343 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:02.476094 29280 tablet_replica.cc:333] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.477000 29280 raft_consensus.cc:2243] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.477599 29280 raft_consensus.cc:2272] T 7dd6f9127ae748e2a1809528ad41e510 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.479512 29280 tablet_replica.cc:333] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.480075 29280 raft_consensus.cc:2243] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.480479 29280 raft_consensus.cc:2272] T acc3c1c51cdc453482436f718d2c9d7e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.482021 29280 tablet_replica.cc:333] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.482501 29280 raft_consensus.cc:2243] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.483251 29280 raft_consensus.cc:2272] T ce685fd8d02c4517a9645975113edf3d P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.484913 29280 tablet_replica.cc:333] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.485425 29280 raft_consensus.cc:2243] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.485813 29280 raft_consensus.cc:2272] T 985c4742a3034ccebabbf2e6154986b1 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.487850 29280 tablet_replica.cc:333] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.488319 29280 raft_consensus.cc:2243] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.488685 29280 raft_consensus.cc:2272] T d5016a1a05974aa3b9dd02041adf900e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.490350 29280 tablet_replica.cc:333] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.491153 29280 raft_consensus.cc:2243] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.491668 29280 raft_consensus.cc:2272] T 1ac63ad409e04df9a25566ed47412a88 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.493397 29280 tablet_replica.cc:333] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.493796 29280 raft_consensus.cc:2243] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.494128 29280 raft_consensus.cc:2272] T 4653ae5fe77b418cb0366ec6eba673b0 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.496057 29280 tablet_replica.cc:333] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.496484 29280 raft_consensus.cc:2243] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.497229 29280 raft_consensus.cc:2272] T f7fbae70e418471fb0a5c1dc9635fc9a P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.499181 29280 tablet_replica.cc:333] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.499800 29280 raft_consensus.cc:2243] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.500260 29280 raft_consensus.cc:2272] T 55f2e4dfe9c947a9b191ec7487f84575 P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.501816 29280 tablet_replica.cc:333] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd: stopping tablet replica
I20260709 13:09:02.502202 29280 raft_consensus.cc:2243] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.502883 29280 raft_consensus.cc:2272] T ba2d0a2d206743e7ad1e3b432b8fd03e P 6d65a2b4a9d1425dbb0d60de1f9328dd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.512717 30035 consensus_peers.cc:597] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 -> Peer 6d65a2b4a9d1425dbb0d60de1f9328dd (127.28.152.2:35743): Couldn't send request to peer 6d65a2b4a9d1425dbb0d60de1f9328dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:02.530827 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:09:02.549662 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
I20260709 13:09:02.571805 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:02.572520 29280 tablet_replica.cc:333] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.573088 29280 raft_consensus.cc:2243] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.573537 29280 raft_consensus.cc:2272] T 55f2e4dfe9c947a9b191ec7487f84575 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.575320 29280 tablet_replica.cc:333] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.575826 29280 raft_consensus.cc:2243] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.576277 29280 raft_consensus.cc:2272] T 1ac63ad409e04df9a25566ed47412a88 P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.577808 29280 tablet_replica.cc:333] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.578277 29280 raft_consensus.cc:2243] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.578681 29280 raft_consensus.cc:2272] T ba2d0a2d206743e7ad1e3b432b8fd03e P 9f3a31f929584b969c86987c43ecfde5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.580729 29280 tablet_replica.cc:333] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.581272 29280 raft_consensus.cc:2243] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.581686 29280 raft_consensus.cc:2272] T f7fbae70e418471fb0a5c1dc9635fc9a P 9f3a31f929584b969c86987c43ecfde5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.583870 29280 tablet_replica.cc:333] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.584378 29280 raft_consensus.cc:2243] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.585119 29280 raft_consensus.cc:2272] T 4653ae5fe77b418cb0366ec6eba673b0 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.586933 29280 tablet_replica.cc:333] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.587481 29280 raft_consensus.cc:2243] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.588235 29280 raft_consensus.cc:2272] T 7dd6f9127ae748e2a1809528ad41e510 P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.589924 29280 tablet_replica.cc:333] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.590389 29280 raft_consensus.cc:2243] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.590838 29280 raft_consensus.cc:2272] T acc3c1c51cdc453482436f718d2c9d7e P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.592407 29280 tablet_replica.cc:333] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.592857 29280 raft_consensus.cc:2243] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.593252 29280 raft_consensus.cc:2272] T ce685fd8d02c4517a9645975113edf3d P 9f3a31f929584b969c86987c43ecfde5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.594869 29280 tablet_replica.cc:333] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.595293 29280 raft_consensus.cc:2243] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.596062 29280 raft_consensus.cc:2272] T 985c4742a3034ccebabbf2e6154986b1 P 9f3a31f929584b969c86987c43ecfde5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.597849 29280 tablet_replica.cc:333] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5: stopping tablet replica
I20260709 13:09:02.598272 29280 raft_consensus.cc:2243] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.598644 29280 raft_consensus.cc:2272] T d5016a1a05974aa3b9dd02041adf900e P 9f3a31f929584b969c86987c43ecfde5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.625365 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:09:02.643587 29280 master.cc:562] Master@127.28.152.62:35589 shutting down...
I20260709 13:09:02.669075 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.669651 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.670020 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 204e49316a284becb4bf97d2812f10cc: stopping tablet replica
I20260709 13:09:02.689612 29280 master.cc:584] Master@127.28.152.62:35589 shutdown complete.
6d65a2b4a9d1425dbb0d60de1f9328dd  4
9f3a31f929584b969c86987c43ecfde5  1
b56dd23a863c46f39e7ca5db4ca94f43  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10606 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:09:02.734429 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:45705
I20260709 13:09:02.735612 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:02.741425 30285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.741684 30284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.741955 30287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.743835 29280 server_base.cc:1061] running on GCE node
I20260709 13:09:02.744727 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:02.744946 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:02.745115 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602542745098 us; error 0 us; skew 500 ppm
I20260709 13:09:02.745637 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:02.748179 29280 webserver.cc:533] Webserver started at http://127.28.152.62:34097/ using document root <none> and password file <none>
I20260709 13:09:02.748660 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:02.748867 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:02.749142 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:02.750238 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "47740a6b78644dffa37c97c591d3d3e7"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-x7j4"
I20260709 13:09:02.754609 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:09:02.757870 30292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.758580 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:02.758925 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "47740a6b78644dffa37c97c591d3d3e7"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-x7j4"
I20260709 13:09:02.759171 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:02.774646 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:02.775906 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:02.814546 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:45705
I20260709 13:09:02.814643 30343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:45705 every 8 connection(s)
I20260709 13:09:02.818405 30344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.828711 30344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Bootstrap starting.
I20260709 13:09:02.833197 30344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:02.837324 30344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: No bootstrap required, opened a new log
I20260709 13:09:02.839373 30344 raft_consensus.cc:359] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER }
I20260709 13:09:02.839732 30344 raft_consensus.cc:385] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:02.839916 30344 raft_consensus.cc:740] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47740a6b78644dffa37c97c591d3d3e7, State: Initialized, Role: FOLLOWER
I20260709 13:09:02.840396 30344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER }
I20260709 13:09:02.840782 30344 raft_consensus.cc:399] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:02.840965 30344 raft_consensus.cc:493] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:02.841168 30344 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:02.845177 30344 raft_consensus.cc:515] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER }
I20260709 13:09:02.845633 30344 leader_election.cc:304] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47740a6b78644dffa37c97c591d3d3e7; no voters: 
I20260709 13:09:02.846716 30344 leader_election.cc:290] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:02.847082 30347 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:02.848742 30347 raft_consensus.cc:697] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 1 LEADER]: Becoming Leader. State: Replica: 47740a6b78644dffa37c97c591d3d3e7, State: Running, Role: LEADER
I20260709 13:09:02.849330 30347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER }
I20260709 13:09:02.849913 30344 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:02.854068 30348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47740a6b78644dffa37c97c591d3d3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER } }
I20260709 13:09:02.855176 30349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47740a6b78644dffa37c97c591d3d3e7. Latest consensus state: current_term: 1 leader_uuid: "47740a6b78644dffa37c97c591d3d3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47740a6b78644dffa37c97c591d3d3e7" member_type: VOTER } }
I20260709 13:09:02.855794 30348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:02.855887 30349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:02.857822 30356 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:02.862664 30356 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:02.865039 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:02.871415 30356 catalog_manager.cc:1383] Generated new cluster ID: 816dc6e4b3f244408b0c4640cb35e34d
I20260709 13:09:02.871716 30356 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:02.897347 30356 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:02.898578 30356 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:02.915956 30356 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Generated new TSK 0
I20260709 13:09:02.916579 30356 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:02.934087 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:02.939764 30365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.940994 30366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:02.942543 30368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:02.942768 29280 server_base.cc:1061] running on GCE node
I20260709 13:09:02.943640 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:02.943863 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:02.944001 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602542943989 us; error 0 us; skew 500 ppm
I20260709 13:09:02.944446 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:02.946597 29280 webserver.cc:533] Webserver started at http://127.28.152.1:34591/ using document root <none> and password file <none>
I20260709 13:09:02.947099 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:02.947263 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:02.947475 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:02.948449 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "0472fa7187444a91b443058ef89fceb9"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-x7j4"
I20260709 13:09:02.952986 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:09:02.956139 30373 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.956945 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:02.957237 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "0472fa7187444a91b443058ef89fceb9"
format_stamp: "Formatted at 2026-07-09 13:09:02 on dist-test-slave-x7j4"
I20260709 13:09:02.957506 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:02.984530 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:02.985781 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:02.987200 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:02.989423 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:02.989590 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:02.989872 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:02.990056 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.033497 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:33099
I20260709 13:09:03.033588 30435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:33099 every 8 connection(s)
I20260709 13:09:03.038470 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:03.045353 30440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:03.046244 30441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:03.049482 29280 server_base.cc:1061] running on GCE node
W20260709 13:09:03.049445 30443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:03.050930 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:03.051231 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:03.051442 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602543051426 us; error 0 us; skew 500 ppm
I20260709 13:09:03.051614 30436 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45705
I20260709 13:09:03.051954 30436 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:03.052146 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:03.052865 30436 heartbeater.cc:507] Master 127.28.152.62:45705 requested a full tablet report, sending...
I20260709 13:09:03.054780 29280 webserver.cc:533] Webserver started at http://127.28.152.2:38991/ using document root <none> and password file <none>
I20260709 13:09:03.055289 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:03.055497 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:03.055403 30309 ts_manager.cc:194] Registered new tserver with Master: 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:03.055918 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:03.057034 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "ce312b0d7a1747c8898a748f8d76df81"
format_stamp: "Formatted at 2026-07-09 13:09:03 on dist-test-slave-x7j4"
I20260709 13:09:03.057291 30309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35860
I20260709 13:09:03.062080 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:03.065537 30448 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.066401 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:03.066740 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "ce312b0d7a1747c8898a748f8d76df81"
format_stamp: "Formatted at 2026-07-09 13:09:03 on dist-test-slave-x7j4"
I20260709 13:09:03.067052 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:03.097071 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:03.098263 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:03.099746 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:03.101893 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:03.102113 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.102355 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:03.102523 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.140765 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:33247
I20260709 13:09:03.140862 30510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:33247 every 8 connection(s)
I20260709 13:09:03.145488 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:03.152622 30514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:03.155097 30515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:03.156200 30517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:03.156850 29280 server_base.cc:1061] running on GCE node
I20260709 13:09:03.157855 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:03.158094 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:03.158193 30511 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45705
I20260709 13:09:03.158313 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602543158294 us; error 0 us; skew 500 ppm
I20260709 13:09:03.158591 30511 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:03.159104 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:03.159514 30511 heartbeater.cc:507] Master 127.28.152.62:45705 requested a full tablet report, sending...
I20260709 13:09:03.161875 29280 webserver.cc:533] Webserver started at http://127.28.152.3:36013/ using document root <none> and password file <none>
I20260709 13:09:03.162005 30309 ts_manager.cc:194] Registered new tserver with Master: ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:03.162508 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:03.162782 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:03.163094 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:03.163807 30309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35862
I20260709 13:09:03.164558 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "027e191e31da4af2bc83c5ddc0c15d05"
format_stamp: "Formatted at 2026-07-09 13:09:03 on dist-test-slave-x7j4"
I20260709 13:09:03.169322 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:03.172348 30522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.173122 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:03.173434 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "027e191e31da4af2bc83c5ddc0c15d05"
format_stamp: "Formatted at 2026-07-09 13:09:03 on dist-test-slave-x7j4"
I20260709 13:09:03.173722 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:03.212807 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:03.213970 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:03.215456 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:03.217588 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:03.217818 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.218053 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:03.218223 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:03.259516 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:43783
I20260709 13:09:03.259599 30584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:43783 every 8 connection(s)
I20260709 13:09:03.276022 30585 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45705
I20260709 13:09:03.276405 30585 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:03.277122 30585 heartbeater.cc:507] Master 127.28.152.62:45705 requested a full tablet report, sending...
I20260709 13:09:03.278987 30309 ts_manager.cc:194] Registered new tserver with Master: 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:03.279486 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016709514s
I20260709 13:09:03.280681 30309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35874
I20260709 13:09:03.304474 30309 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35882:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:03.310277 30309 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:03.501260 30401 tablet_service.cc:1511] Processing CreateTablet for tablet ed91464a4fda479c9d2d6dfa8ca92193 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:03.501722 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 788d95f5ce114732b7f934005a3580e2 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:03.502753 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed91464a4fda479c9d2d6dfa8ca92193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.503960 30476 tablet_service.cc:1511] Processing CreateTablet for tablet ed91464a4fda479c9d2d6dfa8ca92193 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:03.505213 30476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed91464a4fda479c9d2d6dfa8ca92193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.505777 30400 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4ac70a018496ba2020b90313c013e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:03.507860 30475 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4ac70a018496ba2020b90313c013e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:03.509099 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4ac70a018496ba2020b90313c013e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.509361 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4ac70a018496ba2020b90313c013e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.511837 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 788d95f5ce114732b7f934005a3580e2 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:03.512029 30398 tablet_service.cc:1511] Processing CreateTablet for tablet b32c699f55944c90a3ffe996af3951b7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:03.513151 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788d95f5ce114732b7f934005a3580e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.513345 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32c699f55944c90a3ffe996af3951b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.512956 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 497264cf15754f0e9029cd057a54a7fb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:03.514405 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497264cf15754f0e9029cd057a54a7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.515820 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 497264cf15754f0e9029cd057a54a7fb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:03.515918 30473 tablet_service.cc:1511] Processing CreateTablet for tablet b32c699f55944c90a3ffe996af3951b7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:03.517100 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497264cf15754f0e9029cd057a54a7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.517167 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32c699f55944c90a3ffe996af3951b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.517370 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1e11d913434fda8959a45d48772c1f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:03.518671 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1e11d913434fda8959a45d48772c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.519019 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788d95f5ce114732b7f934005a3580e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.521759 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1e11d913434fda8959a45d48772c1f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:03.523277 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1e11d913434fda8959a45d48772c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.521670 30470 tablet_service.cc:1511] Processing CreateTablet for tablet cb15b3fc088e4285aec0576f22ecb481 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:03.524485 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb15b3fc088e4285aec0576f22ecb481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.526269 30469 tablet_service.cc:1511] Processing CreateTablet for tablet e809575d6fe84ef3afe48c9cf7532868 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:03.527577 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e809575d6fe84ef3afe48c9cf7532868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.535166 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 3d72c167bcb8445c86bea233eccc0132 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:03.536552 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d72c167bcb8445c86bea233eccc0132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.538831 30395 tablet_service.cc:1511] Processing CreateTablet for tablet cb15b3fc088e4285aec0576f22ecb481 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:03.539080 30550 tablet_service.cc:1511] Processing CreateTablet for tablet ed91464a4fda479c9d2d6dfa8ca92193 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:03.540184 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb15b3fc088e4285aec0576f22ecb481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.540354 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed91464a4fda479c9d2d6dfa8ca92193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.530138 30468 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3cb6475718492e846dc8fdd3f4e538 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:03.543555 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3cb6475718492e846dc8fdd3f4e538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.543903 30549 tablet_service.cc:1511] Processing CreateTablet for tablet 61d4ac70a018496ba2020b90313c013e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:03.545208 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4ac70a018496ba2020b90313c013e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.545372 30545 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1e11d913434fda8959a45d48772c1f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:03.546638 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1e11d913434fda8959a45d48772c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.547143 30548 tablet_service.cc:1511] Processing CreateTablet for tablet 788d95f5ce114732b7f934005a3580e2 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:03.548633 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788d95f5ce114732b7f934005a3580e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.548786 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3cb6475718492e846dc8fdd3f4e538 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:03.549546 30394 tablet_service.cc:1511] Processing CreateTablet for tablet e809575d6fe84ef3afe48c9cf7532868 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:03.550158 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3cb6475718492e846dc8fdd3f4e538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.551224 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e809575d6fe84ef3afe48c9cf7532868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.550686 30547 tablet_service.cc:1511] Processing CreateTablet for tablet b32c699f55944c90a3ffe996af3951b7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:03.551862 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 3d72c167bcb8445c86bea233eccc0132 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:03.555840 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32c699f55944c90a3ffe996af3951b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.557121 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 497264cf15754f0e9029cd057a54a7fb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:03.558802 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497264cf15754f0e9029cd057a54a7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.560711 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d72c167bcb8445c86bea233eccc0132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.585423 30544 tablet_service.cc:1511] Processing CreateTablet for tablet cb15b3fc088e4285aec0576f22ecb481 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:03.586822 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb15b3fc088e4285aec0576f22ecb481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.600657 30543 tablet_service.cc:1511] Processing CreateTablet for tablet e809575d6fe84ef3afe48c9cf7532868 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:03.602525 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e809575d6fe84ef3afe48c9cf7532868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.618856 30473 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7503235ec641f7b8929ebbf8124038 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:03.620178 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7503235ec641f7b8929ebbf8124038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.627490 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3cb6475718492e846dc8fdd3f4e538 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:03.628846 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3cb6475718492e846dc8fdd3f4e538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.635748 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 3d72c167bcb8445c86bea233eccc0132 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:03.637976 30600 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:03.638257 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d72c167bcb8445c86bea233eccc0132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.656054 30476 tablet_service.cc:1511] Processing CreateTablet for tablet 7244cfd402714902be2b9ef1ac7af65a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:03.663501 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7503235ec641f7b8929ebbf8124038 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:03.666146 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7503235ec641f7b8929ebbf8124038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.668550 30600 tablet_bootstrap.cc:654] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.676631 30470 tablet_service.cc:1511] Processing CreateTablet for tablet eb1e5995c7614e97bf058caeaa374e54 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:03.666224 30395 tablet_service.cc:1511] Processing CreateTablet for tablet eb1e5995c7614e97bf058caeaa374e54 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:03.678712 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1e5995c7614e97bf058caeaa374e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.681242 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 7244cfd402714902be2b9ef1ac7af65a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:03.682948 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7244cfd402714902be2b9ef1ac7af65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.685928 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 0500eacf70c44cb5bb9527f23aea9b1d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:03.688210 30394 tablet_service.cc:1511] Processing CreateTablet for tablet 0500eacf70c44cb5bb9527f23aea9b1d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:03.715757 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500eacf70c44cb5bb9527f23aea9b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.711521 30475 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:03.704592 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7503235ec641f7b8929ebbf8124038 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:03.718292 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7503235ec641f7b8929ebbf8124038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.720250 30548 tablet_service.cc:1511] Processing CreateTablet for tablet 7244cfd402714902be2b9ef1ac7af65a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:03.721493 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7244cfd402714902be2b9ef1ac7af65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.722035 30401 tablet_service.cc:1511] Processing CreateTablet for tablet 1640dd5756f749fd8546ca110299cc59 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:03.744011 30543 tablet_service.cc:1511] Processing CreateTablet for tablet eb1e5995c7614e97bf058caeaa374e54 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:03.744887 30398 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:03.748656 30549 tablet_service.cc:1511] Processing CreateTablet for tablet 0500eacf70c44cb5bb9527f23aea9b1d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:03.749318 30476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7244cfd402714902be2b9ef1ac7af65a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.749218 30473 tablet_service.cc:1511] Processing CreateTablet for tablet 1640dd5756f749fd8546ca110299cc59 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:03.754760 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 3320ad6cc8ec4755a5fcf40ada291b5a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:03.765020 30601 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:03.771250 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1e5995c7614e97bf058caeaa374e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.778353 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500eacf70c44cb5bb9527f23aea9b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.779808 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 3320ad6cc8ec4755a5fcf40ada291b5a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:03.780592 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3320ad6cc8ec4755a5fcf40ada291b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.781042 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3320ad6cc8ec4755a5fcf40ada291b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.783052 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1640dd5756f749fd8546ca110299cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.787029 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba0b89a2fc4499a917166e3b4b88cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.787608 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1e5995c7614e97bf058caeaa374e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.788327 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1b5d40df944767ab310e2bd822d5b0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:03.791640 30545 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:03.806111 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba0b89a2fc4499a917166e3b4b88cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.812961 30547 tablet_service.cc:1511] Processing CreateTablet for tablet 1640dd5756f749fd8546ca110299cc59 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:03.774498 30400 tablet_service.cc:1511] Processing CreateTablet for tablet 3320ad6cc8ec4755a5fcf40ada291b5a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:03.810969 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba0b89a2fc4499a917166e3b4b88cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.827178 30601 tablet_bootstrap.cc:654] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.829958 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3320ad6cc8ec4755a5fcf40ada291b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.818038 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 7846efa5da12423cb3343cd5f3483869 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:03.831395 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7846efa5da12423cb3343cd5f3483869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.834975 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1b5d40df944767ab310e2bd822d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.835417 30600 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:03.835898 30600 ts_tablet_manager.cc:1403] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.000s
I20260709 13:09:03.838781 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1640dd5756f749fd8546ca110299cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.838966 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1640dd5756f749fd8546ca110299cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.845690 30550 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1b5d40df944767ab310e2bd822d5b0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:03.823551 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 567508f2962f473b8fac20c97a240f35 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:03.826416 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 7846efa5da12423cb3343cd5f3483869 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:03.847093 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567508f2962f473b8fac20c97a240f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.847391 30602 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:03.823587 30468 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1b5d40df944767ab310e2bd822d5b0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:03.823551 30394 tablet_service.cc:1511] Processing CreateTablet for tablet 7df93ef89d784f0bab73ca5a5d399cc0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:03.853615 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df93ef89d784f0bab73ca5a5d399cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.856549 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 567508f2962f473b8fac20c97a240f35 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:03.857740 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567508f2962f473b8fac20c97a240f35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:03.860308 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:03.861779 30600 raft_consensus.cc:359] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:03.862545 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500eacf70c44cb5bb9527f23aea9b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.865278 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 7846efa5da12423cb3343cd5f3483869 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:03.866473 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7846efa5da12423cb3343cd5f3483869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.868577 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1b5d40df944767ab310e2bd822d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.869587 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 7df93ef89d784f0bab73ca5a5d399cc0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:03.883343 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1b5d40df944767ab310e2bd822d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.874512 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 9677253d313a48abb6e352b42a3fae88 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:03.868546 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 567508f2962f473b8fac20c97a240f35 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:03.887876 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567508f2962f473b8fac20c97a240f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.876534 30600 raft_consensus.cc:385] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:03.879194 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7846efa5da12423cb3343cd5f3483869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.889693 30600 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:03.890586 30600 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:03.892150 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df93ef89d784f0bab73ca5a5d399cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.895319 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9677253d313a48abb6e352b42a3fae88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:03.914357 30295 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49476.8us
W20260709 13:09:03.915864 30293 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46835.3us
I20260709 13:09:03.922224 30511 heartbeater.cc:499] Master 127.28.152.62:45705 was elected leader, sending a full tablet report...
I20260709 13:09:03.926477 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 9677253d313a48abb6e352b42a3fae88 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:03.927821 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9677253d313a48abb6e352b42a3fae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.929755 30602 tablet_bootstrap.cc:654] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:03.938069 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 1f911d757027485a941dce045769b0fe (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:03.952406 30600 ts_tablet_manager.cc:1434] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.005s
I20260709 13:09:03.954455 30475 tablet_service.cc:1511] Processing CreateTablet for tablet 1f911d757027485a941dce045769b0fe (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:03.959460 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f911d757027485a941dce045769b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.960263 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f911d757027485a941dce045769b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.957983 30548 tablet_service.cc:1511] Processing CreateTablet for tablet 9677253d313a48abb6e352b42a3fae88 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:03.968035 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9677253d313a48abb6e352b42a3fae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.922204 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 7df93ef89d784f0bab73ca5a5d399cc0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:03.988091 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 1f911d757027485a941dce045769b0fe (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:03.989403 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f911d757027485a941dce045769b0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.994506 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 6b47e3764d6643f0a7629098b7f19d34 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:03.996304 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b47e3764d6643f0a7629098b7f19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.999243 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df93ef89d784f0bab73ca5a5d399cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.006058 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 6b47e3764d6643f0a7629098b7f19d34 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:04.007443 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b47e3764d6643f0a7629098b7f19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:03.994629 30601 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:04.012293 30600 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:04.019841 30601 ts_tablet_manager.cc:1403] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.255s	user 0.016s	sys 0.000s
I20260709 13:09:04.034551 30398 tablet_service.cc:1511] Processing CreateTablet for tablet 406b169640e341629c55637d07dd3d47 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:04.035984 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b169640e341629c55637d07dd3d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.040931 30600 tablet_bootstrap.cc:654] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.045342 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0025bdb2b44775bcdb4ec9702926aa (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:04.049259 30601 raft_consensus.cc:359] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.050010 30601 raft_consensus.cc:385] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.049777 30545 tablet_service.cc:1511] Processing CreateTablet for tablet 6b47e3764d6643f0a7629098b7f19d34 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:04.050333 30601 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.095394 30601 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.051301 30473 tablet_service.cc:1511] Processing CreateTablet for tablet 9005afb08e044cf08de618af26cfcf42 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:04.055215 30602 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:04.096940 30602 ts_tablet_manager.cc:1403] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.043s
I20260709 13:09:04.097571 30600 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:04.098085 30600 ts_tablet_manager.cc:1403] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.007s
I20260709 13:09:04.056588 30549 tablet_service.cc:1511] Processing CreateTablet for tablet 406b169640e341629c55637d07dd3d47 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:04.100706 30602 raft_consensus.cc:359] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.101455 30602 raft_consensus.cc:385] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.101191 30600 raft_consensus.cc:359] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.101744 30602 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.101882 30600 raft_consensus.cc:385] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.102183 30600 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.103421 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9005afb08e044cf08de618af26cfcf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.103016 30600 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.105310 30600 ts_tablet_manager.cc:1434] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:04.106153 30600 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:04.102473 30602 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.057019 30401 tablet_service.cc:1511] Processing CreateTablet for tablet ba4c05796efa42489d11c8a49ba476ad (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:04.058218 30547 tablet_service.cc:1511] Processing CreateTablet for tablet 9005afb08e044cf08de618af26cfcf42 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:04.060042 30436 heartbeater.cc:499] Master 127.28.152.62:45705 was elected leader, sending a full tablet report...
I20260709 13:09:04.063316 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 9005afb08e044cf08de618af26cfcf42 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:04.042764 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0025bdb2b44775bcdb4ec9702926aa (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:04.066826 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0025bdb2b44775bcdb4ec9702926aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.109019 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0025bdb2b44775bcdb4ec9702926aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.067646 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b47e3764d6643f0a7629098b7f19d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.115243 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9005afb08e044cf08de618af26cfcf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.071470 30550 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0025bdb2b44775bcdb4ec9702926aa (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:04.115890 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b169640e341629c55637d07dd3d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.116405 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4c05796efa42489d11c8a49ba476ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.118834 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0025bdb2b44775bcdb4ec9702926aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.122462 30600 tablet_bootstrap.cc:654] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.129875 30543 tablet_service.cc:1511] Processing CreateTablet for tablet e6ff8d501cb144d0ba1527bbf7c10597 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:04.076447 30548 tablet_service.cc:1511] Processing CreateTablet for tablet ba4c05796efa42489d11c8a49ba476ad (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:04.139784 30585 heartbeater.cc:499] Master 127.28.152.62:45705 was elected leader, sending a full tablet report...
I20260709 13:09:04.140434 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4c05796efa42489d11c8a49ba476ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:04.080636 30294 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46791.2us
W20260709 13:09:04.081203 30293 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 48239.3us
I20260709 13:09:04.152508 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 82023e2c5e484095a622dab241c66cd3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:04.153789 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82023e2c5e484095a622dab241c66cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.080971 30398 tablet_service.cc:1511] Processing CreateTablet for tablet 82023e2c5e484095a622dab241c66cd3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:04.155614 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 913c2d18b15848cd98ab0ff37874cc23 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:04.155818 30397 tablet_service.cc:1511] Processing CreateTablet for tablet cc136e9e62d1428b88f928b6ccef8316 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:04.157918 30394 tablet_service.cc:1511] Processing CreateTablet for tablet b9205df4217c4ceca542cc35ed79d43e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:04.065132 30468 tablet_service.cc:1511] Processing CreateTablet for tablet e6ff8d501cb144d0ba1527bbf7c10597 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:04.159610 30601 ts_tablet_manager.cc:1434] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.000s
I20260709 13:09:04.160024 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ff8d501cb144d0ba1527bbf7c10597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.161712 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 913c2d18b15848cd98ab0ff37874cc23 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:04.167562 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913c2d18b15848cd98ab0ff37874cc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.127902 30602 ts_tablet_manager.cc:1434] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:04.123071 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9005afb08e044cf08de618af26cfcf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.074432 30400 tablet_service.cc:1511] Processing CreateTablet for tablet e6ff8d501cb144d0ba1527bbf7c10597 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:04.171926 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ff8d501cb144d0ba1527bbf7c10597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.172626 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82023e2c5e484095a622dab241c66cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.174062 30541 tablet_service.cc:1511] Processing CreateTablet for tablet d34313dd02b6470d81b73b13d5cf157f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:04.094071 30470 tablet_service.cc:1511] Processing CreateTablet for tablet ba4c05796efa42489d11c8a49ba476ad (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:04.136731 30600 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:04.175237 30600 ts_tablet_manager.cc:1403] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:09:04.175617 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4c05796efa42489d11c8a49ba476ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.163196 30472 tablet_service.cc:1511] Processing CreateTablet for tablet d34313dd02b6470d81b73b13d5cf157f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:04.163832 30469 tablet_service.cc:1511] Processing CreateTablet for tablet cc136e9e62d1428b88f928b6ccef8316 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:04.163784 30476 tablet_service.cc:1511] Processing CreateTablet for tablet 88cc3e301acf441dab14eb0be7a54db1 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:04.179113 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc136e9e62d1428b88f928b6ccef8316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.179473 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34313dd02b6470d81b73b13d5cf157f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.180054 30476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cc3e301acf441dab14eb0be7a54db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.178195 30600 raft_consensus.cc:359] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.181720 30600 raft_consensus.cc:385] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.182013 30600 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.162413 30467 tablet_service.cc:1511] Processing CreateTablet for tablet b9205df4217c4ceca542cc35ed79d43e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:04.182771 30600 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.183367 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc136e9e62d1428b88f928b6ccef8316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.183979 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913c2d18b15848cd98ab0ff37874cc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.187282 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9205df4217c4ceca542cc35ed79d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.189599 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9205df4217c4ceca542cc35ed79d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.191545 30605 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.191991 30605 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.193989 30600 ts_tablet_manager.cc:1434] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:04.011502 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 406b169640e341629c55637d07dd3d47 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:04.195494 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b169640e341629c55637d07dd3d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.195362 30475 tablet_service.cc:1511] Processing CreateTablet for tablet 82023e2c5e484095a622dab241c66cd3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:04.196626 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82023e2c5e484095a622dab241c66cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.160578 30601 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:04.171927 30401 tablet_service.cc:1511] Processing CreateTablet for tablet d34313dd02b6470d81b73b13d5cf157f (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:04.194481 30605 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:04.231242 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34313dd02b6470d81b73b13d5cf157f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.222270 30605 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.271098 30605 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.273346 30605 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:04.233649 30602 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:04.240861 30473 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7575b0e686483ca3a32ff9be16a338 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:04.249955 30544 tablet_service.cc:1511] Processing CreateTablet for tablet b9205df4217c4ceca542cc35ed79d43e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:04.250787 30600 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:04.259162 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7575b0e686483ca3a32ff9be16a338 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:04.263756 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 913c2d18b15848cd98ab0ff37874cc23 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:04.266835 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34313dd02b6470d81b73b13d5cf157f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.325986 30600 tablet_bootstrap.cc:654] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.276198 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ff8d501cb144d0ba1527bbf7c10597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.246201 30545 tablet_service.cc:1511] Processing CreateTablet for tablet cc136e9e62d1428b88f928b6ccef8316 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:04.327059 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7575b0e686483ca3a32ff9be16a338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.327549 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc136e9e62d1428b88f928b6ccef8316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.235987 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 88cc3e301acf441dab14eb0be7a54db1 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:04.329245 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9205df4217c4ceca542cc35ed79d43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.329882 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cc3e301acf441dab14eb0be7a54db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.331780 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913c2d18b15848cd98ab0ff37874cc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.334983 30548 tablet_service.cc:1511] Processing CreateTablet for tablet 02b91286dc8d477e8ebec973b266b7f0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:04.336236 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b91286dc8d477e8ebec973b266b7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.285034 30549 tablet_service.cc:1511] Processing CreateTablet for tablet 9632f38fdbf84c58a587a59a81f394ce (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:04.288622 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 02b91286dc8d477e8ebec973b266b7f0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:04.342458 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632f38fdbf84c58a587a59a81f394ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.342721 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b91286dc8d477e8ebec973b266b7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.301470 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:04.282635 30547 tablet_service.cc:1511] Processing CreateTablet for tablet 8a7575b0e686483ca3a32ff9be16a338 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:04.270120 30550 tablet_service.cc:1511] Processing CreateTablet for tablet 88cc3e301acf441dab14eb0be7a54db1 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:04.300824 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:04.300154 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 02b91286dc8d477e8ebec973b266b7f0 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:04.348016 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7575b0e686483ca3a32ff9be16a338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.286831 30615 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.289408 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 9632f38fdbf84c58a587a59a81f394ce (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:04.303803 30541 tablet_service.cc:1511] Processing CreateTablet for tablet fadcc5b6fd8a4ea992fa104050ad1a12 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:04.303962 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:04.305253 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:04.303779 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 9632f38fdbf84c58a587a59a81f394ce (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:04.352162 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cc3e301acf441dab14eb0be7a54db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.304423 30469 tablet_service.cc:1511] Processing CreateTablet for tablet fadcc5b6fd8a4ea992fa104050ad1a12 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:09:04.347908 30451 leader_election.cc:343] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.350950 30615 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.354457 30615 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:04.297152 30394 tablet_service.cc:1511] Processing CreateTablet for tablet fadcc5b6fd8a4ea992fa104050ad1a12 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:04.351476 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632f38fdbf84c58a587a59a81f394ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.356410 30400 tablet_service.cc:1511] Processing CreateTablet for tablet e4f6773aa18b4ca9a0d9829e2021b82e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:04.357661 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f6773aa18b4ca9a0d9829e2021b82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.358263 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcc5b6fd8a4ea992fa104050ad1a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.361009 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a7575b0e686483ca3a32ff9be16a338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.361407 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcc5b6fd8a4ea992fa104050ad1a12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:04.366730 30450 leader_election.cc:343] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:04.367427 30450 leader_election.cc:343] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.367642 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:04.368161 30468 tablet_service.cc:1511] Processing CreateTablet for tablet e4f6773aa18b4ca9a0d9829e2021b82e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:09:04.369081 30451 leader_election.cc:343] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.369382 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f6773aa18b4ca9a0d9829e2021b82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.369521 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:04.370854 30615 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:04.371407 30451 leader_election.cc:343] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.374959 30602 tablet_bootstrap.cc:654] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.376181 30475 tablet_service.cc:1511] Processing CreateTablet for tablet 6b385b950a414bce8902269df58e5bf4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:04.377434 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b385b950a414bce8902269df58e5bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.379374 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632f38fdbf84c58a587a59a81f394ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.380199 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 550a9c0ab10040efb87b80fce405535d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:04.381383 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550a9c0ab10040efb87b80fce405535d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.383193 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcc5b6fd8a4ea992fa104050ad1a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.367842 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:04.385381 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b91286dc8d477e8ebec973b266b7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.386613 30470 tablet_service.cc:1511] Processing CreateTablet for tablet b5b1451644b74f359b2aae8ebfaf45d3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:04.390166 30615 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.360101 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97aadeef4e4fb9b4f6d566a7908278 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:04.395507 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:04.374306 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 6b385b950a414bce8902269df58e5bf4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:04.395536 30601 tablet_bootstrap.cc:654] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.429656 30476 tablet_service.cc:1511] Processing CreateTablet for tablet d909a45f39c448af875585d7299103f6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:04.390990 30398 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97aadeef4e4fb9b4f6d566a7908278 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:09:04.411007 30450 leader_election.cc:343] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.411216 30397 tablet_service.cc:1511] Processing CreateTablet for tablet d909a45f39c448af875585d7299103f6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:04.427268 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b1451644b74f359b2aae8ebfaf45d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.429711 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 550a9c0ab10040efb87b80fce405535d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:04.432925 30450 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:04.440496 30615 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.441746 30393 tablet_service.cc:1511] Processing CreateTablet for tablet b5b1451644b74f359b2aae8ebfaf45d3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:04.447081 30608 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.447865 30608 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.457122 30476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a45f39c448af875585d7299103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.447595 30547 tablet_service.cc:1511] Processing CreateTablet for tablet e4f6773aa18b4ca9a0d9829e2021b82e (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:04.480017 30471 tablet_service.cc:1511] Processing CreateTablet for tablet f2c4e8b43b5248a6b8811c7335522edb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:04.482221 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97aadeef4e4fb9b4f6d566a7908278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.467145 30608 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:04.495227 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97aadeef4e4fb9b4f6d566a7908278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.496523 30550 tablet_service.cc:1511] Processing CreateTablet for tablet 550a9c0ab10040efb87b80fce405535d (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:04.498483 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550a9c0ab10040efb87b80fce405535d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.486871 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 6b385b950a414bce8902269df58e5bf4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:04.500094 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b385b950a414bce8902269df58e5bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.501423 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b385b950a414bce8902269df58e5bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.506982 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550a9c0ab10040efb87b80fce405535d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.507319 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f6773aa18b4ca9a0d9829e2021b82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.488128 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 3d97aadeef4e4fb9b4f6d566a7908278 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:04.509644 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a45f39c448af875585d7299103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.509979 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97aadeef4e4fb9b4f6d566a7908278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.506466 30549 tablet_service.cc:1511] Processing CreateTablet for tablet d909a45f39c448af875585d7299103f6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:04.525533 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c4e8b43b5248a6b8811c7335522edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.525574 30543 tablet_service.cc:1511] Processing CreateTablet for tablet f2c4e8b43b5248a6b8811c7335522edb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:04.527309 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c4e8b43b5248a6b8811c7335522edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.520802 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b1451644b74f359b2aae8ebfaf45d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.526357 30473 tablet_service.cc:1511] Processing CreateTablet for tablet 8972e85ae0a345ccbcc03a1799a386c5 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:04.486438 30545 tablet_service.cc:1511] Processing CreateTablet for tablet b5b1451644b74f359b2aae8ebfaf45d3 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:04.537014 30600 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:04.537509 30600 ts_tablet_manager.cc:1403] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.307s	user 0.006s	sys 0.010s
I20260709 13:09:04.537854 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 8972e85ae0a345ccbcc03a1799a386c5 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:04.540349 30600 raft_consensus.cc:359] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.541039 30600 raft_consensus.cc:385] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.541337 30600 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.542384 30600 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.543668 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8972e85ae0a345ccbcc03a1799a386c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.544538 30600 ts_tablet_manager.cc:1434] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:04.550715 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 0efe22046955442f80d17ac45b08253b (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:04.550899 30394 tablet_service.cc:1511] Processing CreateTablet for tablet f2c4e8b43b5248a6b8811c7335522edb (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:04.552338 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c4e8b43b5248a6b8811c7335522edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.555429 30600 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:04.555662 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a45f39c448af875585d7299103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.559861 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b1451644b74f359b2aae8ebfaf45d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.559942 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 0efe22046955442f80d17ac45b08253b (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:04.561901 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efe22046955442f80d17ac45b08253b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.564577 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efe22046955442f80d17ac45b08253b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.565302 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 93b081f573884221a895fd5d1acd47d4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:04.567340 30609 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.567900 30609 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.569990 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8972e85ae0a345ccbcc03a1799a386c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.565416 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 93b081f573884221a895fd5d1acd47d4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:04.571776 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b081f573884221a895fd5d1acd47d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.575536 30601 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:04.576068 30601 ts_tablet_manager.cc:1403] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.416s	user 0.030s	sys 0.009s
I20260709 13:09:04.578822 30602 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:04.579300 30602 ts_tablet_manager.cc:1403] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.347s	user 0.026s	sys 0.021s
I20260709 13:09:04.586647 30600 tablet_bootstrap.cc:654] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.587401 30601 raft_consensus.cc:359] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.591554 30609 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:04.591779 30601 raft_consensus.cc:385] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.592480 30601 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.595007 30601 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.542941 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 8972e85ae0a345ccbcc03a1799a386c5 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:04.614454 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b081f573884221a895fd5d1acd47d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.617331 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8972e85ae0a345ccbcc03a1799a386c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.623009 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 0efe22046955442f80d17ac45b08253b (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:04.624666 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0efe22046955442f80d17ac45b08253b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.636962 30601 ts_tablet_manager.cc:1434] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 13:09:04.637962 30601 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:04.587343 30602 raft_consensus.cc:359] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.659178 30601 tablet_bootstrap.cc:654] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.655650 30602 raft_consensus.cc:385] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.671095 30602 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.671443 30397 tablet_service.cc:1511] Processing CreateTablet for tablet ca06fa0758d044ec9b556e21520124e6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:04.672726 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca06fa0758d044ec9b556e21520124e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.672056 30602 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.674383 30602 ts_tablet_manager.cc:1434] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.004s
I20260709 13:09:04.676818 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:04.679100 30524 leader_election.cc:343] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.680167 30602 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:04.683450 30472 tablet_service.cc:1511] Processing CreateTablet for tablet ca06fa0758d044ec9b556e21520124e6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:04.686275 30602 tablet_bootstrap.cc:654] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:04.694288 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca06fa0758d044ec9b556e21520124e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.690534 30397 tablet_service.cc:1511] Processing CreateTablet for tablet d0a59ccddffd4014bdeda9cac96154f7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:04.692900 30394 tablet_service.cc:1511] Processing CreateTablet for tablet e16021f7db32485f8ce7b81d2cd291b8 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:04.696355 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a59ccddffd4014bdeda9cac96154f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.697117 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16021f7db32485f8ce7b81d2cd291b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.698457 30467 tablet_service.cc:1511] Processing CreateTablet for tablet e16021f7db32485f8ce7b81d2cd291b8 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:04.699657 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16021f7db32485f8ce7b81d2cd291b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.701259 30550 tablet_service.cc:1511] Processing CreateTablet for tablet ca06fa0758d044ec9b556e21520124e6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:04.702443 30550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca06fa0758d044ec9b556e21520124e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.705631 30401 tablet_service.cc:1511] Processing CreateTablet for tablet b145c49726dc4998aea9471d4b0ca159 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:04.712973 30471 tablet_service.cc:1511] Processing CreateTablet for tablet d0a59ccddffd4014bdeda9cac96154f7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:04.630434 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 93b081f573884221a895fd5d1acd47d4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:04.715647 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b081f573884221a895fd5d1acd47d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.720101 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:04.726898 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a59ccddffd4014bdeda9cac96154f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.736279 30545 tablet_service.cc:1511] Processing CreateTablet for tablet b145c49726dc4998aea9471d4b0ca159 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:04.736738 30549 tablet_service.cc:1511] Processing CreateTablet for tablet e16021f7db32485f8ce7b81d2cd291b8 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:04.737613 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145c49726dc4998aea9471d4b0ca159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.738933 30543 tablet_service.cc:1511] Processing CreateTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:04.740160 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.756201 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 2066b43938d64be7be50295fb7cf724a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:04.774760 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145c49726dc4998aea9471d4b0ca159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.726217 30548 tablet_service.cc:1511] Processing CreateTablet for tablet d0a59ccddffd4014bdeda9cac96154f7 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:04.747337 30468 tablet_service.cc:1511] Processing CreateTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:04.776182 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e16021f7db32485f8ce7b81d2cd291b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.784122 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.787954 30473 tablet_service.cc:1511] Processing CreateTablet for tablet b145c49726dc4998aea9471d4b0ca159 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:04.789197 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b145c49726dc4998aea9471d4b0ca159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.798413 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.800117 30615 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.800604 30615 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.802804 30615 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:04.805276 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:04.807121 30450 leader_election.cc:343] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.808945 30393 tablet_service.cc:1511] Processing CreateTablet for tablet f9ed30c25a2940f2b0a16f63a49eb1a6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:04.810499 30475 tablet_service.cc:1511] Processing CreateTablet for tablet f9ed30c25a2940f2b0a16f63a49eb1a6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:04.774302 30394 tablet_service.cc:1511] Processing CreateTablet for tablet 2066b43938d64be7be50295fb7cf724a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:04.815910 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:04.816582 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2066b43938d64be7be50295fb7cf724a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:04.817284 30451 leader_election.cc:343] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.817741 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:04.817296 30544 tablet_service.cc:1511] Processing CreateTablet for tablet f9ed30c25a2940f2b0a16f63a49eb1a6 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:04.818953 30615 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:04.819438 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed30c25a2940f2b0a16f63a49eb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.811736 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed30c25a2940f2b0a16f63a49eb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.810647 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed30c25a2940f2b0a16f63a49eb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.831327 30608 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.842643 30608 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.844655 30608 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:04.846177 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:04.847662 30524 leader_election.cc:343] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.850416 30468 tablet_service.cc:1511] Processing CreateTablet for tablet c4b473589cd94be59022580022e2de00 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:04.833249 30600 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:04.841822 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 290c8f7e148a4bd4b296c97e9c6552c4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:04.859018 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 2066b43938d64be7be50295fb7cf724a (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:04.861171 30601 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:04.861652 30601 ts_tablet_manager.cc:1403] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.224s	user 0.026s	sys 0.000s
W20260709 13:09:04.862495 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:04.864593 30601 raft_consensus.cc:359] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.865303 30601 raft_consensus.cc:385] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.865595 30601 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.866349 30601 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.868476 30601 ts_tablet_manager.cc:1434] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:04.856935 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a59ccddffd4014bdeda9cac96154f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.882867 30398 tablet_service.cc:1511] Processing CreateTablet for tablet 370c7d03a9fc4d11a8594e49e0b79a64 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:04.883648 30544 tablet_service.cc:1511] Processing CreateTablet for tablet c4b473589cd94be59022580022e2de00 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:04.839766 30392 tablet_service.cc:1511] Processing CreateTablet for tablet c4b473589cd94be59022580022e2de00 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:04.887240 30602 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:04.887718 30602 ts_tablet_manager.cc:1403] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.032s
I20260709 13:09:04.888093 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 290c8f7e148a4bd4b296c97e9c6552c4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:04.891110 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2066b43938d64be7be50295fb7cf724a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.894100 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c7d03a9fc4d11a8594e49e0b79a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.895653 30602 raft_consensus.cc:359] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.896343 30602 raft_consensus.cc:385] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.896637 30602 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.897567 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b473589cd94be59022580022e2de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.897732 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b473589cd94be59022580022e2de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.900666 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290c8f7e148a4bd4b296c97e9c6552c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.885027 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:04.886059 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:04.904376 30484 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:04.883874 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:04.905982 30374 leader_election.cc:343] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.907066 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:04.907912 30608 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:04.908267 30608 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.908612 30608 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:04.907681 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 290c8f7e148a4bd4b296c97e9c6552c4 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:04.918576 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 370c7d03a9fc4d11a8594e49e0b79a64 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:04.920163 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c7d03a9fc4d11a8594e49e0b79a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.922549 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290c8f7e148a4bd4b296c97e9c6552c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.924721 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b473589cd94be59022580022e2de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.914274 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 370c7d03a9fc4d11a8594e49e0b79a64 (DEFAULT_TABLE table=test-workload [id=9873667297e3409ebf7b87a04f44298c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:04.926720 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2066b43938d64be7be50295fb7cf724a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:04.929133 30523 leader_election.cc:343] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:04.929593 30523 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:04.879894 30600 ts_tablet_manager.cc:1403] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.325s	user 0.019s	sys 0.030s
I20260709 13:09:04.937637 30600 raft_consensus.cc:359] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.938359 30600 raft_consensus.cc:385] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:04.938959 30602 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.941073 30602 ts_tablet_manager.cc:1434] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.002s
I20260709 13:09:04.948408 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370c7d03a9fc4d11a8594e49e0b79a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.951498 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290c8f7e148a4bd4b296c97e9c6552c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:04.954299 30602 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:04.938645 30600 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:04.971819 30601 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:04.972648 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 43560us
I20260709 13:09:04.989327 30608 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.991396 30600 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:04.998792 30600 ts_tablet_manager.cc:1434] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 13:09:04.992871 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.003055 30485 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.008330 30628 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.008989 30628 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.009405 30628 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.010450 30602 tablet_bootstrap.cc:654] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.012300 30485 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.013893 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.014133 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.014648 30608 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.015234 30608 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.015774 30608 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.016557 30608 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.022037 30600 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.037742 30628 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.038862 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.039522 30485 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.051977 30601 tablet_bootstrap.cc:654] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.055418 30609 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.057227 30609 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.059616 30609 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.056603 30600 tablet_bootstrap.cc:654] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.063562 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.065668 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:05.072480 30376 leader_election.cc:343] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.072958 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.074082 30609 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.079769 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.080811 30601 tablet_bootstrap.cc:492] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
W20260709 13:09:05.080902 30374 leader_election.cc:343] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.081475 30601 ts_tablet_manager.cc:1403] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.004s
I20260709 13:09:05.083088 30608 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.083477 30608 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.083815 30608 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.085089 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.084851 30308 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.087853 30602 tablet_bootstrap.cc:492] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.088335 30602 ts_tablet_manager.cc:1403] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.026s
I20260709 13:09:05.085204 30601 raft_consensus.cc:359] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.090752 30601 raft_consensus.cc:385] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.091176 30601 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.091750 30602 raft_consensus.cc:359] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.091833 30608 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.092562 30602 raft_consensus.cc:385] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.092900 30602 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.092875 30601 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.093887 30602 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.094430 30608 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:05.092381 30524 leader_election.cc:343] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.095500 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:05.095850 30524 leader_election.cc:343] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.096009 30602 ts_tablet_manager.cc:1434] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:05.096042 30485 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.097559 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.098573 30601 ts_tablet_manager.cc:1434] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:09:05.099558 30601 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:05.099969 30376 leader_election.cc:343] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.100397 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.101414 30609 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.101691 30600 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.102201 30600 ts_tablet_manager.cc:1403] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.080s	user 0.004s	sys 0.014s
I20260709 13:09:05.102991 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.103523 30485 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
W20260709 13:09:05.104291 30524 leader_election.cc:343] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.105163 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.105036 30600 raft_consensus.cc:359] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.105768 30600 raft_consensus.cc:385] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.105427 30602 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.106122 30608 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.106146 30600 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.107095 30608 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.107278 30600 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.108081 30608 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.113387 30602 tablet_bootstrap.cc:654] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.115625 30600 ts_tablet_manager.cc:1434] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:05.120219 30601 tablet_bootstrap.cc:654] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.124799 30601 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.125201 30601 ts_tablet_manager.cc:1403] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:09:05.126554 30600 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.127398 30601 raft_consensus.cc:359] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.127957 30601 raft_consensus.cc:385] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.128199 30601 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.128985 30601 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.130652 30601 ts_tablet_manager.cc:1434] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:09:05.133176 30601 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.133889 30600 tablet_bootstrap.cc:654] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.139230 30602 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.139519 30601 tablet_bootstrap.cc:654] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.139726 30602 ts_tablet_manager.cc:1403] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.006s
I20260709 13:09:05.142948 30602 raft_consensus.cc:359] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.144474 30609 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.145056 30609 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.147733 30609 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.149761 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.150820 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:05.151631 30374 leader_election.cc:343] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.143898 30602 raft_consensus.cc:385] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.152506 30602 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.153703 30602 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.157008 30602 ts_tablet_manager.cc:1434] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:05.156708 30309 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.158461 30602 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
W20260709 13:09:05.159122 30376 leader_election.cc:343] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.159698 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.160724 30609 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.171514 30600 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.171995 30600 ts_tablet_manager.cc:1403] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.014s
I20260709 13:09:05.172510 30602 tablet_bootstrap.cc:654] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.172513 30601 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.174412 30601 ts_tablet_manager.cc:1403] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.017s
I20260709 13:09:05.176783 30600 raft_consensus.cc:359] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.177582 30600 raft_consensus.cc:385] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.177592 30601 raft_consensus.cc:359] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.178165 30602 tablet_bootstrap.cc:492] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.178503 30601 raft_consensus.cc:385] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.178038 30600 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.178754 30602 ts_tablet_manager.cc:1403] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:09:05.178834 30601 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.179637 30601 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.179613 30600 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.181921 30601 ts_tablet_manager.cc:1434] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:05.181661 30602 raft_consensus.cc:359] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.182351 30602 raft_consensus.cc:385] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.182633 30602 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.183399 30601 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.183346 30602 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.186046 30615 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.186527 30615 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.188614 30615 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.189657 30601 tablet_bootstrap.cc:654] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.191708 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.192411 30602 ts_tablet_manager.cc:1434] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:05.192384 30410 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.190529 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.194137 30560 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.195741 30602 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.195797 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.185592 30600 ts_tablet_manager.cc:1434] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:05.199721 30600 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.203538 30615 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.203941 30615 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.204268 30615 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.208118 30600 tablet_bootstrap.cc:654] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.212496 30602 tablet_bootstrap.cc:654] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.213387 30601 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.213799 30601 ts_tablet_manager.cc:1403] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 13:09:05.210155 30615 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.217042 30600 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.216923 30601 raft_consensus.cc:359] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.217577 30600 ts_tablet_manager.cc:1403] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:09:05.217612 30601 raft_consensus.cc:385] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.217998 30602 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.217998 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.218029 30601 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.218679 30602 ts_tablet_manager.cc:1403] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.006s
I20260709 13:09:05.218804 30410 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.219265 30601 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.220667 30600 raft_consensus.cc:359] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.221336 30600 raft_consensus.cc:385] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.221657 30600 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.221560 30602 raft_consensus.cc:359] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.222361 30602 raft_consensus.cc:385] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.222718 30602 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.222517 30600 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.223481 30602 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.225668 30602 ts_tablet_manager.cc:1434] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:05.226971 30602 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.229979 30410 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.230383 30601 ts_tablet_manager.cc:1434] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:09:05.231190 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.232532 30600 ts_tablet_manager.cc:1434] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:09:05.234586 30601 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.234524 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:05.234920 30609 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.235198 30560 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.237946 30609 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.240120 30609 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.241214 30601 tablet_bootstrap.cc:654] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.241606 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.242347 30485 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:05.242673 30560 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.244801 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.250108 30602 tablet_bootstrap.cc:654] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.251097 30600 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.252255 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.253558 30609 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.258272 30600 tablet_bootstrap.cc:654] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.258924 30601 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.259375 30601 ts_tablet_manager.cc:1403] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 13:09:05.262367 30601 raft_consensus.cc:359] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.246958 30615 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.263247 30601 raft_consensus.cc:385] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.264694 30601 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.265684 30601 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.268640 30601 ts_tablet_manager.cc:1434] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:05.269825 30601 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.247478 30647 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.273121 30647 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:05.276803 30601 tablet_bootstrap.cc:654] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.277382 30609 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.274333 30647 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.283951 30615 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.284747 30600 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.284443 30615 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.285393 30600 ts_tablet_manager.cc:1403] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:09:05.286672 30615 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.288375 30601 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.288035 30600 raft_consensus.cc:359] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.288712 30600 raft_consensus.cc:385] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.288800 30601 ts_tablet_manager.cc:1403] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:09:05.288968 30600 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.289405 30600 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.290360 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.290979 30600 ts_tablet_manager.cc:1434] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:05.291483 30601 raft_consensus.cc:359] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.291926 30600 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.292150 30601 raft_consensus.cc:385] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.292454 30601 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
W20260709 13:09:05.292642 30451 leader_election.cc:343] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.291923 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.293145 30601 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.295133 30601 ts_tablet_manager.cc:1434] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:05.296401 30601 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:05.296922 30450 leader_election.cc:343] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.297437 30600 tablet_bootstrap.cc:654] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.297340 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.298344 30615 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.300827 30601 tablet_bootstrap.cc:654] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.305590 30309 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.311478 30608 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.312134 30608 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.314527 30629 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.315305 30629 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.317299 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.318074 30629 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.318185 30485 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.320952 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.322165 30608 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.323011 30609 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.323706 30609 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.327605 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.328476 30485 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
W20260709 13:09:05.329015 30524 leader_election.cc:343] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.330067 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.330540 30523 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.332624 30608 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.333163 30608 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.333823 30608 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.333081 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:05.336016 30524 leader_election.cc:343] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.337297 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.338160 30485 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.341931 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.343482 30629 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.343997 30629 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.344483 30629 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.346391 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.347301 30559 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:05.351298 30609 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.351994 30609 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.352413 30609 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.352909 30609 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.361958 30602 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.361516 30629 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.362474 30602 ts_tablet_manager.cc:1403] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.136s	user 0.022s	sys 0.017s
I20260709 13:09:05.365319 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.365548 30602 raft_consensus.cc:359] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.366216 30602 raft_consensus.cc:385] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.366508 30602 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.366839 30629 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:05.367462 30524 leader_election.cc:343] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.367266 30602 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.368456 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.369009 30600 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.369086 30485 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.369396 30600 ts_tablet_manager.cc:1403] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.078s	user 0.038s	sys 0.036s
I20260709 13:09:05.369433 30602 ts_tablet_manager.cc:1434] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:05.370813 30602 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.372068 30601 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.371753 30600 raft_consensus.cc:359] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.372478 30600 raft_consensus.cc:385] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.372601 30601 ts_tablet_manager.cc:1403] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.076s	user 0.038s	sys 0.025s
I20260709 13:09:05.372848 30600 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.373637 30600 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.375404 30601 raft_consensus.cc:359] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.376070 30601 raft_consensus.cc:385] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.376417 30601 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.377139 30602 tablet_bootstrap.cc:654] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.377466 30601 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.378127 30647 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.378562 30647 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.379741 30601 ts_tablet_manager.cc:1434] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:05.380713 30601 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.380587 30647 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.382206 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.383327 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.384270 30559 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.384217 30410 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.385722 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.386557 30647 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.386988 30601 tablet_bootstrap.cc:654] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.386950 30647 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.387373 30647 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.383657 30600 ts_tablet_manager.cc:1434] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:09:05.395924 30600 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.407442 30600 tablet_bootstrap.cc:654] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.398613 30647 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.411235 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:05.412022 30559 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.416877 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.417737 30410 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.423243 30629 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:05.428445 30647 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.454829 30608 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.459270 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.454913 30559 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.463424 30655 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.463948 30655 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.465060 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.465999 30647 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.466526 30647 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:05.466251 30655 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.467866 30600 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.468449 30600 ts_tablet_manager.cc:1403] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.002s
I20260709 13:09:05.467651 30647 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:05.463141 30524 leader_election.cc:343] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.472033 30600 raft_consensus.cc:359] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.472961 30600 raft_consensus.cc:385] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.473300 30600 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.474128 30600 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.477310 30600 ts_tablet_manager.cc:1434] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:05.478483 30600 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.480765 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.481606 30484 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:05.483264 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.484372 30655 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.484875 30655 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.485245 30655 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.488233 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.488989 30559 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:05.490604 30600 tablet_bootstrap.cc:654] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.494801 30655 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.498006 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.498828 30484 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.502797 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:05.503558 30559 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.505255 30609 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.509006 30484 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:05.516268 30629 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:05.516455 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.516614 30559 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:05.527436 30308 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.510852 30485 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.511325 30655 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.536811 30655 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.537482 30655 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:05.538664 30655 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.548581 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.550166 30629 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.550480 30647 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.551923 30647 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.555729 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.556591 30411 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.558243 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.559358 30615 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.559880 30600 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.559834 30615 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.560451 30615 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.568177 30647 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.571069 30600 ts_tablet_manager.cc:1403] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.093s	user 0.006s	sys 0.013s
I20260709 13:09:05.577564 30615 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.580855 30600 raft_consensus.cc:359] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.581696 30600 raft_consensus.cc:385] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.582870 30629 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.584211 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.585510 30615 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.582168 30655 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.587082 30559 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:05.587505 30655 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.585932 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.588423 30411 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.589776 30655 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.588706 30309 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.590706 30600 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.590443 30629 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.591450 30600 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.593181 30668 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.593747 30600 ts_tablet_manager.cc:1434] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:09:05.593675 30668 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.594686 30600 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.595773 30668 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.596534 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:05.604537 30670 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.605027 30670 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.603492 30559 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.622996 30410 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.634557 30608 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.640717 30602 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.640584 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.641175 30602 ts_tablet_manager.cc:1403] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.271s	user 0.046s	sys 0.136s
I20260709 13:09:05.641263 30483 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.641791 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.642373 30484 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.636494 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.607856 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.614924 30411 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.644186 30602 raft_consensus.cc:359] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.644850 30602 raft_consensus.cc:385] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.645066 30602 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.645298 30408 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.646677 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.647650 30608 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.647993 30608 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.648319 30608 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.637259 30670 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.654011 30601 tablet_bootstrap.cc:492] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.643941 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.657160 30308 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.659514 30482 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.660993 30601 ts_tablet_manager.cc:1403] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.280s	user 0.067s	sys 0.113s
I20260709 13:09:05.654275 30602 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.655367 30609 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.656388 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.657099 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.659514 30485 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:05.664886 30411 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:05.664819 30615 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.665342 30615 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:05.663534 30559 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:05.657804 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.664178 30600 tablet_bootstrap.cc:654] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.666884 30615 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.669821 30410 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.667719 30602 ts_tablet_manager.cc:1434] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:09:05.671257 30602 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.674381 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:05.674428 30483 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.675736 30560 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.675890 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.676505 30523 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.680244 30671 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.680753 30671 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.681348 30671 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.674569 30670 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:05.684464 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.690828 30647 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.691468 30647 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.694046 30647 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.694728 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:05.697052 30450 leader_election.cc:343] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.677531 30608 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.695123 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.698141 30560 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:05.699143 30670 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:05.699131 30451 leader_election.cc:343] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.699753 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.701413 30647 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.702351 30602 tablet_bootstrap.cc:654] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.704041 30672 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:05.703545 30608 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.706656 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.707372 30410 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.702901 30482 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:05.708483 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.709014 30486 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.709378 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.710300 30609 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.710765 30609 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:05.710865 30601 raft_consensus.cc:359] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.711565 30601 raft_consensus.cc:385] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.711880 30601 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.713146 30601 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.716045 30601 ts_tablet_manager.cc:1434] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.006s
I20260709 13:09:05.717693 30600 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.718080 30600 ts_tablet_manager.cc:1403] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.010s
I20260709 13:09:05.711634 30609 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.719231 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.723009 30655 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:05.726969 30308 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.729607 30601 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.733799 30410 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.736490 30671 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.736974 30671 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.737370 30647 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:05.739542 30486 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.740762 30671 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.740188 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:05.745782 30482 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.745828 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.746734 30671 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.747025 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.747400 30671 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.748121 30608 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.748634 30608 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.749069 30608 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.748306 30671 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.762228 30601 tablet_bootstrap.cc:654] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.761976 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.775180 30410 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:05.780546 30608 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.785727 30608 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:05.787497 30669 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:05.788893 30600 raft_consensus.cc:359] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.789562 30600 raft_consensus.cc:385] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.789917 30600 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.790472 30600 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.789575 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:05.793927 30600 ts_tablet_manager.cc:1434] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:09:05.793193 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:05.796813 30601 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.796811 30409 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.797375 30601 ts_tablet_manager.cc:1403] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.008s
I20260709 13:09:05.798635 30600 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.801111 30601 raft_consensus.cc:359] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.801599 30601 raft_consensus.cc:385] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.801822 30601 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.794600 30482 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.802407 30601 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.802253 30308 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.804463 30601 ts_tablet_manager.cc:1434] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:05.805974 30601 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.815011 30306 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.821309 30482 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:05.823017 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:05.824136 30608 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:05.824951 30608 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:05.825862 30608 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.826822 30602 tablet_bootstrap.cc:492] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.827306 30602 ts_tablet_manager.cc:1403] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.000s
I20260709 13:09:05.831854 30602 raft_consensus.cc:359] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.832501 30602 raft_consensus.cc:385] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.832830 30600 tablet_bootstrap.cc:654] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.832788 30602 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.833523 30602 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.835421 30602 ts_tablet_manager.cc:1434] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:05.836253 30602 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.829284 30601 tablet_bootstrap.cc:654] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.841459 30602 tablet_bootstrap.cc:654] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.847633 30409 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
W20260709 13:09:05.866683 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:05.877187 30308 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.879689 30308 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.886595 30601 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.887185 30601 ts_tablet_manager.cc:1403] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.031s
I20260709 13:09:05.888489 30600 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.888926 30600 ts_tablet_manager.cc:1403] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.030s
I20260709 13:09:05.889436 30602 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.889859 30602 ts_tablet_manager.cc:1403] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.035s
I20260709 13:09:05.890174 30601 raft_consensus.cc:359] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.890939 30601 raft_consensus.cc:385] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.891253 30601 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.891430 30600 raft_consensus.cc:359] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.892082 30600 raft_consensus.cc:385] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.892411 30600 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.892131 30601 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.892405 30602 raft_consensus.cc:359] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.893144 30602 raft_consensus.cc:385] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.893440 30602 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.893251 30600 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.894212 30602 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.895253 30600 ts_tablet_manager.cc:1434] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:05.895355 30601 ts_tablet_manager.cc:1434] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:05.896289 30600 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.896356 30601 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.899431 30602 ts_tablet_manager.cc:1434] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:05.900435 30602 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.902772 30600 tablet_bootstrap.cc:654] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.902873 30601 tablet_bootstrap.cc:654] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.906682 30602 tablet_bootstrap.cc:654] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.917711 30600 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:05.918457 30600 ts_tablet_manager.cc:1403] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:09:05.920642 30602 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:05.921087 30602 ts_tablet_manager.cc:1403] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:09:05.921559 30601 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.921046 30600 raft_consensus.cc:359] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.921918 30600 raft_consensus.cc:385] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.921995 30601 ts_tablet_manager.cc:1403] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.010s
I20260709 13:09:05.922206 30600 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.922868 30600 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.923669 30602 raft_consensus.cc:359] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.924278 30602 raft_consensus.cc:385] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.924516 30602 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.924932 30600 ts_tablet_manager.cc:1434] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:05.924575 30601 raft_consensus.cc:359] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.925271 30601 raft_consensus.cc:385] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.925149 30602 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.925566 30601 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.925829 30600 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:05.926226 30601 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.928954 30601 ts_tablet_manager.cc:1434] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:05.929951 30602 ts_tablet_manager.cc:1434] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:05.930823 30602 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:05.930837 30669 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:05.933481 30600 tablet_bootstrap.cc:654] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.936318 30601 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.936906 30602 tablet_bootstrap.cc:654] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.942577 30601 tablet_bootstrap.cc:654] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:05.942869 30669 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.943503 30669 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.946460 30669 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.948261 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:05.950228 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.950861 30559 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
W20260709 13:09:05.951948 30450 leader_election.cc:343] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.953296 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:05.954763 30669 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.955250 30669 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.955703 30669 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:05.957459 30601 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:05.957947 30601 ts_tablet_manager.cc:1403] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:09:05.964989 30601 raft_consensus.cc:359] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.966284 30601 raft_consensus.cc:385] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:05.966605 30601 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:05.967447 30601 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.970175 30601 ts_tablet_manager.cc:1434] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:05.970077 30647 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:05.971390 30601 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:05.977533 30609 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.978017 30609 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:05.980141 30609 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:05.981717 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:05.983187 30374 leader_election.cc:343] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:05.984715 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:05.985342 30560 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:05.987152 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:05.990757 30609 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:05.991668 30655 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:05.992180 30655 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.992617 30655 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.000527 30602 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.001024 30602 ts_tablet_manager.cc:1403] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.035s
I20260709 13:09:06.000870 30655 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.002321 30601 tablet_bootstrap.cc:654] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.003547 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.003646 30602 raft_consensus.cc:359] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.004462 30602 raft_consensus.cc:385] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.004734 30602 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
W20260709 13:09:06.004981 30374 leader_election.cc:343] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.005471 30602 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.007525 30600 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.007745 30602 ts_tablet_manager.cc:1434] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:09:06.007947 30600 ts_tablet_manager.cc:1403] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.004s
I20260709 13:09:06.009241 30602 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.016031 30602 tablet_bootstrap.cc:654] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.018764 30601 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.019225 30601 ts_tablet_manager.cc:1403] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:09:06.027300 30602 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.027769 30602 ts_tablet_manager.cc:1403] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:09:06.030275 30601 raft_consensus.cc:359] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.030498 30602 raft_consensus.cc:359] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.031073 30601 raft_consensus.cc:385] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.031216 30602 raft_consensus.cc:385] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.031590 30601 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.031612 30602 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.032490 30601 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.032642 30602 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.034770 30601 ts_tablet_manager.cc:1434] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:06.035686 30601 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.040678 30669 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.041463 30601 tablet_bootstrap.cc:654] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.042672 30602 ts_tablet_manager.cc:1434] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:09:06.043958 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.044274 30602 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.044654 30560 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.049237 30609 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.050483 30602 tablet_bootstrap.cc:654] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.062839 30655 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.067816 30560 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:06.069417 30602 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.069913 30602 ts_tablet_manager.cc:1403] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.006s
I20260709 13:09:06.070552 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.072237 30702 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.072456 30602 raft_consensus.cc:359] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.072932 30702 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:06.073213 30602 raft_consensus.cc:385] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.073532 30602 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.074332 30602 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.010354 30600 raft_consensus.cc:359] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.075950 30600 raft_consensus.cc:385] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.076320 30600 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.076459 30602 ts_tablet_manager.cc:1434] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:06.074142 30702 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.077669 30602 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.080638 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.080588 30600 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.082031 30669 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:06.082227 30450 leader_election.cc:343] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.083592 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.084592 30560 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.083987 30602 tablet_bootstrap.cc:654] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.086052 30409 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.092720 30600 ts_tablet_manager.cc:1434] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:09:06.093663 30600 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.093907 30672 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.103583 30669 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.107362 30655 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.107827 30655 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.109858 30655 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.113312 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.114051 30482 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:06.119769 30600 tablet_bootstrap.cc:654] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.119840 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.129242 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.150918 30560 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:06.157302 30664 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.160236 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.156425 30655 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.161625 30698 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.161876 30672 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.168313 30669 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.168887 30601 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.168951 30698 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:06.169406 30601 ts_tablet_manager.cc:1403] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.040s
I20260709 13:09:06.172454 30602 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.172931 30602 ts_tablet_manager.cc:1403] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.015s
I20260709 13:09:06.169883 30698 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.173565 30601 raft_consensus.cc:359] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.271471 30601 raft_consensus.cc:385] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.271818 30601 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.193929 30670 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.081s
I20260709 13:09:06.194099 30672 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.278191 30670 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.269114 30647 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.265558 30669 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.278779 30602 raft_consensus.cc:359] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.281082 30602 raft_consensus.cc:385] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.280019 30601 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.192759 30655 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.277094 30672 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.282841 30647 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.281478 30602 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.285053 30670 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.286710 30647 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.287460 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.287937 30669 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.292114 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.309000 30560 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:06.309757 30669 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.311903 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.313162 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.314144 30450 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.315907 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.317056 30600 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.317068 30669 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.296657 30655 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.299957 30601 ts_tablet_manager.cc:1434] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.004s
I20260709 13:09:06.284462 30602 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.331606 30655 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.332307 30601 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.333098 30602 ts_tablet_manager.cc:1434] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.002s
I20260709 13:09:06.333890 30602 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.334088 30655 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.335227 30408 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:06.335295 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.335991 30482 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:06.336973 30704 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.337441 30704 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.340420 30704 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.340715 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.341720 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.342182 30374 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.343679 30602 tablet_bootstrap.cc:654] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.344285 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.344424 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:06.345687 30374 leader_election.cc:343] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.305100 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.341360 30409 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:06.345693 30704 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.347093 30704 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.347389 30704 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.305076 30307 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.322242 30670 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.324297 30647 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.323076 30600 ts_tablet_manager.cc:1403] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.230s	user 0.015s	sys 0.001s
I20260709 13:09:06.328352 30669 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:06.330417 30451 leader_election.cc:343] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.349643 30655 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:06.351691 30647 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.353440 30450 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:06.354207 30669 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.354607 30669 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:06.323006 30523 leader_election.cc:343] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.355032 30669 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:06.356400 30523 leader_election.cc:343] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.303598 30672 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.347954 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:06.358078 30376 leader_election.cc:343] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.365440 30558 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:06.360205 30600 raft_consensus.cc:359] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.361405 30671 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.366828 30671 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.369496 30671 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.366266 30600 raft_consensus.cc:385] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.370302 30600 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.371156 30600 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.361356 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.377123 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:06.378525 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.379058 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.363247 30647 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.373860 30672 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.374365 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.372159 30670 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:06.381330 30601 tablet_bootstrap.cc:654] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.386840 30669 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.401062 30669 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.387885 30558 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:06.402076 30655 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.391458 30486 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
W20260709 13:09:06.399405 30524 leader_election.cc:343] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.403697 30704 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.415611 30647 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.404915 30655 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.420138 30647 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.415652 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.432056 30647 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.432392 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.433084 30670 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.433208 30485 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:06.434937 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.435951 30704 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.435864 30670 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.436353 30609 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.436813 30655 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.436842 30609 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.437475 30609 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.425024 30600 ts_tablet_manager.cc:1434] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.021s
I20260709 13:09:06.425979 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.429181 30523 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.420595 30717 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:09:06.439574 30600 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.445446 30409 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:06.445465 30672 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.447872 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.448959 30672 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.449396 30672 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.449813 30672 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.457343 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.458799 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.459630 30485 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:06.461439 30451 leader_election.cc:343] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.461866 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.464223 30670 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.464457 30723 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.464677 30670 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.465081 30670 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.466070 30601 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.466740 30601 ts_tablet_manager.cc:1403] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.135s	user 0.019s	sys 0.010s
I20260709 13:09:06.467324 30609 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.473279 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.476069 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.475889 30647 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.476706 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:06.475940 30601 raft_consensus.cc:359] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.478062 30601 raft_consensus.cc:385] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.478305 30601 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.478919 30601 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.480633 30601 ts_tablet_manager.cc:1434] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:09:06.474936 30702 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.481017 30702 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.483222 30602 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.483665 30602 ts_tablet_manager.cc:1403] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.009s
I20260709 13:09:06.485780 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.486189 30600 tablet_bootstrap.cc:654] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.486387 30485 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.481361 30702 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.486842 30306 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.487843 30670 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.491950 30670 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.494035 30601 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.493453 30485 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:06.497885 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.498245 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.498627 30558 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:06.498498 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.499048 30482 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:06.499105 30409 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.488368 30647 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.508750 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.508561 30672 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.511582 30704 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.512049 30704 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:06.512869 30704 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.493567 30702 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.512871 30672 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.515861 30609 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.522601 30672 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.535599 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.532512 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.549582 30602 raft_consensus.cc:359] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.550858 30602 raft_consensus.cc:385] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.551129 30602 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
W20260709 13:09:06.555070 30523 leader_election.cc:343] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.553634 30602 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.547228 30672 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.556573 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.560048 30672 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.561398 30702 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.562876 30602 ts_tablet_manager.cc:1434] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:09:06.563539 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.563783 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:06.564350 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.566987 30602 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.568344 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:06.569526 30647 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.569962 30647 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:06.570823 30647 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:06.581670 30374 leader_election.cc:343] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.582494 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.583626 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.584390 30559 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:06.584399 30601 tablet_bootstrap.cc:654] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:06.585915 30523 leader_election.cc:343] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.587409 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.588160 30410 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:06.589150 30376 leader_election.cc:343] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.589582 30376 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:06.591427 30376 leader_election.cc:343] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.592478 30704 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.593173 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.593780 30410 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:06.596531 30602 tablet_bootstrap.cc:654] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.598737 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.600138 30411 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:06.601580 30600 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.602087 30600 ts_tablet_manager.cc:1403] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.163s	user 0.041s	sys 0.001s
I20260709 13:09:06.605157 30600 raft_consensus.cc:359] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.605882 30600 raft_consensus.cc:385] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.606163 30600 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.606917 30600 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.613106 30600 ts_tablet_manager.cc:1434] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:06.614104 30600 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.619135 30524 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.620915 30672 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.621321 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.622092 30672 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.622488 30672 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.623137 30672 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.625061 30601 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.622483 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.625504 30601 ts_tablet_manager.cc:1403] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.004s
I20260709 13:09:06.625722 30717 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:09:06.627017 30376 leader_election.cc:343] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.628181 30601 raft_consensus.cc:359] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.628295 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.628890 30601 raft_consensus.cc:385] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.629158 30601 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.629492 30702 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.633409 30600 tablet_bootstrap.cc:654] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.635794 30601 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.637852 30601 ts_tablet_manager.cc:1434] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:09:06.637656 30307 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.638675 30601 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.645524 30601 tablet_bootstrap.cc:654] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.647986 30602 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.648476 30602 ts_tablet_manager.cc:1403] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.000s
I20260709 13:09:06.651058 30602 raft_consensus.cc:359] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.654844 30600 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.656630 30306 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.659267 30600 ts_tablet_manager.cc:1403] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.003s
I20260709 13:09:06.659106 30602 raft_consensus.cc:385] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.659874 30602 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.660667 30602 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.662036 30600 raft_consensus.cc:359] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.656541 30672 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.662815 30600 raft_consensus.cc:385] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.663209 30600 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.664017 30600 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.663488 30602 ts_tablet_manager.cc:1434] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:06.665488 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.666038 30600 ts_tablet_manager.cc:1434] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:09:06.666057 30411 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.667234 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.667780 30482 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.672226 30411 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:06.673604 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:06.674582 30671 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.675240 30671 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:06.676386 30671 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.680346 30600 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.682474 30482 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:06.683372 30702 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.687105 30600 tablet_bootstrap.cc:654] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.687423 30672 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.665716 30602 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.693354 30601 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.693790 30601 ts_tablet_manager.cc:1403] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.007s
I20260709 13:09:06.696270 30601 raft_consensus.cc:359] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.696892 30601 raft_consensus.cc:385] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.697154 30601 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.699329 30602 tablet_bootstrap.cc:654] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.703366 30601 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.706296 30601 ts_tablet_manager.cc:1434] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:06.707495 30601 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.706960 30307 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.711743 30602 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.712167 30602 ts_tablet_manager.cc:1403] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.005s
I20260709 13:09:06.718853 30602 raft_consensus.cc:359] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.719486 30602 raft_consensus.cc:385] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.719735 30602 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.720322 30602 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.734120 30601 tablet_bootstrap.cc:654] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.737226 30600 tablet_bootstrap.cc:492] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.738011 30600 ts_tablet_manager.cc:1403] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.036s
I20260709 13:09:06.739188 30664 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.740859 30600 raft_consensus.cc:359] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.741504 30600 raft_consensus.cc:385] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.741778 30600 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.742496 30600 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.744481 30600 ts_tablet_manager.cc:1434] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:06.759025 30602 ts_tablet_manager.cc:1434] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 13:09:06.763741 30602 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.762648 30600 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.777714 30600 tablet_bootstrap.cc:654] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.781147 30647 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.783481 30602 tablet_bootstrap.cc:654] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.784152 30601 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.784672 30601 ts_tablet_manager.cc:1403] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.021s
I20260709 13:09:06.785549 30411 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.787668 30671 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.788126 30671 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.791281 30671 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.791676 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.793095 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:06.796190 30524 leader_election.cc:343] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.796408 30482 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:06.798038 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.799839 30671 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.800516 30671 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.800882 30671 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.805203 30647 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:06.806883 30601 raft_consensus.cc:359] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.809686 30601 raft_consensus.cc:385] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.811470 30600 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.812032 30600 ts_tablet_manager.cc:1403] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:09:06.813611 30601 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.816229 30600 raft_consensus.cc:359] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.817001 30600 raft_consensus.cc:385] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.817306 30600 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.817526 30717 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.817971 30717 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.818156 30600 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.820001 30717 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.814469 30601 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.821695 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.816395 30671 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.822800 30410 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:06.820269 30600 ts_tablet_manager.cc:1434] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:06.823812 30600 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.826089 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.826779 30601 ts_tablet_manager.cc:1434] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:09:06.827687 30601 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.829098 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.824857 30671 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.829850 30482 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:06.830530 30664 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.831003 30664 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.833153 30664 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:06.827797 30524 leader_election.cc:343] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.836268 30647 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.836122 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.836122 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.836730 30647 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.837337 30558 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:06.838654 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:06.838830 30482 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:06.841493 30664 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.841970 30664 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.842423 30664 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.845423 30600 tablet_bootstrap.cc:654] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.847971 30602 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.849216 30602 ts_tablet_manager.cc:1403] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.008s
I20260709 13:09:06.848730 30601 tablet_bootstrap.cc:654] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.852341 30602 raft_consensus.cc:359] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.853041 30602 raft_consensus.cc:385] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.853313 30602 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.853634 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.853969 30602 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.855259 30647 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.856106 30602 ts_tablet_manager.cc:1434] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:06.857015 30602 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.858408 30601 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.859889 30601 ts_tablet_manager.cc:1403] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:09:06.860239 30600 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.862727 30600 ts_tablet_manager.cc:1403] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.002s
I20260709 13:09:06.862637 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.863345 30558 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:06.863462 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.863992 30482 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.864849 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.865604 30671 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.866732 30602 tablet_bootstrap.cc:654] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.867488 30451 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:06.869125 30723 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.869470 30723 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.869788 30723 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.872946 30671 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.874332 30601 raft_consensus.cc:359] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.877010 30671 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.877565 30671 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.878268 30724 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.878753 30724 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.880491 30602 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.881405 30602 ts_tablet_manager.cc:1403] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
W20260709 13:09:06.882395 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:06.880831 30724 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.882225 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:06.884203 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:06.883996 30602 raft_consensus.cc:359] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.880491 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:06.884513 30450 leader_election.cc:343] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.884809 30558 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
W20260709 13:09:06.885558 30524 leader_election.cc:343] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.885785 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:06.886000 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.886240 30602 raft_consensus.cc:385] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.886392 30484 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:06.886566 30602 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.887123 30647 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.887470 30647 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.887403 30602 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.887894 30647 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.887909 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.889103 30717 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:06.889452 30602 ts_tablet_manager.cc:1434] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:06.889497 30671 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.889474 30717 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.876662 30601 raft_consensus.cc:385] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.890138 30717 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.890451 30601 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.890885 30602 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.891134 30601 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.875818 30600 raft_consensus.cc:359] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.892025 30600 raft_consensus.cc:385] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.892290 30600 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.892876 30723 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.893179 30600 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.901989 30600 ts_tablet_manager.cc:1434] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:09:06.902884 30600 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:06.903023 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.903399 30723 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.904224 30647 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.903873 30664 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.905786 30410 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:06.896816 30482 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:06.906270 30647 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.907831 30664 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:06.908710 30600 tablet_bootstrap.cc:654] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.909340 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.909909 30558 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:06.909904 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.911163 30671 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.911991 30671 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:06.897699 30602 tablet_bootstrap.cc:654] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.899896 30601 ts_tablet_manager.cc:1434] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:09:06.912371 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:06.912650 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.913237 30601 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.913581 30482 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:06.913980 30450 leader_election.cc:343] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.915972 30671 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.918581 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.918875 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:06.919927 30451 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.922324 30601 tablet_bootstrap.cc:654] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.923252 30558 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:06.925202 30669 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.926338 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.927493 30664 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:06.928006 30664 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:06.928793 30664 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.897094 30717 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.932278 30560 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:06.933804 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:06.935428 30524 leader_election.cc:343] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:06.936580 30717 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:06.938510 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:06.939452 30647 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.944752 30601 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:06.945324 30601 ts_tablet_manager.cc:1403] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:09:06.951404 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:06.952028 30482 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:06.952950 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:06.954355 30672 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:06.959743 30602 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:06.960199 30602 ts_tablet_manager.cc:1403] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.004s
I20260709 13:09:06.960692 30647 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:06.963459 30601 raft_consensus.cc:359] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.965047 30601 raft_consensus.cc:385] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.965394 30601 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.966116 30601 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.967471 30602 raft_consensus.cc:359] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.968207 30601 ts_tablet_manager.cc:1434] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:09:06.968576 30602 raft_consensus.cc:385] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:06.961635 30307 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.969053 30602 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:06.969589 30601 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:06.970178 30602 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:06.979565 30602 ts_tablet_manager.cc:1434] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:09:06.980296 30602 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:06.982820 30600 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:06.983284 30600 ts_tablet_manager.cc:1403] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.007s
I20260709 13:09:06.985909 30306 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.986928 30602 tablet_bootstrap.cc:654] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.987500 30601 tablet_bootstrap.cc:654] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:06.991060 30647 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:07.000466 30671 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.001140 30671 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.036067 30671 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.038496 30602 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.039013 30602 ts_tablet_manager.cc:1403] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 13:09:07.039278 30647 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.039691 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.041422 30602 raft_consensus.cc:359] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.042052 30602 raft_consensus.cc:385] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.042281 30602 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.039769 30647 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.045524 30484 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.044924 30602 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.047629 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.049445 30717 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.049835 30717 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.050120 30717 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.051507 30647 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.051579 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.059227 30704 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.058161 30600 raft_consensus.cc:359] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.059851 30704 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.060503 30600 raft_consensus.cc:385] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.060915 30600 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.063767 30704 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.064518 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.065616 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:07.066797 30374 leader_election.cc:343] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.063060 30600 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.098717 30600 ts_tablet_manager.cc:1434] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.015s
I20260709 13:09:07.099952 30600 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.102645 30671 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.102865 30664 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.103471 30664 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.105885 30664 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.085094 30601 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.107031 30601 ts_tablet_manager.cc:1403] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.138s	user 0.021s	sys 0.011s
I20260709 13:09:07.108062 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.106498 30664 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:07.109810 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:07.114033 30374 leader_election.cc:343] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.115046 30671 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.115669 30671 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.049424 30602 ts_tablet_manager.cc:1434] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
W20260709 13:09:07.120883 30376 leader_election.cc:343] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.121481 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.122907 30671 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.123296 30704 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.124543 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.127949 30647 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.128149 30523 leader_election.cc:343] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.128412 30647 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.128994 30670 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.129431 30670 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.130501 30647 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.131333 30670 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.137442 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:07.138912 30451 leader_election.cc:343] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.139467 30647 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.140077 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.139942 30647 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:07.141166 30376 leader_election.cc:343] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.141610 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.141961 30600 tablet_bootstrap.cc:654] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.141968 30647 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.144686 30559 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.145527 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.149274 30560 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:07.077792 30717 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.154439 30704 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.155750 30558 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:07.170432 30601 raft_consensus.cc:359] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.171226 30601 raft_consensus.cc:385] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.171500 30601 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.172354 30601 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.174600 30601 ts_tablet_manager.cc:1434] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:07.174865 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.174995 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.175515 30601 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.175745 30406 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
W20260709 13:09:07.176319 30450 leader_election.cc:343] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.176767 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.176884 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.177218 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.177838 30647 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.178861 30670 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.179221 30670 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.179258 30524 leader_election.cc:343] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.179610 30670 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.183200 30664 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.186385 30647 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.186323 30670 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.187306 30717 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.187868 30671 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.188989 30670 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.183712 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.191461 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.192332 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.193327 30671 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.174791 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.198046 30602 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.202234 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.201745 30482 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.183233 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.204460 30402 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:07.205842 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.206204 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:07.206658 30523 leader_election.cc:343] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:07.207073 30524 leader_election.cc:343] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:07.207360 30450 leader_election.cc:343] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.207597 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.207792 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.208511 30647 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.207731 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.208532 30671 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.209264 30723 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.212132 30671 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.212958 30671 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.214792 30602 tablet_bootstrap.cc:654] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.219099 30647 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.220976 30601 tablet_bootstrap.cc:654] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.221693 30600 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.223585 30600 ts_tablet_manager.cc:1403] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.004s
I20260709 13:09:07.209854 30411 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.229349 30602 tablet_bootstrap.cc:492] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.229854 30602 ts_tablet_manager.cc:1403] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:09:07.230873 30600 raft_consensus.cc:359] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.231635 30600 raft_consensus.cc:385] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.231901 30600 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.232565 30600 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.234308 30602 raft_consensus.cc:359] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.234876 30600 ts_tablet_manager.cc:1434] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:07.235131 30602 raft_consensus.cc:385] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.235841 30600 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.235864 30664 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.236452 30664 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.238510 30664 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.239681 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.239578 30308 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.235548 30602 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.242074 30602 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.247008 30602 ts_tablet_manager.cc:1434] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:07.249408 30411 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.250582 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.251802 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.252492 30482 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:07.253186 30671 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.253695 30671 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.254205 30602 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.254451 30671 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.259291 30374 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.261780 30664 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.271960 30601 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.273576 30601 ts_tablet_manager.cc:1403] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.014s
I20260709 13:09:07.283257 30600 tablet_bootstrap.cc:654] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.286216 30664 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.288354 30601 raft_consensus.cc:359] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.289064 30601 raft_consensus.cc:385] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.289325 30601 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.289968 30601 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.292025 30601 ts_tablet_manager.cc:1434] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:09:07.292871 30601 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.293959 30602 tablet_bootstrap.cc:654] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.298489 30601 tablet_bootstrap.cc:654] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.299803 30600 tablet_bootstrap.cc:492] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.300283 30600 ts_tablet_manager.cc:1403] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.006s
I20260709 13:09:07.300305 30307 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.303362 30600 raft_consensus.cc:359] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.304028 30600 raft_consensus.cc:385] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.304352 30600 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.305099 30600 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.315253 30600 ts_tablet_manager.cc:1434] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:07.317028 30671 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:07.325623 30600 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.327361 30602 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.327934 30602 ts_tablet_manager.cc:1403] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.008s
I20260709 13:09:07.331002 30602 raft_consensus.cc:359] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.331743 30600 tablet_bootstrap.cc:654] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.331707 30602 raft_consensus.cc:385] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.332175 30602 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.332955 30602 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.335032 30602 ts_tablet_manager.cc:1434] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:07.335966 30602 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.341361 30602 tablet_bootstrap.cc:654] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.341437 30601 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.342259 30601 ts_tablet_manager.cc:1403] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.028s
I20260709 13:09:07.345247 30600 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.345727 30600 ts_tablet_manager.cc:1403] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:09:07.348598 30600 raft_consensus.cc:359] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.348598 30601 raft_consensus.cc:359] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.349387 30600 raft_consensus.cc:385] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.349494 30601 raft_consensus.cc:385] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.349707 30600 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.349876 30601 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.350363 30600 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.352293 30672 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.352749 30672 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.353508 30670 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.354714 30672 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.356637 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.357242 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.358289 30600 ts_tablet_manager.cc:1434] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:07.359274 30600 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.360981 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.361068 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:07.361619 30484 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.364517 30670 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.364885 30670 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.365193 30670 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.371791 30670 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.350797 30601 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.376665 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.377156 30670 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.377246 30406 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.378062 30670 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.378298 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.378523 30670 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.378898 30484 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.379446 30601 ts_tablet_manager.cc:1434] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.004s
I20260709 13:09:07.380376 30601 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.385905 30484 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.386991 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.387480 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.387785 30717 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.388293 30717 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.376688 30600 tablet_bootstrap.cc:654] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.389110 30717 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.396898 30601 tablet_bootstrap.cc:654] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.400094 30600 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.398504 30670 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.400712 30600 ts_tablet_manager.cc:1403] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:09:07.400635 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.401360 30484 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.402774 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.403749 30670 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.404189 30670 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.404603 30670 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.406437 30602 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.407038 30602 ts_tablet_manager.cc:1403] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.006s
I20260709 13:09:07.404029 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:07.408288 30524 leader_election.cc:343] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.409495 30602 raft_consensus.cc:359] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.409991 30602 raft_consensus.cc:385] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.410197 30602 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.410686 30602 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.413569 30602 ts_tablet_manager.cc:1434] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:09:07.421573 30670 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.422806 30600 raft_consensus.cc:359] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.423730 30600 raft_consensus.cc:385] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.424055 30600 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.424108 30308 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.425310 30670 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.426229 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.427311 30601 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
W20260709 13:09:07.427498 30524 leader_election.cc:343] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.427742 30601 ts_tablet_manager.cc:1403] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.012s
I20260709 13:09:07.430224 30601 raft_consensus.cc:359] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.430864 30601 raft_consensus.cc:385] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.431119 30601 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.431231 30602 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.431771 30601 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.433828 30601 ts_tablet_manager.cc:1434] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:07.434654 30601 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.436697 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.437266 30484 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.437536 30602 tablet_bootstrap.cc:654] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.440145 30601 tablet_bootstrap.cc:654] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.440446 30600 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.443109 30484 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.444397 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.448007 30670 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.448697 30670 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.449503 30670 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.450030 30600 ts_tablet_manager.cc:1434] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:09:07.451298 30600 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.453294 30647 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.453761 30647 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.455705 30647 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.457141 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.458024 30406 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:07.459033 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.460170 30600 tablet_bootstrap.cc:654] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.460873 30450 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.461514 30647 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.465528 30602 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.466537 30602 ts_tablet_manager.cc:1403] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.002s
I20260709 13:09:07.469283 30600 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.469727 30600 ts_tablet_manager.cc:1403] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:09:07.469409 30602 raft_consensus.cc:359] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.470098 30602 raft_consensus.cc:385] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.470393 30602 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.471158 30602 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.473412 30602 ts_tablet_manager.cc:1434] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:07.472736 30600 raft_consensus.cc:359] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.473066 30647 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.474166 30600 raft_consensus.cc:385] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.474452 30600 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.475337 30601 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.475136 30600 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.475857 30601 ts_tablet_manager.cc:1403] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.011s
I20260709 13:09:07.477053 30600 ts_tablet_manager.cc:1434] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:07.477900 30600 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.479740 30601 raft_consensus.cc:359] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.480348 30601 raft_consensus.cc:385] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.480612 30601 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.481781 30602 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.483362 30600 tablet_bootstrap.cc:654] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.484742 30601 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.486958 30601 ts_tablet_manager.cc:1434] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:07.487778 30601 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.476935 30309 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.491662 30602 tablet_bootstrap.cc:654] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.494830 30600 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.495277 30600 ts_tablet_manager.cc:1403] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:09:07.498013 30600 raft_consensus.cc:359] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.498835 30600 raft_consensus.cc:385] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.499146 30600 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.499933 30601 tablet_bootstrap.cc:654] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.499794 30600 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.502105 30600 ts_tablet_manager.cc:1434] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:07.503129 30600 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.504107 30602 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.504516 30602 ts_tablet_manager.cc:1403] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:09:07.506942 30602 raft_consensus.cc:359] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.507511 30602 raft_consensus.cc:385] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.507750 30602 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.508409 30602 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.508919 30600 tablet_bootstrap.cc:654] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.515693 30602 ts_tablet_manager.cc:1434] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:07.516583 30602 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.520195 30600 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.520677 30600 ts_tablet_manager.cc:1403] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:09:07.522046 30602 tablet_bootstrap.cc:654] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.523487 30600 raft_consensus.cc:359] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.523978 30601 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.524235 30600 raft_consensus.cc:385] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.524614 30601 ts_tablet_manager.cc:1403] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:09:07.524552 30600 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.525430 30600 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.527624 30601 raft_consensus.cc:359] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.528934 30601 raft_consensus.cc:385] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.529277 30601 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.530108 30601 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.532127 30600 ts_tablet_manager.cc:1434] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:07.532126 30601 ts_tablet_manager.cc:1434] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:07.533358 30600 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.533615 30601 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.539602 30670 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.545750 30723 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.546293 30723 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.550139 30664 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.551594 30600 tablet_bootstrap.cc:654] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.552294 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.555915 30782 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.555750 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.556428 30782 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.556648 30406 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:07.550431 30723 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.542675 30670 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.558313 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.561605 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:07.561868 30451 leader_election.cc:343] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.562242 30485 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.563619 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.564203 30411 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.558472 30782 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.564710 30647 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.565312 30647 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.565703 30647 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.567004 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:07.561605 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.570436 30782 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.576149 30664 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:09:07.598726 30782 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.599485 30782 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.580525 30609 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.601042 30609 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.602041 30602 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.602486 30602 ts_tablet_manager.cc:1403] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.018s
I20260709 13:09:07.571825 30670 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.599972 30647 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.604028 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.604888 30485 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:07.605446 30647 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.605621 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.606209 30406 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.607421 30601 tablet_bootstrap.cc:654] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.607908 30602 raft_consensus.cc:359] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.569492 30523 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.614375 30406 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:07.614610 30602 raft_consensus.cc:385] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:07.614727 30524 leader_election.cc:343] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:07.615263 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46177.1us
I20260709 13:09:07.615386 30670 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.615860 30670 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.616361 30670 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.616748 30717 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.617190 30717 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.617909 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.615803 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.618777 30560 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:07.616756 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.619187 30717 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.619553 30602 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.620611 30376 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.620422 30602 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.621528 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:07.621634 30702 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.619200 30669 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.622309 30669 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:07.623301 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.623942 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.624526 30406 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:07.623292 30669 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.628567 30702 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.630115 30602 ts_tablet_manager.cc:1434] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
W20260709 13:09:07.630805 30451 leader_election.cc:343] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:07.631762 30523 leader_election.cc:343] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.634132 30602 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.630856 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:07.635674 30717 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.636039 30717 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.636528 30523 leader_election.cc:343] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.636895 30411 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.604044 30609 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.613565 30782 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.644312 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.644528 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.645038 30402 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.636364 30717 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.647295 30602 tablet_bootstrap.cc:654] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:07.649040 30523 leader_election.cc:343] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.649508 30782 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.651845 30671 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.655895 30402 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.657326 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.658212 30671 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.658840 30671 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.660032 30671 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.662541 30602 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.663100 30602 ts_tablet_manager.cc:1403] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260709 13:09:07.649652 30670 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.651432 30601 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.664129 30601 ts_tablet_manager.cc:1403] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
I20260709 13:09:07.664868 30717 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.666436 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.666941 30601 raft_consensus.cc:359] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.667627 30601 raft_consensus.cc:385] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.667665 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.668031 30601 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
W20260709 13:09:07.668157 30524 leader_election.cc:343] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.668998 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:07.668932 30601 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.669668 30407 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.671708 30601 ts_tablet_manager.cc:1434] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:07.672784 30601 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.668351 30485 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.681663 30407 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.681423 30602 raft_consensus.cc:359] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.685423 30602 raft_consensus.cc:385] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.686815 30602 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.684852 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:07.687856 30602 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.691494 30602 ts_tablet_manager.cc:1434] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:09:07.691797 30717 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.693396 30602 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.693674 30672 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.701092 30601 tablet_bootstrap.cc:654] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.700644 30672 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.704481 30672 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.707509 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.707999 30782 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.711146 30600 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.711679 30600 ts_tablet_manager.cc:1403] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.005s
I20260709 13:09:07.689052 30670 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.702486 30485 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:07.724206 30702 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:07.725978 30702 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:07.727221 30523 leader_election.cc:343] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.728147 30523 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.730216 30672 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.730929 30672 raft_consensus.cc:697] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:07.733251 30672 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.734267 30600 raft_consensus.cc:359] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.734944 30600 raft_consensus.cc:385] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.735205 30600 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.735822 30600 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.737411 30600 ts_tablet_manager.cc:1434] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.000s
I20260709 13:09:07.738159 30600 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.748380 30702 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.751438 30602 tablet_bootstrap.cc:654] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.753145 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.758833 30670 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:07.755311 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.767863 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.776417 30601 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.776999 30601 ts_tablet_manager.cc:1403] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.007s
I20260709 13:09:07.781111 30601 raft_consensus.cc:359] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.775914 30702 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.781776 30601 raft_consensus.cc:385] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.782171 30601 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.782939 30601 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.785579 30600 tablet_bootstrap.cc:654] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.786931 30702 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.787454 30702 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.789402 30306 catalog_manager.cc:5697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.797987 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.798589 30484 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:07.799000 30647 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.799472 30647 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.799829 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.800700 30609 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.801115 30609 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.801504 30609 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.824522 30609 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.831935 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:07.833541 30451 leader_election.cc:343] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.835034 30647 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.836519 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.836848 30702 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.837073 30484 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.786160 30601 ts_tablet_manager.cc:1434] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:09:07.840983 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.841604 30601 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.842628 30804 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:07.842864 30450 leader_election.cc:343] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.844372 30484 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:07.844636 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.845996 30647 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.847469 30609 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.850667 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.852173 30702 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.852244 30804 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.852795 30804 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.852766 30702 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:07.854152 30702 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.854494 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.855343 30559 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:07.856376 30804 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:07.856945 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:07.857507 30558 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.857928 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.865300 30558 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:07.866936 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.867921 30485 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:07.870050 30523 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:07.871156 30601 tablet_bootstrap.cc:654] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.865743 30309 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.872059 30804 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:07.872552 30309 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.873917 30309 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.875115 30804 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:07.877441 30601 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.877854 30601 ts_tablet_manager.cc:1403] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:09:07.880726 30600 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:07.882157 30308 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.852173 30602 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:07.884030 30602 ts_tablet_manager.cc:1403] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.014s
I20260709 13:09:07.885206 30601 raft_consensus.cc:359] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.885856 30601 raft_consensus.cc:385] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.886122 30601 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.886345 30600 ts_tablet_manager.cc:1403] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.007s
I20260709 13:09:07.890910 30602 raft_consensus.cc:359] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.891569 30602 raft_consensus.cc:385] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.891815 30602 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.892350 30602 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.893425 30600 raft_consensus.cc:359] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.894066 30600 raft_consensus.cc:385] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.894309 30600 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.894958 30600 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.898341 30602 ts_tablet_manager.cc:1434] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:09:07.898878 30601 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.902002 30601 ts_tablet_manager.cc:1434] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:09:07.902921 30601 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:07.905328 30600 ts_tablet_manager.cc:1434] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:07.939831 30609 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.942394 30670 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:07.944414 30600 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:07.944083 30609 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:07.905498 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:07.946718 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.942415 30647 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.947330 30486 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:07.947501 30647 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.929715 30717 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:09:07.948330 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.948952 30558 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:07.949533 30647 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.914333 30702 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.951088 30374 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:07.951011 30702 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.952005 30664 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.952379 30664 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.952736 30664 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.953141 30702 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.946944 30609 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:07.953940 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:07.926569 30406 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:07.955152 30450 leader_election.cc:343] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.955215 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:07.913028 30601 tablet_bootstrap.cc:654] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.957199 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:07.963603 30451 leader_election.cc:343] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.964102 30451 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:07.964826 30647 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:07.967429 30376 leader_election.cc:343] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:07.968837 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:07.906487 30602 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:07.969511 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:07.972628 30664 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.972868 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:07.979146 30609 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:07.983590 30609 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.983964 30609 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.992331 30601 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:07.992795 30601 ts_tablet_manager.cc:1403] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.008s
I20260709 13:09:07.997175 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:07.997800 30485 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.998580 30601 raft_consensus.cc:359] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:07.999585 30601 raft_consensus.cc:385] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.999847 30601 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.000555 30601 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.002291 30601 ts_tablet_manager.cc:1434] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:08.003189 30601 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.003180 30664 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.005155 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.005712 30558 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.006420 30485 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.007540 30374 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.008342 30664 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.008791 30664 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:08.009583 30664 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.011804 30558 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.019202 30647 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:08.014436 30609 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.024049 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:08.024614 30485 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.024279 30717 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.032006 30609 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.033048 30601 tablet_bootstrap.cc:654] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.040455 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.039836 30306 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:08.041705 30376 leader_election.cc:343] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.043099 30600 tablet_bootstrap.cc:654] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.052995 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.054850 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:08.055953 30609 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.056385 30609 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:08.059080 30609 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.059736 30601 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.060312 30601 ts_tablet_manager.cc:1403] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.014s
I20260709 13:09:08.065248 30602 tablet_bootstrap.cc:654] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:08.066767 30523 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.069685 30601 raft_consensus.cc:359] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.070396 30601 raft_consensus.cc:385] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.070655 30601 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.071328 30601 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.072872 30602 tablet_bootstrap.cc:492] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.073300 30602 ts_tablet_manager.cc:1403] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.007s
I20260709 13:09:08.073377 30601 ts_tablet_manager.cc:1434] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:09:08.075954 30601 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.076582 30602 raft_consensus.cc:359] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.077186 30602 raft_consensus.cc:385] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.077442 30602 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.078033 30602 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.080168 30602 ts_tablet_manager.cc:1434] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:08.081043 30602 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.082722 30600 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
W20260709 13:09:08.083494 30451 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.084764 30601 tablet_bootstrap.cc:654] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.086546 30600 ts_tablet_manager.cc:1403] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.004s
I20260709 13:09:08.089026 30600 raft_consensus.cc:359] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.089671 30600 raft_consensus.cc:385] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.089941 30600 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.090920 30600 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.100302 30602 tablet_bootstrap.cc:654] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.101930 30804 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.102569 30804 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:08.103608 30523 consensus_peers.cc:597] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.104554 30600 ts_tablet_manager.cc:1434] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:08.106519 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:08.108296 30524 leader_election.cc:343] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.109519 30804 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.111536 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:08.114280 30523 leader_election.cc:343] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.114737 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.115612 30806 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.116856 30600 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:08.122447 30670 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.123215 30600 tablet_bootstrap.cc:654] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.129195 30723 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.128717 30306 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.129683 30723 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.131636 30723 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.133337 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.133723 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.133962 30558 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:08.134368 30406 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:08.135208 30723 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.135823 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.136615 30669 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.136945 30669 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.137255 30669 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.138026 30601 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.138444 30601 ts_tablet_manager.cc:1403] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.020s
I20260709 13:09:08.140883 30601 raft_consensus.cc:359] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.141505 30601 raft_consensus.cc:385] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.141906 30601 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.142647 30601 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.135697 30723 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.144840 30601 ts_tablet_manager.cc:1434] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:08.141544 30600 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:08.145361 30600 ts_tablet_manager.cc:1403] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:09:08.146652 30723 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.147353 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.148023 30406 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:08.148481 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.149065 30558 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:08.149071 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.150036 30723 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.150408 30723 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.150761 30723 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.151338 30601 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.157181 30601 tablet_bootstrap.cc:654] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.158051 30723 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.160924 30806 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:08.161427 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:08.162025 30406 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.166813 30669 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.173034 30600 raft_consensus.cc:359] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.174609 30669 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.181442 30406 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:08.182001 30600 raft_consensus.cc:385] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.177245 30602 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.182796 30602 ts_tablet_manager.cc:1403] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.001s
I20260709 13:09:08.183091 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.183751 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.184026 30669 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.184358 30559 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.186093 30669 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:08.186996 30669 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.186237 30602 raft_consensus.cc:359] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.188488 30602 raft_consensus.cc:385] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.188848 30602 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.189700 30602 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.192160 30602 ts_tablet_manager.cc:1434] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:08.193055 30602 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.193691 30559 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:08.180454 30723 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.176550 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.195382 30558 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.177213 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:08.198519 30411 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.198653 30602 tablet_bootstrap.cc:654] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.208369 30411 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:08.209617 30450 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.202807 30558 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:08.203282 30600 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.214664 30669 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.214542 30600 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.215430 30669 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:08.217548 30600 ts_tablet_manager.cc:1434] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:09:08.217291 30669 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.218773 30600 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:08.221619 30601 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.222057 30601 ts_tablet_manager.cc:1403] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.024s
I20260709 13:09:08.224995 30601 raft_consensus.cc:359] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.225664 30601 raft_consensus.cc:385] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.225924 30601 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.226526 30601 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.229003 30601 ts_tablet_manager.cc:1434] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:08.229879 30601 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.230283 30309 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.236200 30601 tablet_bootstrap.cc:654] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:08.240357 30524 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.244510 30609 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.245002 30609 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.247073 30609 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.248071 30669 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.248574 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.248529 30669 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.249277 30485 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:08.250479 30669 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.251871 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.252669 30600 tablet_bootstrap.cc:654] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.253937 30374 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.256763 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.257112 30609 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.257550 30609 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.257921 30609 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:08.258358 30376 leader_election.cc:343] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.255023 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.263298 30669 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.266914 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:08.274380 30723 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.273711 30669 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.270990 30806 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.277060 30806 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.260859 30602 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.278273 30602 ts_tablet_manager.cc:1403] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.007s
I20260709 13:09:08.279595 30806 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.280357 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.281150 30602 raft_consensus.cc:359] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.281509 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.281895 30602 raft_consensus.cc:385] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.282186 30602 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.282857 30602 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.277596 30669 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.284562 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.296034 30782 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:08.297236 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:08.286201 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.286386 30406 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:08.299125 30664 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.303596 30723 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.304771 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:08.305755 30523 leader_election.cc:343] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.306151 30782 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.306654 30782 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.307116 30782 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.285547 30602 ts_tablet_manager.cc:1434] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:08.317338 30601 tablet_bootstrap.cc:492] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.317802 30601 ts_tablet_manager.cc:1403] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.009s
I20260709 13:09:08.320434 30601 raft_consensus.cc:359] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.321831 30601 raft_consensus.cc:385] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.322099 30601 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.322872 30601 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.324923 30601 ts_tablet_manager.cc:1434] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:08.325798 30601 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.333695 30672 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.334342 30672 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.335422 30602 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.336999 30672 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.341843 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:08.343415 30524 leader_election.cc:343] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.343617 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.348707 30704 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:08.352044 30523 leader_election.cc:343] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.352627 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.354280 30671 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.265717 30609 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.369410 30601 tablet_bootstrap.cc:654] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.373518 30782 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.375839 30600 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:08.384380 30600 ts_tablet_manager.cc:1403] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.166s	user 0.049s	sys 0.043s
I20260709 13:09:08.376453 30602 tablet_bootstrap.cc:654] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.376782 30609 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.379093 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:08.386823 30376 leader_election.cc:343] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.387006 30600 raft_consensus.cc:359] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.387796 30600 raft_consensus.cc:385] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.388129 30600 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.381448 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:08.388760 30486 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.388877 30600 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.391440 30600 ts_tablet_manager.cc:1434] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:08.392562 30600 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:08.398727 30600 tablet_bootstrap.cc:654] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.400748 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:08.401582 30411 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.404793 30486 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.405699 30601 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.406893 30601 ts_tablet_manager.cc:1403] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:09:08.406982 30374 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:08.409016 30609 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.409489 30609 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:08.410280 30609 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.410920 30601 raft_consensus.cc:359] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.411725 30601 raft_consensus.cc:385] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.412030 30601 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.412532 30600 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:08.412477 30411 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:08.413194 30601 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.413800 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:08.414602 30804 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.413546 30600 ts_tablet_manager.cc:1403] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:09:08.415562 30804 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:08.366583 30306 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 2, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.415787 30601 ts_tablet_manager.cc:1434] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:08.416790 30601 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.416373 30804 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.417734 30600 raft_consensus.cc:359] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.418382 30600 raft_consensus.cc:385] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.418357 30782 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.418877 30600 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.419620 30600 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.423527 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:08.424111 30486 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.431979 30602 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.432597 30602 ts_tablet_manager.cc:1403] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.017s
I20260709 13:09:08.433010 30600 ts_tablet_manager.cc:1434] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:09:08.433939 30600 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:08.437109 30601 tablet_bootstrap.cc:654] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.444764 30669 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.445277 30669 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.446596 30600 tablet_bootstrap.cc:654] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.449347 30602 raft_consensus.cc:359] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.450253 30602 raft_consensus.cc:385] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.450738 30602 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.451655 30602 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.452303 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.453215 30486 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:08.449390 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:08.456015 30451 leader_election.cc:343] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.453147 30411 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:08.458456 30450 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:08.460054 30723 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.460520 30723 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.460960 30723 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.463485 30602 ts_tablet_manager.cc:1434] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:09:08.464421 30602 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.447422 30669 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.469442 30601 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.469296 30804 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.471067 30601 ts_tablet_manager.cc:1403] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.011s
I20260709 13:09:08.471531 30782 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.471696 30804 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.472018 30782 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.471119 30602 tablet_bootstrap.cc:654] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.474387 30804 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.476539 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.474447 30601 raft_consensus.cc:359] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.477730 30601 raft_consensus.cc:385] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.477998 30601 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.478641 30601 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.479876 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:08.483247 30524 leader_election.cc:343] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.483675 30601 ts_tablet_manager.cc:1434] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:08.485612 30601 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:08.485888 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.490054 30484 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.495298 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.497803 30601 tablet_bootstrap.cc:654] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.497906 30485 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:08.500401 30306 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.501536 30609 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.502065 30609 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.474344 30782 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.504091 30609 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.505250 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.506057 30559 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.507998 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.509912 30485 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:08.509145 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:08.511327 30609 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.511756 30609 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.512128 30609 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:08.500450 30523 leader_election.cc:343] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.517063 30523 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.518846 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.520179 30803 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.518757 30782 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.534049 30841 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.535267 30672 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.535872 30672 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.538267 30672 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.539618 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.540323 30411 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:08.541555 30524 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:08.543021 30672 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.543540 30672 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.544018 30672 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.556918 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.557873 30485 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:08.530434 30609 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.567785 30803 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.568756 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:08.619396 30485 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.574221 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.621093 30560 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.575446 30609 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.577764 30672 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.586011 30602 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.626410 30702 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.627386 30602 ts_tablet_manager.cc:1403] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.163s	user 0.028s	sys 0.029s
I20260709 13:09:08.628515 30672 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.600169 30841 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.630496 30602 raft_consensus.cc:359] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.631165 30602 raft_consensus.cc:385] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.631431 30602 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.632143 30602 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.634081 30602 ts_tablet_manager.cc:1434] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:08.634963 30602 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.636656 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:08.637208 30406 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.641317 30602 tablet_bootstrap.cc:654] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.642380 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:08.644368 30482 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.650429 30602 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.650914 30602 ts_tablet_manager.cc:1403] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:09:08.653688 30602 raft_consensus.cc:359] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.654345 30602 raft_consensus.cc:385] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.654588 30602 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.655648 30782 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.656263 30782 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.661011 30782 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:08.660934 30602 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.662583 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.663196 30602 ts_tablet_manager.cc:1434] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:08.664057 30602 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.664371 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.665390 30483 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:08.664404 30485 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:08.668584 30523 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.670469 30672 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.670996 30374 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.672115 30841 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.672729 30841 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:08.673784 30841 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.679498 30602 tablet_bootstrap.cc:654] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.686928 30558 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.688663 30602 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.689117 30602 ts_tablet_manager.cc:1403] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:09:08.691015 30702 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.691440 30702 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.695188 30702 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.695605 30560 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:08.695721 30602 raft_consensus.cc:359] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.696376 30602 raft_consensus.cc:385] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.688823 30411 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:08.696659 30602 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.698184 30647 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:08.698841 30602 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.700356 30602 ts_tablet_manager.cc:1434] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:08.701162 30602 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.702322 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:08.703655 30374 leader_election.cc:343] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.708879 30647 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.714990 30602 tablet_bootstrap.cc:654] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.533479 30723 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.738933 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:08.739755 30407 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.748121 30483 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.748644 30555 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:08.756431 30669 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:08.758821 30702 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.759534 30702 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.762708 30702 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.765812 30803 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.771503 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:08.785866 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.774142 30723 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:08.774566 30406 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:08.787056 30672 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:08.787480 30702 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:08.857550 30524 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:08.825241 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:08.788755 30803 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.866137 30306 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.788810 30554 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:08.823571 30482 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:08.877120 30717 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.877681 30717 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:08.869839 30560 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:08.885685 30602 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:08.886293 30602 ts_tablet_manager.cc:1403] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.185s	user 0.030s	sys 0.045s
I20260709 13:09:08.878562 30717 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.893663 30407 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:08.896713 30600 tablet_bootstrap.cc:492] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
W20260709 13:09:08.918604 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61128.1us
I20260709 13:09:08.921576 30600 ts_tablet_manager.cc:1403] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.488s	user 0.148s	sys 0.234s
I20260709 13:09:08.923230 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:08.925019 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:08.923801 30782 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:08.928601 30609 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.928514 30782 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.929116 30609 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.929544 30609 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.926106 30450 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:08.936928 30601 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:08.937408 30601 ts_tablet_manager.cc:1403] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.452s	user 0.084s	sys 0.105s
I20260709 13:09:08.936959 30647 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.934232 30602 raft_consensus.cc:359] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.938714 30602 raft_consensus.cc:385] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.938704 30647 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:08.939132 30602 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.937639 30600 raft_consensus.cc:359] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.939545 30600 raft_consensus.cc:385] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.940694 30600 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.940606 30602 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.926403 30664 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:08.940272 30647 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.945757 30602 ts_tablet_manager.cc:1434] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:09:08.947309 30602 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:08.948072 30600 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.948602 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:08.951027 30600 ts_tablet_manager.cc:1434] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:09:08.952447 30600 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:08.946627 30664 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.955183 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:08.958043 30664 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:08.974571 30374 leader_election.cc:343] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:08.980993 30609 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:08.987039 30862 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:09.004313 30601 raft_consensus.cc:359] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.005153 30601 raft_consensus.cc:385] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.005421 30601 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.006100 30601 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.008690 30601 ts_tablet_manager.cc:1434] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:09:09.009583 30601 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:09.011693 30609 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.022384 30600 tablet_bootstrap.cc:654] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.032019 30803 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:09.085386 30602 tablet_bootstrap.cc:654] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.028251 30664 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.109694 30609 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:09.113859 30601 tablet_bootstrap.cc:654] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.115777 30600 tablet_bootstrap.cc:492] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:09.116251 30600 ts_tablet_manager.cc:1403] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.012s
W20260709 13:09:09.111534 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 129958us
I20260709 13:09:09.205174 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:09.205982 30479 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.204463 30841 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.213665 30600 raft_consensus.cc:359] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.214362 30600 raft_consensus.cc:385] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.214727 30600 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.217811 30600 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.257248 30600 ts_tablet_manager.cc:1434] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.141s	user 0.003s	sys 0.003s
I20260709 13:09:09.258404 30600 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:09.215509 30841 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:09.288445 30872 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:09.330286 30841 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.344615 30479 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:09.362907 30602 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:09.363389 30602 ts_tablet_manager.cc:1403] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.416s	user 0.014s	sys 0.009s
I20260709 13:09:09.344928 30704 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.365217 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:09.367360 30480 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.370221 30601 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:09.370625 30601 ts_tablet_manager.cc:1403] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.361s	user 0.024s	sys 0.008s
I20260709 13:09:09.365165 30704 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.374297 30602 raft_consensus.cc:359] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.377435 30602 raft_consensus.cc:385] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.377749 30602 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.379719 30600 tablet_bootstrap.cc:654] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.379813 30602 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.382303 30602 ts_tablet_manager.cc:1434] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.007s
I20260709 13:09:09.383220 30602 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:09.380496 30782 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:09.385421 30479 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:09.388971 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.400621 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.402477 30480 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:09.404966 30704 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.406298 30803 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.406416 30602 tablet_bootstrap.cc:654] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.406879 30803 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.409389 30803 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:09.413172 30601 raft_consensus.cc:359] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.413889 30601 raft_consensus.cc:385] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.414170 30601 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.414904 30601 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:09.415501 30524 leader_election.cc:343] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.417039 30601 ts_tablet_manager.cc:1434] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:09:09.418008 30601 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:09.419562 30451 leader_election.cc:343] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.428690 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.433770 30601 tablet_bootstrap.cc:654] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.437700 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.439940 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.458850 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:09.459610 30554 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.470952 30560 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.477025 30884 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:09.484194 30600 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:09.485018 30600 ts_tablet_manager.cc:1403] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.227s	user 0.011s	sys 0.006s
I20260709 13:09:09.494246 30602 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:09.494910 30602 ts_tablet_manager.cc:1403] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.019s
I20260709 13:09:09.498584 30602 raft_consensus.cc:359] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.499486 30602 raft_consensus.cc:385] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.499822 30602 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.500649 30602 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.729100 30602 ts_tablet_manager.cc:1434] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.234s	user 0.011s	sys 0.002s
I20260709 13:09:09.732470 30602 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:09.741535 30602 tablet_bootstrap.cc:654] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.747264 30602 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:09.747830 30602 ts_tablet_manager.cc:1403] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:09:09.753641 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:09.758324 30884 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.758687 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:09.762825 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:09.775511 30374 leader_election.cc:343] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.759399 30884 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:09.779461 30878 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:09:09.789753 30554 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:09.781114 30884 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:09.791041 30374 leader_election.cc:343] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.793959 30602 raft_consensus.cc:359] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.794811 30602 raft_consensus.cc:385] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.795127 30602 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.795679 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:09.795815 30602 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.799858 30878 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.800467 30878 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:09.801646 30878 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.803242 30602 ts_tablet_manager.cc:1434] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 13:09:09.805832 30602 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:09.814889 30602 tablet_bootstrap.cc:654] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.831198 30882 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.831990 30882 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.834372 30882 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.837152 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:09.839465 30374 leader_election.cc:343] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.845798 30406 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:09.847169 30600 raft_consensus.cc:359] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.855163 30600 raft_consensus.cc:385] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.855523 30600 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.868957 30869 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.854496 30524 leader_election.cc:343] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.873047 30600 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.869746 30869 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.880468 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:09.885296 30862 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.885623 30664 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.885797 30862 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:09.887545 30374 leader_election.cc:343] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.887763 30600 ts_tablet_manager.cc:1434] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.402s	user 0.011s	sys 0.001s
I20260709 13:09:09.892557 30600 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
W20260709 13:09:09.895159 30893 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 13:09:09.897706 30869 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.906510 30865 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:09.907336 30308 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.910458 30647 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:09.916611 30870 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:09.917635 30870 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.922731 30602 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:09.923246 30602 ts_tablet_manager.cc:1403] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.118s	user 0.029s	sys 0.015s
W20260709 13:09:09.952507 30601 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.023s	sys 0.014s
W20260709 13:09:09.953095 30601 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.024s	sys 0.014s
I20260709 13:09:09.959340 30601 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:09.962754 30601 ts_tablet_manager.cc:1403] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.545s	user 0.032s	sys 0.017s
I20260709 13:09:09.970427 30704 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.971074 30870 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:09.970981 30704 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.977998 30602 raft_consensus.cc:359] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:09.990824 30602 raft_consensus.cc:385] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.992129 30602 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
W20260709 13:09:09.998448 30523 leader_election.cc:343] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.998977 30523 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.003108 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.007848 30782 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.980631 30865 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:10.008679 30782 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:10.014063 30704 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.015668 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:10.016532 30560 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.009s
W20260709 13:09:10.017253 30374 leader_election.cc:343] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.017546 30887 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.018105 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 76) took 1128 ms. Trace:
I20260709 13:09:10.018121 30887 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.018626 30309 rpcz_store.cc:276] 0709 13:09:08.889470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.897298 (+  7828us) service_pool.cc:224] Handling call
0709 13:09:10.017883 (+1120585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":927866,"reported_tablets":1}
I20260709 13:09:10.024715 30600 tablet_bootstrap.cc:654] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.025524 30306 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 65) took 1410 ms. Trace:
I20260709 13:09:10.028945 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:10.031301 30450 leader_election.cc:343] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.026779 30862 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.028831 30306 rpcz_store.cc:276] 0709 13:09:08.614793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.614991 (+   198us) service_pool.cc:224] Handling call
0709 13:09:10.025292 (+1410301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:08.876375 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:08.886972 (+ 10597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:08.887009 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:09:08.887032 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:08.888525 (+  1493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:08.888577 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:08.888609 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:08.888787 (+   178us) tablet.cc:701] Row locks acquired
0709 13:09:08.888805 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:08.888934 (+   129us) write_op.cc:270] Start()
0709 13:09:08.889039 (+   105us) write_op.cc:276] Timestamp: P: 1783602548888899 usec, L: 0
0709 13:09:08.889065 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:09:08.889657 (+   592us) log.cc:844] Serialized 537 byte log entry
0709 13:09:08.893992 (+  4335us) op_driver.cc:464] REPLICATION: finished
0709 13:09:08.894454 (+   462us) write_op.cc:301] APPLY: starting
0709 13:09:08.894541 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:08.894664 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:08.894860 (+   196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:08.895058 (+   198us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:08.895261 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:08.895327 (+    66us) write_op.cc:312] APPLY: finished
0709 13:09:08.895510 (+   183us) log.cc:844] Serialized 22 byte log entry
0709 13:09:08.895647 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.895727 (+    80us) write_op.cc:454] Released schema lock
0709 13:09:08.895760 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:08.896009 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.896033 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196934,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":1498,"apply.run_wall_time_us":1530,"num_ops":1,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":2502,"prepare.run_wall_time_us":16411,"replication_time_us":4813}]]}
I20260709 13:09:10.025547 30887 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:10.027262 30602 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.063004 30862 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:10.063928 30862 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.068204 30704 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:10.068643 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.069044 30704 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.072265 30862 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.072454 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.061504 30601 raft_consensus.cc:359] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.079228 30601 raft_consensus.cc:385] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.079993 30601 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.072628 30704 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.083877 30601 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:10.073172 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 101665us
I20260709 13:09:10.087057 30601 ts_tablet_manager.cc:1434] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.124s	user 0.003s	sys 0.006s
I20260709 13:09:10.088408 30601 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:10.082495 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 82087.3us
I20260709 13:09:10.100703 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.101186 30551 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:10.101471 30554 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:10.103399 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:10.104053 30560 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.109639 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:10.099958 30602 ts_tablet_manager.cc:1434] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.002s
I20260709 13:09:10.112145 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.113734 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.114099 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.115839 30887 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:10.117205 30523 leader_election.cc:343] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.117841 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.121064 30906 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.129428 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.133477 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.140327 30602 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:10.142225 30600 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.142747 30600 ts_tablet_manager.cc:1403] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.007s
I20260709 13:09:10.130906 30560 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:10.154547 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.155856 30558 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:10.156322 30878 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.156911 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.157877 30878 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.157812 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.158347 30878 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.158731 30878 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.161216 30376 leader_election.cc:343] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.161885 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.162945 30609 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.163520 30601 tablet_bootstrap.cc:654] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.165076 30376 leader_election.cc:343] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.166627 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.167747 30609 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.172806 30862 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.175122 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.184238 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.185233 30485 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:10.185374 30600 raft_consensus.cc:359] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.186234 30600 raft_consensus.cc:385] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.186563 30600 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.187518 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.187323 30600 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.188853 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.189568 30560 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:10.191890 30878 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.194872 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:10.196625 30374 leader_election.cc:343] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.190536 30602 tablet_bootstrap.cc:654] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.198200 30376 leader_election.cc:343] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.198737 30376 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.210593 30878 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.189059 30600 ts_tablet_manager.cc:1434] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:09:10.213600 30600 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.213740 30308 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 69) took 1346 ms. Trace:
I20260709 13:09:10.214126 30308 rpcz_store.cc:276] 0709 13:09:08.874684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.876261 (+  1577us) service_pool.cc:224] Handling call
0709 13:09:10.213664 (+1337403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:10.111917 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:10.112760 (+   843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:10.112823 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:09:10.112851 (+    28us) tablet.cc:662] Decoding operations
0709 13:09:10.137734 (+ 24883us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:10.143142 (+  5408us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:10.143412 (+   270us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:10.147665 (+  4253us) tablet.cc:701] Row locks acquired
0709 13:09:10.147697 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:09:10.147871 (+   174us) write_op.cc:270] Start()
0709 13:09:10.148823 (+   952us) write_op.cc:276] Timestamp: P: 1783602550147811 usec, L: 0
0709 13:09:10.148876 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:09:10.149700 (+   824us) log.cc:844] Serialized 537 byte log entry
0709 13:09:10.179317 (+ 29617us) op_driver.cc:464] REPLICATION: finished
0709 13:09:10.199273 (+ 19956us) write_op.cc:301] APPLY: starting
0709 13:09:10.199369 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:10.199490 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:10.199660 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:10.199981 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:10.200334 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:10.200431 (+    97us) write_op.cc:312] APPLY: finished
0709 13:09:10.200730 (+   299us) log.cc:844] Serialized 22 byte log entry
0709 13:09:10.200922 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:10.201019 (+    97us) write_op.cc:454] Released schema lock
0709 13:09:10.201081 (+    62us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":472062,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":19611,"num_ops":1,"prepare.queue_time_us":135720,"prepare.run_cpu_time_us":14829,"prepare.run_wall_time_us":75968,"raft.queue_time_us":1259,"raft.run_cpu_time_us":7155,"raft.run_wall_time_us":19750,"replication_time_us":30256,"spinlock_wait_cycles":17792,"thread_start_us":97406,"threads_started":4,"wal-append.queue_time_us":26379}]]}
I20260709 13:09:10.216660 30609 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.217940 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.218966 30609 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.219256 30609 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.219622 30609 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.220918 30306 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 2, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.225857 30609 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.228220 30609 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.235276 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:10.237389 30374 leader_election.cc:343] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.237568 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:10.235244 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 51071.1us
I20260709 13:09:10.239629 30609 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.243399 30309 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.244735 30523 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.246775 30866 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.248210 30866 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.252381 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.253343 30602 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:10.253599 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.255219 30870 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.255877 30870 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.253850 30602 ts_tablet_manager.cc:1403] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.003s
I20260709 13:09:10.256896 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.257899 30874 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.258246 30874 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.258559 30874 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.263314 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:10.264678 30558 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.267294 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:10.267881 30554 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.272487 30558 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:10.273674 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.275418 30609 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.276109 30601 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:10.275882 30609 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.276556 30601 ts_tablet_manager.cc:1403] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.009s
I20260709 13:09:10.278930 30878 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.279310 30609 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.279546 30601 raft_consensus.cc:359] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.279778 30874 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.280902 30602 raft_consensus.cc:359] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.281546 30602 raft_consensus.cc:385] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.281803 30602 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.282369 30602 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.283113 30874 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.284448 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:10.284853 30600 tablet_bootstrap.cc:654] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.285761 30450 leader_election.cc:343] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.287050 30609 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.280212 30601 raft_consensus.cc:385] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.287914 30601 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.288509 30601 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.280234 30878 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:10.289527 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.292588 30602 ts_tablet_manager.cc:1434] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:09:10.292886 30554 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:10.293617 30602 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:10.298309 30601 ts_tablet_manager.cc:1434] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:09:10.299331 30601 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:10.299285 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.290587 30878 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.312515 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:10.313129 30558 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.314735 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.317699 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.318588 30609 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.318940 30869 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.319293 30609 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.320665 30664 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.321178 30664 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:10.322492 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.322021 30664 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:10.323679 30374 leader_election.cc:343] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.324371 30609 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.329170 30306 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.377138 30558 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:10.381094 30602 tablet_bootstrap.cc:654] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.382490 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 57295.5us
I20260709 13:09:10.389207 30600 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.389649 30600 ts_tablet_manager.cc:1403] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.003s
I20260709 13:09:10.391987 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.392928 30601 tablet_bootstrap.cc:654] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.394111 30874 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.394600 30874 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:10.395393 30874 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.399040 30609 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.405375 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.409404 30647 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.410009 30647 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.412513 30647 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:10.417161 30376 leader_election.cc:343] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.417660 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.391057 30306 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.416569 30600 raft_consensus.cc:359] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.419262 30600 raft_consensus.cc:385] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.419536 30884 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.419629 30600 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.420601 30600 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.416234 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.434454 30600 ts_tablet_manager.cc:1434] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:09:10.439348 30601 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:10.439961 30601 ts_tablet_manager.cc:1403] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.020s
I20260709 13:09:10.451933 30600 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.447396 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:10.451433 30450 leader_election.cc:343] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.456799 30558 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:10.460232 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.474049 30601 raft_consensus.cc:359] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.478842 30601 raft_consensus.cc:385] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.479158 30601 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.492815 30600 tablet_bootstrap.cc:654] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.479732 30874 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.495409 30874 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.495889 30874 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.499213 30306 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.501811 30404 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.504307 30647 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:10.504828 30647 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.506676 30647 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.511530 30925 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.515774 30306 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.517060 30601 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.526165 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.525804 30601 ts_tablet_manager.cc:1434] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.004s
I20260709 13:09:10.529367 30309 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.531816 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.534096 30450 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.535254 30602 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:10.535411 30647 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.535699 30602 ts_tablet_manager.cc:1403] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.242s	user 0.032s	sys 0.034s
I20260709 13:09:10.536471 30601 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:10.538650 30878 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.538357 30602 raft_consensus.cc:359] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.539324 30602 raft_consensus.cc:385] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.539604 30602 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.540222 30602 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.542939 30602 ts_tablet_manager.cc:1434] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:10.543928 30602 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
W20260709 13:09:10.546876 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080003d2c0 after lost signal to thread 29283
W20260709 13:09:10.547981 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08000389a0 after lost signal to thread 30343
W20260709 13:09:10.549216 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080027cc80 after lost signal to thread 30435
I20260709 13:09:10.549743 30602 tablet_bootstrap.cc:654] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.550308 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080027c480 after lost signal to thread 30510
W20260709 13:09:10.551477 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8220 after lost signal to thread 30584
I20260709 13:09:10.559600 30874 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.562567 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:10.564390 30450 leader_election.cc:343] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.565892 30600 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.566525 30600 ts_tablet_manager.cc:1403] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.003s
I20260709 13:09:10.570631 30874 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.571224 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:10.571913 30560 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.577369 30600 raft_consensus.cc:359] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.578110 30600 raft_consensus.cc:385] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.578366 30600 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.579082 30600 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.581113 30600 ts_tablet_manager.cc:1434] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:10.581986 30600 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.586284 30601 tablet_bootstrap.cc:654] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.593375 30560 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:10.595180 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:10.595954 30874 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.596412 30874 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:10.597962 30874 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.610967 30602 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:10.611469 30602 ts_tablet_manager.cc:1403] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.023s
I20260709 13:09:10.612915 30600 tablet_bootstrap.cc:654] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.614588 30602 raft_consensus.cc:359] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.615322 30601 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:10.615321 30602 raft_consensus.cc:385] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.615792 30602 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.616518 30602 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.627691 30602 ts_tablet_manager.cc:1434] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:10.628342 30601 ts_tablet_manager.cc:1403] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.007s
I20260709 13:09:10.631685 30602 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:10.638065 30601 raft_consensus.cc:359] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.638805 30601 raft_consensus.cc:385] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.639086 30601 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.639756 30601 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.641849 30601 ts_tablet_manager.cc:1434] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:10.642627 30600 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.643098 30600 ts_tablet_manager.cc:1403] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.003s
I20260709 13:09:10.643251 30601 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:10.649051 30602 tablet_bootstrap.cc:654] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.649384 30601 tablet_bootstrap.cc:654] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.645620 30600 raft_consensus.cc:359] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.651212 30600 raft_consensus.cc:385] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.651496 30600 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.652098 30600 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.653924 30600 ts_tablet_manager.cc:1434] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:09:10.654817 30600 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.662623 30600 tablet_bootstrap.cc:654] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.670302 30306 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.671448 30866 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.672115 30866 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.676690 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.676949 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.677626 30404 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
W20260709 13:09:10.678620 30523 leader_election.cc:343] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.679404 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.680506 30804 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.680948 30804 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.681335 30804 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.686863 30866 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:10.687577 30602 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:10.688002 30602 ts_tablet_manager.cc:1403] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.007s
I20260709 13:09:10.693595 30804 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.696748 30804 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:10.698390 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:10.698621 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:10.705077 30404 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.705760 30523 leader_election.cc:343] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.713764 30600 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.714995 30478 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.717118 30600 ts_tablet_manager.cc:1403] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.000s
I20260709 13:09:10.715965 30404 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:10.716539 30601 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:10.719056 30601 ts_tablet_manager.cc:1403] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.006s
I20260709 13:09:10.719532 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.720924 30906 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.721743 30906 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:10.722883 30601 raft_consensus.cc:359] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.722833 30906 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.723615 30601 raft_consensus.cc:385] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.723968 30601 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.729723 30601 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.731418 30664 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.731818 30601 ts_tablet_manager.cc:1434] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:10.732836 30601 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:10.718528 30602 raft_consensus.cc:359] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.736841 30602 raft_consensus.cc:385] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.737121 30602 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.737751 30602 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.739786 30602 ts_tablet_manager.cc:1434] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:09:10.728652 30600 raft_consensus.cc:359] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.740157 30600 raft_consensus.cc:385] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.740513 30600 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.741081 30600 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.742522 30600 ts_tablet_manager.cc:1434] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.000s
I20260709 13:09:10.743505 30600 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.749574 30600 tablet_bootstrap.cc:654] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.753127 30601 tablet_bootstrap.cc:654] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.766922 30602 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:10.771378 30306 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.777575 30862 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.778259 30862 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.779693 30664 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.781769 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:10.783342 30450 leader_election.cc:343] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.784245 30600 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:10.786671 30647 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.787334 30647 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.876967 30600 ts_tablet_manager.cc:1403] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.015s
I20260709 13:09:10.793354 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.881021 30647 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.882172 30601 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:10.882606 30874 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.883249 30874 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.885782 30874 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.882645 30601 ts_tablet_manager.cc:1403] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.150s	user 0.030s	sys 0.012s
W20260709 13:09:10.890542 30451 leader_election.cc:343] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.891273 30601 raft_consensus.cc:359] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.912809 30601 raft_consensus.cc:385] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.913101 30601 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.913730 30601 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.915457 30601 ts_tablet_manager.cc:1434] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:10.916199 30601 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:10.919911 30869 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.920480 30869 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.922897 30869 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.892737 30600 raft_consensus.cc:359] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.902276 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.923764 30600 raft_consensus.cc:385] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.924047 30600 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.924209 30560 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:10.924974 30600 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:10.904685 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 118152us
I20260709 13:09:10.927242 30600 ts_tablet_manager.cc:1434] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:09:10.928149 30600 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:10.928534 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:10.931254 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:10.907269 30944 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:09:10.911325 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.935158 30862 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:10.923475 30601 tablet_bootstrap.cc:654] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.933528 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 150235us
I20260709 13:09:10.935000 30874 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.944036 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.947325 30602 tablet_bootstrap.cc:654] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.951633 30376 leader_election.cc:343] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.951659 30882 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.953712 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.956483 30882 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.957039 30882 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:10.960831 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:10.961982 30404 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:10.967687 30882 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:10.971073 30374 leader_election.cc:343] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.971504 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:10.981253 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:10.982151 30560 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:10.982411 30878 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:10.990072 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55666.7us
W20260709 13:09:10.993194 30451 leader_election.cc:343] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.030248 30480 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.035204 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.006807 30904 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.079214 30647 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.056779 30904 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.096045 30878 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.096630 30878 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.088657 30804 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.097846 30804 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.101629 30904 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.101840 30804 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.113724 30647 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:11.105818 30878 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.142141 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.142413 30948 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.142488 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.143079 30948 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.103108 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:11.150009 30523 leader_election.cc:343] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.133533 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.168787 30404 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:11.169015 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.170261 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.170620 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.170876 30407 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:11.174137 30600 tablet_bootstrap.cc:654] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.175446 30524 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:11.176983 30523 leader_election.cc:343] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.183037 30925 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.145771 30948 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.191589 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:11.205451 30866 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:11.210779 30523 leader_election.cc:343] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.245256 30866 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.246227 30948 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.253072 30450 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:11.266348 30601 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:11.266930 30601 ts_tablet_manager.cc:1403] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.351s	user 0.016s	sys 0.009s
I20260709 13:09:11.264503 30948 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:11.266774 30524 leader_election.cc:343] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.269156 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.255838 30866 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.296085 30601 raft_consensus.cc:359] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.296681 30601 raft_consensus.cc:385] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.296931 30601 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
W20260709 13:09:11.298305 30523 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.299832 30804 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.312105 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.317426 30925 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:11.324514 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 235954us
I20260709 13:09:11.327682 30601 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.338267 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:11.300020 30948 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.355612 30647 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.355942 30647 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.356218 30647 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.358453 30601 ts_tablet_manager.cc:1434] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 13:09:11.359586 30601 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:11.362398 30523 leader_election.cc:343] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.367228 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 100505us
I20260709 13:09:11.367802 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.369998 30647 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.371235 30948 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.375175 30647 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.377362 30948 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:11.372893 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65108us
I20260709 13:09:11.391477 30647 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.391983 30647 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.386620 30948 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.407758 30647 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.388295 30954 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.389693 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:11.413901 30600 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:11.414363 30600 ts_tablet_manager.cc:1403] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.486s	user 0.012s	sys 0.011s
I20260709 13:09:11.421016 30600 raft_consensus.cc:359] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.421504 30600 raft_consensus.cc:385] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.422971 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.424657 30600 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.423419 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:11.427994 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.428543 30602 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:11.428995 30602 ts_tablet_manager.cc:1403] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.662s	user 0.026s	sys 0.036s
W20260709 13:09:11.434962 30451 leader_election.cc:343] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.435631 30451 leader_election.cc:343] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.437122 30958 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:11.439113 30524 leader_election.cc:343] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.439512 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.440501 30958 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.443784 30878 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.443985 30602 raft_consensus.cc:359] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.444643 30602 raft_consensus.cc:385] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.444931 30602 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.445760 30602 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.426167 30600 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.450273 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:11.464720 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:11.464979 30948 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.471072 30602 ts_tablet_manager.cc:1434] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:09:11.472086 30602 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:11.479626 30602 tablet_bootstrap.cc:654] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.482244 30600 ts_tablet_manager.cc:1434] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:09:11.485908 30866 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.490862 30551 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:11.494530 30601 tablet_bootstrap.cc:654] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.496608 30600 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:11.510952 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:11.511792 30404 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.514916 30959 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.515452 30959 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.537297 30866 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.544008 30959 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:11.518373 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 89534.3us
I20260709 13:09:11.551865 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:11.552488 30403 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.552582 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:11.551695 30862 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.553247 30551 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:11.568181 30948 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.568627 30600 tablet_bootstrap.cc:654] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.571719 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:11.572750 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:11.573958 30959 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.574297 30959 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.574608 30959 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.575800 30523 leader_election.cc:343] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.571655 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:11.581722 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.588815 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:11.590977 30411 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.595799 30523 leader_election.cc:343] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.595834 30404 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:11.598426 30601 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:11.598462 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.598915 30601 ts_tablet_manager.cc:1403] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.013s
I20260709 13:09:11.600508 30524 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.604887 30403 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:11.612587 30804 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:11.623178 30450 leader_election.cc:343] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.623517 30411 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:11.623726 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:11.624598 30954 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:11.628963 30450 leader_election.cc:343] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.626669 30959 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.629971 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:09:11.601593 30374 leader_election.cc:343] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.630831 30602 tablet_bootstrap.cc:492] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:11.632370 30804 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:11.640551 30374 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.641337 30878 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.640564 30954 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.640786 30602 ts_tablet_manager.cc:1403] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.006s
I20260709 13:09:11.641251 30804 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.636373 30601 raft_consensus.cc:359] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.633195 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.647249 30601 raft_consensus.cc:385] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.647656 30601 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.648458 30601 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.650871 30960 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.656389 30960 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:11.657473 30960 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.642970 30954 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:11.658146 30601 ts_tablet_manager.cc:1434] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:09:11.660151 30602 raft_consensus.cc:359] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.661118 30602 raft_consensus.cc:385] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.661393 30602 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.662073 30602 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.661620 30954 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.668433 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:11.669669 30602 ts_tablet_manager.cc:1434] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:09:11.670951 30601 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
W20260709 13:09:11.675213 30450 leader_election.cc:343] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.683190 30600 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:11.683548 30600 ts_tablet_manager.cc:1403] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.004s
I20260709 13:09:11.694402 30600 raft_consensus.cc:359] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.694394 30866 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.696363 30602 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:11.699569 30308 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.708389 30600 raft_consensus.cc:385] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.713742 30600 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.707863 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:11.715219 30555 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.714928 30866 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.714385 30600 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.721616 30878 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.722095 30878 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.723764 30878 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.724635 30555 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:11.724892 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:11.725208 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.725792 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:11.727342 30647 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.727833 30647 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:11.695730 30959 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.726387 30552 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:11.728245 30480 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:11.728543 30647 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.735096 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:11.737700 30925 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.738075 30925 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.738320 30925 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.738340 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:11.739291 30600 ts_tablet_manager.cc:1434] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.004s
W20260709 13:09:11.741739 30524 leader_election.cc:343] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.749161 30925 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.751065 30600 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:11.752518 30601 tablet_bootstrap.cc:654] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.755954 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:11.757869 30523 leader_election.cc:343] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.758239 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:11.755146 30866 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:11.759979 30905 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.760720 30925 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.763510 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:11.764725 30306 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.770293 30552 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.766052 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:11.771173 30647 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.770569 30306 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.772310 30480 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.771592 30647 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.768980 30602 tablet_bootstrap.cc:654] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.773942 30647 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.775605 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:11.777575 30451 leader_election.cc:343] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.778369 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:11.779657 30450 leader_election.cc:343] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.780079 30450 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:11.780819 30959 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.781468 30552 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:11.782415 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:11.786648 30878 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.787171 30878 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:11.788000 30878 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.790259 30600 tablet_bootstrap.cc:654] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.804643 30601 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:11.805248 30601 ts_tablet_manager.cc:1403] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.003s
I20260709 13:09:11.817591 30480 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:11.836774 30600 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:11.867137 30600 ts_tablet_manager.cc:1403] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.006s
I20260709 13:09:11.867952 30602 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:11.868554 30602 ts_tablet_manager.cc:1403] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.182s	user 0.018s	sys 0.030s
I20260709 13:09:11.871003 30600 raft_consensus.cc:359] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.871955 30600 raft_consensus.cc:385] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.871627 30602 raft_consensus.cc:359] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.872403 30600 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.872736 30602 raft_consensus.cc:385] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.873208 30602 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.831435 30601 raft_consensus.cc:359] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.874135 30601 raft_consensus.cc:385] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.874531 30601 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.874235 30602 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.875432 30601 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.876777 30600 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.877475 30602 ts_tablet_manager.cc:1434] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:11.878753 30602 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:11.878944 30601 ts_tablet_manager.cc:1434] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:09:11.880203 30601 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:11.887563 30602 tablet_bootstrap.cc:654] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.889897 30600 ts_tablet_manager.cc:1434] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:09:11.892781 30600 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:11.907142 30601 tablet_bootstrap.cc:654] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.908102 30411 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.940961 30925 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.941121 30600 tablet_bootstrap.cc:654] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.941679 30925 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.945613 30925 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:11.947914 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:11.948565 30481 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:11.949422 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:11.949983 30555 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:11.951872 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:11.953166 30600 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:11.953778 30600 ts_tablet_manager.cc:1403] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.009s
I20260709 13:09:11.957098 30969 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.957485 30969 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.957790 30600 raft_consensus.cc:359] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.958756 30600 raft_consensus.cc:385] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.960446 30601 tablet_bootstrap.cc:492] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:11.961390 30600 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.961958 30601 ts_tablet_manager.cc:1403] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.007s
I20260709 13:09:11.962843 30600 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.957839 30969 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.970978 30600 ts_tablet_manager.cc:1434] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:09:11.979804 30601 raft_consensus.cc:359] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.980547 30601 raft_consensus.cc:385] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.980835 30601 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.981566 30601 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.984935 30600 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:11.992286 30601 ts_tablet_manager.cc:1434] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:09:11.997571 30969 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:11.999877 30309 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.006117 30600 tablet_bootstrap.cc:654] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.012979 30602 tablet_bootstrap.cc:492] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.013523 30602 ts_tablet_manager.cc:1403] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.135s	user 0.035s	sys 0.039s
I20260709 13:09:12.016644 30602 raft_consensus.cc:359] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.017310 30602 raft_consensus.cc:385] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.017546 30602 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.018124 30602 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.019484 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:12.042203 30480 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.029584 30948 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.045053 30948 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.048990 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:12.051642 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.051939 30480 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:12.052429 30411 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:12.020947 30969 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.021250 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:12.030213 30647 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.053241 30555 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.053282 30647 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.055256 30647 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.022156 30601 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.022678 30308 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.056389 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.054965 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:12.057492 30969 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.057530 30866 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.058187 30969 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:12.058991 30969 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:12.060619 30512 tablet.cc:2406] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:12.063642 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.067420 30602 ts_tablet_manager.cc:1434] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.003s
I20260709 13:09:12.068499 30602 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.070206 30601 tablet_bootstrap.cc:654] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.073288 30523 consensus_peers.cc:597] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.074663 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.076152 30866 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.076835 30948 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:12.076972 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:12.077970 30959 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.084611 30484 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.093724 30601 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:12.094235 30601 ts_tablet_manager.cc:1403] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.006s
I20260709 13:09:12.100150 30555 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:12.101852 30601 raft_consensus.cc:359] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.102425 30602 tablet_bootstrap.cc:654] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.102519 30601 raft_consensus.cc:385] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.108747 30600 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:12.113495 30600 ts_tablet_manager.cc:1403] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.129s	user 0.018s	sys 0.013s
I20260709 13:09:12.112123 30308 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.116220 30600 raft_consensus.cc:359] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.117055 30600 raft_consensus.cc:385] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.117372 30600 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.118098 30600 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.118767 30601 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.119843 30601 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.121965 30601 ts_tablet_manager.cc:1434] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:12.122650 30965 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.124717 30601 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.130342 30866 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.138878 30600 ts_tablet_manager.cc:1434] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:12.142607 30600 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:12.166393 30601 tablet_bootstrap.cc:654] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.169018 30602 tablet_bootstrap.cc:492] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.169507 30602 ts_tablet_manager.cc:1403] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.010s
I20260709 13:09:12.176586 30954 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.180629 30600 tablet_bootstrap.cc:654] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.181562 30925 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.185760 30602 raft_consensus.cc:359] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.186477 30602 raft_consensus.cc:385] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.186839 30602 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.189924 30602 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.194952 30601 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
W20260709 13:09:12.195256 30523 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:12.195400 30601 ts_tablet_manager.cc:1403] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 13:09:12.195674 30948 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.200009 30601 raft_consensus.cc:359] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.200639 30601 raft_consensus.cc:385] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.200922 30969 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.200899 30601 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.202762 30600 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:12.203223 30600 ts_tablet_manager.cc:1403] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.003s
I20260709 13:09:12.203250 30601 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.205426 30601 ts_tablet_manager.cc:1434] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:12.205869 30600 raft_consensus.cc:359] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.206326 30601 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.206514 30600 raft_consensus.cc:385] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.206821 30600 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.200963 30602 ts_tablet_manager.cc:1434] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:09:12.208570 30602 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.215025 30600 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.220438 30600 ts_tablet_manager.cc:1434] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:12.221450 30600 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:12.224267 30602 tablet_bootstrap.cc:654] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.230468 30601 tablet_bootstrap.cc:654] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.232476 30600 tablet_bootstrap.cc:654] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.240674 30602 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.243181 30602 ts_tablet_manager.cc:1403] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 13:09:12.245908 30602 raft_consensus.cc:359] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.246562 30602 raft_consensus.cc:385] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.249738 30602 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.253839 30954 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.254326 30954 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.255421 30602 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.256659 30954 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.258909 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.260185 30551 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:12.261049 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.261688 30411 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:12.262817 30450 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.269759 30602 ts_tablet_manager.cc:1434] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:09:12.271582 30602 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.268648 30954 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.278957 30969 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.290025 30969 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.287635 30954 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.292148 30969 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.292538 30954 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.293548 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:12.302409 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.306573 30552 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:12.308128 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:12.312196 30969 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.313908 30600 tablet_bootstrap.cc:492] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:12.314364 30600 ts_tablet_manager.cc:1403] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:09:12.316525 30601 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:12.316556 30862 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.317085 30601 ts_tablet_manager.cc:1403] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.111s	user 0.027s	sys 0.010s
I20260709 13:09:12.318547 30602 tablet_bootstrap.cc:654] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.320827 30601 raft_consensus.cc:359] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.321484 30601 raft_consensus.cc:385] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.321748 30601 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.322144 30600 raft_consensus.cc:359] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.322350 30601 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.322808 30600 raft_consensus.cc:385] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.323467 30600 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.324441 30601 ts_tablet_manager.cc:1434] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:12.325590 30601 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.332969 30600 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.343588 30969 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.344237 30600 ts_tablet_manager.cc:1434] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:09:12.347323 30600 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:12.356400 30647 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.355631 30862 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.357472 30862 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.364691 30601 tablet_bootstrap.cc:654] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.359316 30954 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.370085 30602 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.371201 30602 ts_tablet_manager.cc:1403] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.008s
I20260709 13:09:12.371275 30954 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.372277 30600 tablet_bootstrap.cc:654] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.373548 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:12.373653 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:12.374230 30402 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.377400 30647 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.377839 30647 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.379864 30647 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.374182 30552 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.380270 30862 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.385622 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.388530 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.388531 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:12.390547 30451 leader_election.cc:343] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.393792 30600 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:12.394251 30600 ts_tablet_manager.cc:1403] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.014s
I20260709 13:09:12.394444 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:12.395531 30647 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.397292 30602 raft_consensus.cc:359] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.398115 30602 raft_consensus.cc:385] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.398555 30602 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.398798 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.399428 30408 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 0.
I20260709 13:09:12.400534 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:12.401013 30601 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:12.401470 30601 ts_tablet_manager.cc:1403] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.009s
I20260709 13:09:12.399575 30602 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.404654 30602 ts_tablet_manager.cc:1434] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:09:12.404543 30601 raft_consensus.cc:359] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.405251 30601 raft_consensus.cc:385] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.405519 30601 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.397152 30600 raft_consensus.cc:359] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.406680 30600 raft_consensus.cc:385] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.406165 30601 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.407002 30600 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.401845 30954 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.408939 30954 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.409267 30954 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.414963 30600 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.407091 30402 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:12.427137 30601 ts_tablet_manager.cc:1434] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:09:12.429883 30450 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.440089 30602 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.441584 30959 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.442076 30959 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:12.442867 30959 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.449402 30601 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.450726 30954 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.453534 30600 ts_tablet_manager.cc:1434] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.008s
I20260709 13:09:12.461540 30954 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.463181 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:12.466096 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:12.466933 30408 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.474396 30600 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
W20260709 13:09:12.481335 30451 leader_election.cc:343] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.484802 30647 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.485271 30647 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.488780 30647 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.474116 30552 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:12.493953 30484 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.497466 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.500129 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.505894 30450 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:12.518404 30309 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.511762 30948 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.534756 30601 tablet_bootstrap.cc:654] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.511226 30905 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.525640 30948 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.543874 30905 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.558809 30862 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.562107 30948 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:12.571945 30602 tablet_bootstrap.cc:654] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.579641 30408 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:12.580129 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.581225 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:12.582435 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:09:12.582947 30524 leader_election.cc:343] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.583518 30965 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.584926 30905 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:12.585047 30965 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:12.587085 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.587131 30965 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.585433 30882 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:09:12.594120 30523 leader_election.cc:343] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.594686 30523 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:12.596076 30524 leader_election.cc:343] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.596500 30600 tablet_bootstrap.cc:654] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.597718 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:12.599436 30523 leader_election.cc:343] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.599879 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:12.601297 30905 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.598731 30866 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.616852 30601 tablet_bootstrap.cc:492] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:12.617549 30601 ts_tablet_manager.cc:1403] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.190s	user 0.022s	sys 0.013s
I20260709 13:09:12.620750 30481 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.633049 30602 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.633585 30602 ts_tablet_manager.cc:1403] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.003s
I20260709 13:09:12.638877 30601 raft_consensus.cc:359] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.636098 30602 raft_consensus.cc:359] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.642848 30601 raft_consensus.cc:385] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.643052 30602 raft_consensus.cc:385] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.643146 30601 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.643471 30602 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.644188 30602 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.646569 30602 ts_tablet_manager.cc:1434] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:12.647550 30602 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.647538 30601 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.649672 30601 ts_tablet_manager.cc:1434] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:12.655814 30309 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:12.658574 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:12.663789 30878 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.664278 30878 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.669344 30601 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.658234 30600 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:12.670171 30600 ts_tablet_manager.cc:1403] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.010s
I20260709 13:09:12.668498 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:12.671590 30480 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:12.671799 30925 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.673126 30878 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.674522 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.677352 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:12.678642 30376 leader_election.cc:343] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.681329 30600 raft_consensus.cc:359] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.682273 30600 raft_consensus.cc:385] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.682574 30600 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.683272 30600 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.680183 30878 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.684096 30878 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.684440 30878 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.685263 30600 ts_tablet_manager.cc:1434] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:12.686210 30600 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:12.698765 30601 tablet_bootstrap.cc:654] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.706781 30969 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.707264 30969 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.709167 30969 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.709619 30969 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.710016 30969 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.713454 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.714049 30555 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:12.714268 30602 tablet_bootstrap.cc:654] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.717730 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:12.720742 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:12.720801 30374 leader_election.cc:343] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.721201 30484 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:12.723826 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.731593 30926 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.731978 30926 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.732275 30926 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.743052 30969 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.759585 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:12.772413 30969 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.789917 30969 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.799225 30969 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.813907 30926 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.835752 30878 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.840477 30878 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.841074 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:12.841683 30480 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.825734 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:12.852990 30602 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:12.853453 30602 ts_tablet_manager.cc:1403] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.206s	user 0.009s	sys 0.022s
I20260709 13:09:12.856598 30552 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
W20260709 13:09:12.857618 31025 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:12.859824 30600 tablet_bootstrap.cc:654] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.860631 30601 tablet_bootstrap.cc:492] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:12.861078 30601 ts_tablet_manager.cc:1403] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.020s
I20260709 13:09:12.874428 30601 raft_consensus.cc:359] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.875097 30601 raft_consensus.cc:385] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.875353 30601 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.879840 30926 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.880656 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:12.881271 30481 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.882860 30602 raft_consensus.cc:359] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.883525 30602 raft_consensus.cc:385] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.883796 30602 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.884425 30602 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.885906 30954 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.885915 31027 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.891476 31027 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.893443 31027 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:12.895346 30602 ts_tablet_manager.cc:1434] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:09:12.896227 30601 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.898376 30601 ts_tablet_manager.cc:1434] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 13:09:12.903456 30601 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:12.904140 30602 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:12.906090 30481 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:12.867465 31037 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.932529 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.933465 30965 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.937345 30965 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.939430 30965 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.940634 30878 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.941148 30878 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:12.941933 30878 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:12.943920 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:12.944509 30555 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.947858 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:12.950449 30969 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:12.951756 30450 leader_election.cc:343] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.952533 30969 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:12.953543 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:12.954025 31037 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:12.955384 30374 leader_election.cc:343] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.957520 31037 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:12.922885 30480 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:12.959621 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:12.971576 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:12.972210 30560 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.976958 30602 tablet_bootstrap.cc:654] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.981544 30560 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:12.974172 30969 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.005468 30601 tablet_bootstrap.cc:654] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.007593 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:13.009886 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:13.010746 30404 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:13.011361 30969 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:13.012240 30969 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.013015 30600 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:13.013453 30600 ts_tablet_manager.cc:1403] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.327s	user 0.012s	sys 0.018s
I20260709 13:09:13.015269 31033 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.015758 31033 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.031701 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.017203 30555 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:13.059379 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:13.051276 30926 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.060730 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:13.068256 31033 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.063273 31039 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.058890 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.076515 30478 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:13.073313 30926 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.085067 30926 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.090333 30523 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:13.098918 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.100230 30602 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:13.100836 30602 ts_tablet_manager.cc:1403] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.197s	user 0.023s	sys 0.011s
I20260709 13:09:13.103717 30600 raft_consensus.cc:359] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.104380 30600 raft_consensus.cc:385] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.104647 30600 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.074443 30560 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.105990 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 57245.4us
I20260709 13:09:13.107131 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.109905 31037 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.112257 30600 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:13.112655 30374 leader_election.cc:343] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.114735 30451 leader_election.cc:343] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.115129 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:13.101630 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.118857 30480 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:13.117254 30954 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.125229 30600 ts_tablet_manager.cc:1434] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.002s
W20260709 13:09:13.120133 31041 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:13.127628 31039 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.135241 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.135922 30556 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:13.118012 31017 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:13.140789 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.143918 30601 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:13.144485 30601 ts_tablet_manager.cc:1403] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.006s
I20260709 13:09:13.145675 30600 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:13.136134 30309 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.139360 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:13.148322 30862 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.149673 30882 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.150111 30882 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.150524 30882 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.151630 30560 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
W20260709 13:09:13.193572 30376 leader_election.cc:343] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.194036 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:13.202396 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:13.202060 30602 raft_consensus.cc:359] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.203044 30602 raft_consensus.cc:385] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.203641 30602 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.211176 31045 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.214354 30926 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.214835 30926 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:09:13.215474 31042 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:13.215296 30601 raft_consensus.cc:359] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.216029 30601 raft_consensus.cc:385] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.215674 30926 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.216297 30601 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.216885 30601 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.220011 30602 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.223922 30601 ts_tablet_manager.cc:1434] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.079s	user 0.002s	sys 0.004s
I20260709 13:09:13.225169 30601 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Bootstrap starting.
I20260709 13:09:13.238536 30602 ts_tablet_manager.cc:1434] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.137s	user 0.008s	sys 0.000s
I20260709 13:09:13.241165 30602 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:13.250841 30601 tablet_bootstrap.cc:654] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.259351 30862 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.265443 30882 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:13.290753 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 51804.1us
I20260709 13:09:13.266834 31027 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.295766 31027 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.337363 30602 tablet_bootstrap.cc:654] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.325140 30600 tablet_bootstrap.cc:654] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.339514 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:13.335048 30882 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.333760 31033 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.334801 31027 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:13.395947 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:13.396541 30485 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.379151 31033 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.402980 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.403981 30477 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:13.413712 30411 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:13.417485 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:13.427321 31035 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.427795 31035 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.428170 31035 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.428985 31033 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.430084 31038 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.430578 31038 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.433743 31038 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:13.445837 30485 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
W20260709 13:09:13.448886 31054 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:13.449072 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:13.454142 30601 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: No bootstrap required, opened a new log
I20260709 13:09:13.454630 30601 ts_tablet_manager.cc:1403] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent bootstrapping tablet: real 0.230s	user 0.020s	sys 0.016s
W20260709 13:09:13.475853 30524 leader_election.cc:343] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.482252 30602 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:13.482758 30602 ts_tablet_manager.cc:1403] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.242s	user 0.026s	sys 0.001s
I20260709 13:09:13.483958 31035 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.573735 31035 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:13.594233 30600 tablet_bootstrap.cc:492] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:13.594848 30600 ts_tablet_manager.cc:1403] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.449s	user 0.029s	sys 0.027s
I20260709 13:09:13.606611 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.603044 30602 raft_consensus.cc:359] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.609828 30602 raft_consensus.cc:385] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.610145 30602 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.611053 30602 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.611145 30601 raft_consensus.cc:359] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.611935 30601 raft_consensus.cc:385] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.612246 30601 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.613008 30601 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.615772 30601 ts_tablet_manager.cc:1434] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent starting tablet: real 0.161s	user 0.004s	sys 0.003s
I20260709 13:09:13.612633 30602 ts_tablet_manager.cc:1434] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.000s
I20260709 13:09:13.620343 30602 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Bootstrap starting.
I20260709 13:09:13.624843 30600 raft_consensus.cc:359] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.625593 30600 raft_consensus.cc:385] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.625865 30600 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.626542 30600 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.628646 30600 ts_tablet_manager.cc:1434] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:09:13.628722 30602 tablet_bootstrap.cc:654] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.648800 30602 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: No bootstrap required, opened a new log
I20260709 13:09:13.649290 30602 ts_tablet_manager.cc:1403] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:09:13.653869 30602 raft_consensus.cc:359] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.654577 30602 raft_consensus.cc:385] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.654897 30602 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.655576 30602 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.657159 30602 ts_tablet_manager.cc:1434] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:13.703794 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:13.704495 30479 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.711748 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.712220 30479 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:13.712616 30558 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:13.719564 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:13.720242 30552 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.729009 30552 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:13.794255 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:13.794939 30408 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.796691 30926 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.800556 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:13.801344 30882 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.801855 30882 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:13.802712 30882 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.804641 30600 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:13.812860 30408 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:13.818148 31045 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.845629 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:13.846374 30482 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 1: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:09:13.884820 30523 leader_election.cc:343] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.885336 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:13.888643 31027 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.892917 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:13.893733 31027 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.894243 31027 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:13.895182 31027 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.906687 30600 tablet_bootstrap.cc:654] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.911372 31045 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.913400 31045 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.959502 30959 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.960166 30959 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.962088 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.962822 30558 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:13.967087 30959 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:13.968647 30600 tablet_bootstrap.cc:492] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:13.969165 30600 ts_tablet_manager.cc:1403] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.011s
I20260709 13:09:13.973330 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:13.974201 30552 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 1: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:13.976269 30600 raft_consensus.cc:359] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.977001 30600 raft_consensus.cc:385] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.977350 30600 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.978119 30600 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:13.980305 30600 ts_tablet_manager.cc:1434] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:13.981241 30600 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:13.989351 30600 tablet_bootstrap.cc:654] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.000834 31031 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.001317 30600 tablet_bootstrap.cc:492] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:14.001906 30600 ts_tablet_manager.cc:1403] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:09:14.004891 30600 raft_consensus.cc:359] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.005676 30600 raft_consensus.cc:385] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.005076 30307 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.005987 30600 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.001398 31031 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:14.006767 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55897.3us
I20260709 13:09:14.008836 31031 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:14.009663 30600 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.011410 30600 ts_tablet_manager.cc:1434] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 13:09:14.012413 30600 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Bootstrap starting.
I20260709 13:09:14.018518 30600 tablet_bootstrap.cc:654] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.023316 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:14.024199 31044 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.032083 30482 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.032378 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:14.033107 30477 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:14.037529 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:14.038216 30406 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:14.045559 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.047312 31031 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.047716 31031 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.048127 31031 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.047603 30307 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.057027 31031 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.062665 31044 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.065065 31026 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.068557 31044 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.069193 31044 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.072355 31044 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:14.073450 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:14.073886 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:14.074501 30408 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.078732 31026 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.084043 30408 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:14.086552 31031 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:14.094746 30600 tablet_bootstrap.cc:492] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: No bootstrap required, opened a new log
I20260709 13:09:14.095369 30600 ts_tablet_manager.cc:1403] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.012s
I20260709 13:09:14.094882 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.097766 31026 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.098232 31026 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.098727 30600 raft_consensus.cc:359] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.099502 30600 raft_consensus.cc:385] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.099797 30600 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.100302 30882 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.100454 30600 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.098753 31026 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.102206 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.103093 31035 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.103790 31035 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:14.104904 31035 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.105495 30600 ts_tablet_manager.cc:1434] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:14.112844 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:14.113595 30484 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 0.
I20260709 13:09:14.120646 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:14.122128 31050 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.126593 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:14.127315 30484 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.136271 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:14.137001 30554 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:14.162200 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.165208 31033 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.186259 30882 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.186731 30882 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.168411 30484 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:14.183112 31026 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.189247 31026 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:14.187125 30882 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.191601 30308 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.214051 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:14.214788 30482 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 0.
I20260709 13:09:14.227260 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:14.227947 30552 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.231241 30308 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.256440 30552 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:14.259712 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.260636 30926 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.261142 30926 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:14.262140 30926 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.246052 30309 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.271775 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:14.272426 30477 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.289443 30882 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.291288 31045 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.298635 30882 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:14.301599 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:14.302228 30554 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.311673 30477 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:14.317790 30554 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:14.320039 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:14.323566 31044 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.324261 31044 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:14.325353 31044 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:14.335005 31030 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.355070 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:14.355741 30480 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.366616 30480 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:14.367316 31031 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:14.372071 30357 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:14.407961 31026 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:14.481871 31084 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:09:14.501165 31082 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.110s	user 0.001s	sys 0.007s
W20260709 13:09:14.503882 31083 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.133s	user 0.002s	sys 0.008s
I20260709 13:09:14.513366 31030 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.550122 30308 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.587855 31037 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.628376 30308 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:14.819674 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec1e0 after lost signal to thread 29283
W20260709 13:09:14.820631 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800191120 after lost signal to thread 30343
W20260709 13:09:14.821640 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08002a02e0 after lost signal to thread 30435
W20260709 13:09:14.822597 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800245dc0 after lost signal to thread 30510
W20260709 13:09:14.823593 30507 debug-util.cc:398] Leaking SignalData structure 0x7b080029a360 after lost signal to thread 30584
I20260709 13:09:14.832733 30882 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.857009 31091 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.964351 31033 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.970260 31033 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:15.990855 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:16.024834 31107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:16.029624 31108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:16.089015 31111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:16.099756 29280 server_base.cc:1061] running on GCE node
I20260709 13:09:16.101516 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:16.103108 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:16.103406 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602556103386 us; error 0 us; skew 500 ppm
I20260709 13:09:16.104563 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:16.110843 29280 webserver.cc:533] Webserver started at http://127.28.152.4:38747/ using document root <none> and password file <none>
I20260709 13:09:16.113348 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:16.113685 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:16.114475 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:16.115873 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-3-root/instance:
uuid: "19556a24b91d452d98668a3709fbc29d"
format_stamp: "Formatted at 2026-07-09 13:09:16 on dist-test-slave-x7j4"
I20260709 13:09:16.127913 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:16.134996 31115 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.137171 29280 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:09:16.137617 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
uuid: "19556a24b91d452d98668a3709fbc29d"
format_stamp: "Formatted at 2026-07-09 13:09:16 on dist-test-slave-x7j4"
I20260709 13:09:16.137928 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:16.180538 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:16.182379 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:16.185592 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:16.191485 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:16.191732 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:16.192092 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:16.192389 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:09:16.416823 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 52584.8us
I20260709 13:09:16.692687 31180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.4:39627 every 8 connection(s)
I20260709 13:09:16.696399 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.4:39627
I20260709 13:09:16.730587 29280 auto_leader_rebalancer-test.cc:384] add a tserver: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:16.738059 31181 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45705
I20260709 13:09:16.738570 31181 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:16.739665 31181 heartbeater.cc:507] Master 127.28.152.62:45705 requested a full tablet report, sending...
I20260709 13:09:16.741911 30309 ts_manager.cc:194] Registered new tserver with Master: 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:16.743827 30309 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49162
I20260709 13:09:17.747004 31181 heartbeater.cc:499] Master 127.28.152.62:45705 was elected leader, sending a full tablet report...
I20260709 13:09:17.868479 30408 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:17.877074 30484 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:17.878243 31091 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.886341 30554 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:17.889178 31091 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.904938 31186 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:17.906605 30486 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:17.916236 30376 consensus_peers.cc:597] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e809575d6fe84ef3afe48c9cf7532868. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.923933 30554 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:17.929107 30408 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:17.933517 30308 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:17.991220 30554 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:17.995546 30376 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3320ad6cc8ec4755a5fcf40ada291b5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:17.996770 31195 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.999328 30482 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:18.003278 31195 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.018358 31195 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.022325 30554 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.024945 30484 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.074143 30307 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.145622 30554 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.172403 30482 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:18.173267 30403 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:18.175508 31185 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.176440 31030 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.201661 31185 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.202633 30482 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:18.222204 30525 consensus_peers.cc:597] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9677253d313a48abb6e352b42a3fae88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.226305 30554 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.233525 30307 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.243940 30408 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:18.267833 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45664.1us
W20260709 13:09:18.316212 30525 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d34313dd02b6470d81b73b13d5cf157f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.321614 30484 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:18.325209 31030 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.327344 30403 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:18.334668 31185 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.364125 31210 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.366168 30405 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.370826 30482 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.388976 30307 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:18.406860 31217 ts_tablet_manager.cc:933] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:18.411994 31217 tablet_copy_client.cc:323] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:18.464730 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 3320ad6cc8ec4755a5fcf40ada291b5a from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:18.465458 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 3320ad6cc8ec4755a5fcf40ada291b5a from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-3320ad6cc8ec4755a5fcf40ada291b5a
I20260709 13:09:18.479008 30421 tablet_copy_source_session.cc:215] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:18.495427 31221 ts_tablet_manager.cc:933] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:18.503810 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3320ad6cc8ec4755a5fcf40ada291b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.538843 31217 tablet_copy_client.cc:806] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:18.539701 31217 tablet_copy_client.cc:670] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:18.566895 31217 tablet_copy_client.cc:538] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:18.571736 31221 tablet_copy_client.cc:323] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:18.581923 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet e809575d6fe84ef3afe48c9cf7532868 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:18.582468 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet e809575d6fe84ef3afe48c9cf7532868 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-e809575d6fe84ef3afe48c9cf7532868
I20260709 13:09:18.585649 31217 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:18.599393 30421 tablet_copy_source_session.cc:215] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:18.608903 31223 ts_tablet_manager.cc:933] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:18.612509 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e809575d6fe84ef3afe48c9cf7532868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.632018 31223 tablet_copy_client.cc:323] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:18.636538 31221 tablet_copy_client.cc:806] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:18.637173 31221 tablet_copy_client.cc:670] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:18.643281 31221 tablet_copy_client.cc:538] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:18.650400 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 9677253d313a48abb6e352b42a3fae88 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:18.650708 31217 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:18.651031 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 9677253d313a48abb6e352b42a3fae88 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-9677253d313a48abb6e352b42a3fae88
I20260709 13:09:18.651628 31217 tablet_bootstrap.cc:492] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:18.659246 31221 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:18.666319 30570 tablet_copy_source_session.cc:215] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:18.667203 31217 ts_tablet_manager.cc:1403] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.006s
I20260709 13:09:18.671386 31223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9677253d313a48abb6e352b42a3fae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.678303 31217 raft_consensus.cc:359] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.679201 31217 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:18.679828 31217 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.689361 31217 ts_tablet_manager.cc:1434] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:18.691394 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-3320ad6cc8ec4755a5fcf40ada291b5a received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:18.691864 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-3320ad6cc8ec4755a5fcf40ada291b5a on tablet 3320ad6cc8ec4755a5fcf40ada291b5a with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:18.718788 31223 tablet_copy_client.cc:806] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:18.723791 31223 tablet_copy_client.cc:670] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:18.734038 31217 ts_tablet_manager.cc:933] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:18.741142 31223 tablet_copy_client.cc:538] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:18.745090 31221 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:18.746048 31221 tablet_bootstrap.cc:492] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:18.746810 31221 ts_tablet_manager.cc:1403] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.034s
I20260709 13:09:18.750126 31221 raft_consensus.cc:359] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.751016 31221 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:18.752223 31223 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:18.751691 31221 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.756865 31221 ts_tablet_manager.cc:1434] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:18.769363 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-e809575d6fe84ef3afe48c9cf7532868 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:18.769837 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-e809575d6fe84ef3afe48c9cf7532868 on tablet e809575d6fe84ef3afe48c9cf7532868 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:18.787272 31223 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:18.786712 31217 tablet_copy_client.cc:323] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:18.789413 31223 tablet_bootstrap.cc:492] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:18.789606 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet d34313dd02b6470d81b73b13d5cf157f from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:18.790154 31223 ts_tablet_manager.cc:1403] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.009s
I20260709 13:09:18.790248 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet d34313dd02b6470d81b73b13d5cf157f from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-d34313dd02b6470d81b73b13d5cf157f
I20260709 13:09:18.801528 30570 tablet_copy_source_session.cc:215] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:18.808339 31217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34313dd02b6470d81b73b13d5cf157f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:18.812323 31223 raft_consensus.cc:359] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.813412 31223 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:18.815595 31223 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.818360 31223 ts_tablet_manager.cc:1434] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:09:18.829851 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-9677253d313a48abb6e352b42a3fae88 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:18.831362 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-9677253d313a48abb6e352b42a3fae88 on tablet 9677253d313a48abb6e352b42a3fae88 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:18.846174 31217 tablet_copy_client.cc:806] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:18.850715 31217 tablet_copy_client.cc:670] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:18.854995 31217 tablet_copy_client.cc:538] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:18.870296 31217 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:18.895951 31153 raft_consensus.cc:1217] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:18.909322 31217 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:18.910282 31217 tablet_bootstrap.cc:492] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:18.911072 31217 ts_tablet_manager.cc:1403] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.011s
I20260709 13:09:18.914018 31217 raft_consensus.cc:359] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.914359 31153 raft_consensus.cc:1217] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:18.914866 31217 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:18.930809 31217 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:18.933221 31217 ts_tablet_manager.cc:1434] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:09:18.940783 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-d34313dd02b6470d81b73b13d5cf157f received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:18.941250 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-d34313dd02b6470d81b73b13d5cf157f on tablet d34313dd02b6470d81b73b13d5cf157f with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:19.113987 31153 raft_consensus.cc:1217] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:19.182679 31153 raft_consensus.cc:1217] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:19.281970 31195 raft_consensus.cc:1064] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:19.284451 31195 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:19.322957 31153 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.324579 31203 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.348718 31186 raft_consensus.cc:1064] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:19.351425 31186 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:19.411371 30482 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.413110 31195 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.446059 30554 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.466216 30482 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.469435 31204 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.487627 31153 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.511404 31204 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.531170 31204 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:19.544281 31203 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.545645 30554 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.556203 30482 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.572932 31186 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.601177 30482 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.601435 30307 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.610917 31195 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.617846 31153 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.618956 31152 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.674790 30308 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.680148 30558 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.692466 30551 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:19.698782 31213 raft_consensus.cc:1064] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:19.699241 31210 raft_consensus.cc:1064] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:19.701983 31213 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:19.702602 31210 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:19.769469 30477 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.772192 30484 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:09:19.775085 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 83608.7us
I20260709 13:09:19.788386 30406 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.788523 30408 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.795023 31153 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.801184 31152 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:19.810432 31241 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.818452 31185 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:19.868204 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 81378.9us
I20260709 13:09:19.880100 31232 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.880744 31185 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.882954 31241 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.888124 31241 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:19.968268 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 136218us
I20260709 13:09:20.076581 30403 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:20.076336 30406 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:20.098007 31152 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.104672 31250 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:20.109447 30480 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.113058 31195 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:20.117715 31213 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.121652 31185 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.149820 30558 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.151001 31166 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:09:20.156037 31260 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:20.156363 31152 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.169466 31153 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.164609 30411 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.174204 31195 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.172230 31250 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:09:20.179133 30307 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.182337 31186 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.184212 31151 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.198259 30558 raft_consensus.cc:2955] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.156162 30480 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.221951 30482 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.229311 30477 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.219300 31153 raft_consensus.cc:2955] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.260097 30306 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.251611 31152 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.305946 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e809575d6fe84ef3afe48c9cf7532868 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:09:20.311249 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68457.4us
I20260709 13:09:20.318497 30309 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.322160 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3320ad6cc8ec4755a5fcf40ada291b5a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:20.330724 30553 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:20.335994 30307 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.339531 31150 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.341317 31254 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:20.348739 31252 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.246467 30403 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.350934 31149 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.356200 30482 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.368122 31185 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.372382 30486 raft_consensus.cc:2955] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.380206 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9677253d313a48abb6e352b42a3fae88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:20.381599 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet e809575d6fe84ef3afe48c9cf7532868 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:20.407071 31263 tablet_replica.cc:333] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:20.408373 31263 raft_consensus.cc:2243] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.416532 31263 raft_consensus.cc:2272] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.455839 30305 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.461572 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 3320ad6cc8ec4755a5fcf40ada291b5a with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:20.463694 31263 ts_tablet_manager.cc:1916] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:20.464031 31264 tablet_replica.cc:333] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:20.465025 30553 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:20.465263 31264 raft_consensus.cc:2243] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.468279 31264 raft_consensus.cc:2272] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.474231 30295 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 9677253d313a48abb6e352b42a3fae88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:09:20.481776 31152 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.483755 31185 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.484215 30403 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:20.486794 31252 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.492564 31254 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.497601 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 9677253d313a48abb6e352b42a3fae88 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:20.505409 30405 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.504944 31152 raft_consensus.cc:2955] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.515072 31263 ts_tablet_manager.cc:1929] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:20.515686 31263 log.cc:1199] T e809575d6fe84ef3afe48c9cf7532868 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/e809575d6fe84ef3afe48c9cf7532868
I20260709 13:09:20.517469 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet e809575d6fe84ef3afe48c9cf7532868 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:20.522198 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d34313dd02b6470d81b73b13d5cf157f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:20.535010 30305 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:20.548955 31265 tablet_replica.cc:333] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:20.550146 31265 raft_consensus.cc:2243] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.550806 31265 raft_consensus.cc:2272] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.560053 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet d34313dd02b6470d81b73b13d5cf157f with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:20.579469 31264 ts_tablet_manager.cc:1916] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:20.577628 31265 ts_tablet_manager.cc:1916] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:20.603540 31264 ts_tablet_manager.cc:1929] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:20.603991 31264 log.cc:1199] T 3320ad6cc8ec4755a5fcf40ada291b5a P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/3320ad6cc8ec4755a5fcf40ada291b5a
I20260709 13:09:20.605806 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 3320ad6cc8ec4755a5fcf40ada291b5a (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:20.607698 31264 tablet_replica.cc:333] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:20.608855 31264 raft_consensus.cc:2243] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.610100 31264 raft_consensus.cc:2272] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.614581 31264 ts_tablet_manager.cc:1916] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:20.623037 31265 ts_tablet_manager.cc:1929] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:20.623494 31265 log.cc:1199] T 9677253d313a48abb6e352b42a3fae88 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/9677253d313a48abb6e352b42a3fae88
I20260709 13:09:20.625239 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 9677253d313a48abb6e352b42a3fae88 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:20.640229 31264 ts_tablet_manager.cc:1929] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:20.640738 31264 log.cc:1199] T d34313dd02b6470d81b73b13d5cf157f P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/d34313dd02b6470d81b73b13d5cf157f
I20260709 13:09:20.643435 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet d34313dd02b6470d81b73b13d5cf157f (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:21.717491 30403 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:21.903980 30554 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:21.905500 30376 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4b473589cd94be59022580022e2de00. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.906514 31204 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:21.907747 30486 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:21.919294 31204 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:21.928356 30554 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:21.926363 31266 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:21.949302 30309 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:21.982625 30486 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.038157 30486 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:22.054579 30405 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.056154 31226 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.112408 30554 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.112203 31261 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.114890 30403 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.120236 31226 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:22.150367 30309 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.213598 30403 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:22.221132 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 103045us
I20260709 13:09:22.224812 30558 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:22.225750 30376 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c4e8b43b5248a6b8811c7335522edb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.227859 30477 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:22.232347 31284 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:22.231119 30451 consensus_peers.cc:597] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7846efa5da12423cb3343cd5f3483869. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.240092 31284 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:22.251176 30554 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.275434 31195 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.284929 30558 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.297655 30486 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:22.299135 30307 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.308580 30483 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:22.347683 30451 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ba0b89a2fc4499a917166e3b4b88cf9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.348837 30554 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:22.350294 31226 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.352563 30403 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:22.356298 31226 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.363691 31281 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.365130 30554 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.397667 30307 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.400650 31292 ts_tablet_manager.cc:933] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:22.432433 31292 tablet_copy_client.cc:323] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:22.435484 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet c4b473589cd94be59022580022e2de00 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:22.436084 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet c4b473589cd94be59022580022e2de00 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-c4b473589cd94be59022580022e2de00
I20260709 13:09:22.461074 30421 tablet_copy_source_session.cc:215] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:22.479974 30403 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:22.498485 31292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b473589cd94be59022580022e2de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.527778 31294 ts_tablet_manager.cc:933] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:22.557786 31292 tablet_copy_client.cc:806] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:22.558424 31292 tablet_copy_client.cc:670] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:22.558892 31294 tablet_copy_client.cc:323] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:09:22.565791 31292 tablet_copy_client.cc:538] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:22.588747 31292 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:22.593206 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 7846efa5da12423cb3343cd5f3483869 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:09:22.593853 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 7846efa5da12423cb3343cd5f3483869 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-7846efa5da12423cb3343cd5f3483869
I20260709 13:09:22.601679 30496 tablet_copy_source_session.cc:215] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:22.606262 31294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7846efa5da12423cb3343cd5f3483869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.665539 31292 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.666597 31292 tablet_bootstrap.cc:492] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:22.669678 31292 ts_tablet_manager.cc:1403] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.013s
I20260709 13:09:22.678591 31292 raft_consensus.cc:359] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:22.679776 31292 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:22.680987 31292 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:22.692945 31292 ts_tablet_manager.cc:1434] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.006s
I20260709 13:09:22.699747 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-c4b473589cd94be59022580022e2de00 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:22.700452 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-c4b473589cd94be59022580022e2de00 on tablet c4b473589cd94be59022580022e2de00 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:22.716420 31294 tablet_copy_client.cc:806] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:22.717070 31294 tablet_copy_client.cc:670] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:22.720973 31294 tablet_copy_client.cc:538] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:22.730768 31294 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:22.804171 31292 ts_tablet_manager.cc:933] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:22.822218 31152 raft_consensus.cc:1217] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:22.887152 31302 ts_tablet_manager.cc:933] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:22.911365 31292 tablet_copy_client.cc:323] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:22.922487 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet f2c4e8b43b5248a6b8811c7335522edb from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:22.923099 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet f2c4e8b43b5248a6b8811c7335522edb from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-f2c4e8b43b5248a6b8811c7335522edb
I20260709 13:09:22.949822 30421 tablet_copy_source_session.cc:215] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:22.954507 31292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c4e8b43b5248a6b8811c7335522edb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:22.960683 31294 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:22.964046 31294 tablet_bootstrap.cc:492] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:22.964901 31302 tablet_copy_client.cc:323] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:09:22.967401 31294 ts_tablet_manager.cc:1403] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.237s	user 0.022s	sys 0.013s
I20260709 13:09:22.967486 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:09:22.972163 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 2ba0b89a2fc4499a917166e3b4b88cf9 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-2ba0b89a2fc4499a917166e3b4b88cf9
I20260709 13:09:22.990780 30496 tablet_copy_source_session.cc:215] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:23.004364 31302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba0b89a2fc4499a917166e3b4b88cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:23.112458 31294 raft_consensus.cc:359] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.153678 31294 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:23.159174 31294 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.166759 31294 ts_tablet_manager.cc:1434] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.000s
I20260709 13:09:23.168406 30496 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-7846efa5da12423cb3343cd5f3483869 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:09:23.168853 30496 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-7846efa5da12423cb3343cd5f3483869 on tablet 7846efa5da12423cb3343cd5f3483869 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:23.176702 31302 tablet_copy_client.cc:806] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:23.178335 31292 tablet_copy_client.cc:806] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:23.178975 31292 tablet_copy_client.cc:670] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:23.179211 31302 tablet_copy_client.cc:670] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:23.183041 31292 tablet_copy_client.cc:538] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:23.183036 31302 tablet_copy_client.cc:538] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:23.194797 31292 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:23.201078 31302 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:23.260028 31292 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.260934 31292 tablet_bootstrap.cc:492] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:23.261582 31292 ts_tablet_manager.cc:1403] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.003s
I20260709 13:09:23.264678 31292 raft_consensus.cc:359] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.271020 31292 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:23.271832 31292 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.281738 31292 ts_tablet_manager.cc:1434] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:09:23.289007 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-f2c4e8b43b5248a6b8811c7335522edb received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:23.289456 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-f2c4e8b43b5248a6b8811c7335522edb on tablet f2c4e8b43b5248a6b8811c7335522edb with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:23.294435 31195 raft_consensus.cc:1064] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:23.297081 31195 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:23.325695 31149 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.326730 30558 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.327575 31266 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.328428 31284 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.334558 30477 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.349423 31266 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.381428 31284 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.383489 30477 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.399426 30554 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.417938 31152 raft_consensus.cc:1217] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:23.425930 30309 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.475337 31149 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.570044 31149 raft_consensus.cc:1217] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:09:23.573571 31302 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.575910 31302 tablet_bootstrap.cc:492] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:23.576773 31302 ts_tablet_manager.cc:1403] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.383s	user 0.035s	sys 0.006s
I20260709 13:09:23.626151 30403 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:23.632750 30477 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.633033 31152 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:23.634140 31318 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.634997 31284 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.637737 31302 raft_consensus.cc:359] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.642781 31302 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:23.643491 31302 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:23.649471 31318 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.652863 30483 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.652446 31302 ts_tablet_manager.cc:1434] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:09:23.652832 31152 raft_consensus.cc:2955] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.667263 30496 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-2ba0b89a2fc4499a917166e3b4b88cf9 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:09:23.667698 30496 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-2ba0b89a2fc4499a917166e3b4b88cf9 on tablet 2ba0b89a2fc4499a917166e3b4b88cf9 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:23.679932 31149 raft_consensus.cc:1217] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:23.681268 30305 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.689208 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4b473589cd94be59022580022e2de00 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:23.696399 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b473589cd94be59022580022e2de00 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:23.707701 31320 tablet_replica.cc:333] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:23.712723 31320 raft_consensus.cc:2243] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:23.713587 31320 raft_consensus.cc:2272] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.717295 31320 ts_tablet_manager.cc:1916] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:23.747728 31320 ts_tablet_manager.cc:1929] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:23.748251 31320 log.cc:1199] T c4b473589cd94be59022580022e2de00 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/c4b473589cd94be59022580022e2de00
I20260709 13:09:23.749773 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet c4b473589cd94be59022580022e2de00 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:23.924098 31318 raft_consensus.cc:1064] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:23.926843 31318 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:23.941833 31152 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.943725 31266 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.950393 30558 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.951515 30483 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:23.953342 31317 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.955725 31266 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.975483 31166 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.982134 30477 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:23.983460 30553 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.000579 30307 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.007579 31152 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.025910 30403 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:24.032399 31152 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.033416 30553 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.033941 31284 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.045507 31166 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.046947 31318 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.056273 30553 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.057425 31152 raft_consensus.cc:2955] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.075402 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2c4e8b43b5248a6b8811c7335522edb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.098490 30307 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.125286 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c4e8b43b5248a6b8811c7335522edb with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:24.127988 31325 tablet_replica.cc:333] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:24.128964 31325 raft_consensus.cc:2243] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.129573 31325 raft_consensus.cc:2272] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.132975 31325 ts_tablet_manager.cc:1916] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.152082 31325 ts_tablet_manager.cc:1929] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:24.152567 31325 log.cc:1199] T f2c4e8b43b5248a6b8811c7335522edb P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/f2c4e8b43b5248a6b8811c7335522edb
I20260709 13:09:24.153729 31226 raft_consensus.cc:1064] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:24.156343 31226 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:24.166414 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet f2c4e8b43b5248a6b8811c7335522edb (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:24.171437 31281 raft_consensus.cc:1064] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:24.176527 31281 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:24.208982 31152 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.211069 31319 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.220424 31149 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:24.228035 31330 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.229557 30403 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:24.230495 30553 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:24.231875 30554 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.232887 31328 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.235880 31226 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.235925 31332 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:24.245574 30405 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:24.251271 31281 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.263078 31332 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.264691 30553 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.281736 30405 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.287671 31333 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.287964 31152 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.289820 30553 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.293413 30305 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.296545 30403 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.312879 31152 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.322885 30308 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.336779 30477 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:24.345111 31152 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.346386 31333 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.348526 30477 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:24.351301 30403 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:24.354655 31226 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.358511 30554 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:24.359882 31332 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.366727 31152 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:24.367489 31331 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.372287 31281 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:24.373658 30553 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.376778 31149 raft_consensus.cc:2955] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.377440 31330 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.379058 30403 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.391860 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.394783 30307 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.397253 30309 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.403386 31152 raft_consensus.cc:2955] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:24.413648 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ba0b89a2fc4499a917166e3b4b88cf9 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:24.414502 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7846efa5da12423cb3343cd5f3483869 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:24.416742 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 7846efa5da12423cb3343cd5f3483869 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:24.419055 31339 tablet_replica.cc:333] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:24.420825 31339 raft_consensus.cc:2243] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.421829 31339 raft_consensus.cc:2272] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.426781 31339 ts_tablet_manager.cc:1916] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.440380 31340 tablet_replica.cc:333] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:24.441439 31340 raft_consensus.cc:2243] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:24.442296 31340 raft_consensus.cc:2272] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:24.445068 31339 ts_tablet_manager.cc:1929] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:24.445542 31340 ts_tablet_manager.cc:1916] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:24.445640 31339 log.cc:1199] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/2ba0b89a2fc4499a917166e3b4b88cf9
I20260709 13:09:24.447104 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 2ba0b89a2fc4499a917166e3b4b88cf9 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:24.460155 31340 ts_tablet_manager.cc:1929] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:09:24.460731 31340 log.cc:1199] T 7846efa5da12423cb3343cd5f3483869 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/7846efa5da12423cb3343cd5f3483869
I20260709 13:09:24.462011 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 7846efa5da12423cb3343cd5f3483869 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:25.487203 30553 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:25.492861 30525 consensus_peers.cc:597] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61d4ac70a018496ba2020b90313c013e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.493098 30403 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.493562 30477 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.494395 31341 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.495327 31314 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.503099 31341 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.504854 30403 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.506398 30477 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.525182 30305 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.526388 30405 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:25.544394 30376 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 913c2d18b15848cd98ab0ff37874cc23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.546795 30477 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.548172 31318 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.552561 30554 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.554736 31345 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.566776 31195 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.567978 30477 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.576597 30554 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.585932 30553 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:25.593216 30309 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.614691 30477 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:25.614902 30525 consensus_peers.cc:597] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 567508f2962f473b8fac20c97a240f35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.616106 31254 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.617316 30405 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:25.618556 31341 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.624506 31341 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.625515 30477 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.628679 30405 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.638561 30403 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:25.651932 30305 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:25.655642 30376 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9632f38fdbf84c58a587a59a81f394ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:25.658398 30477 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.663169 31345 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.683804 30554 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:25.686241 31195 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.691692 31195 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.694114 30483 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.719080 30309 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.723160 30553 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:25.877928 31362 ts_tablet_manager.cc:933] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:25.880663 31362 tablet_copy_client.cc:323] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:25.882365 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 61d4ac70a018496ba2020b90313c013e from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:25.882929 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 61d4ac70a018496ba2020b90313c013e from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-61d4ac70a018496ba2020b90313c013e
I20260709 13:09:25.890602 30570 tablet_copy_source_session.cc:215] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:25.893668 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d4ac70a018496ba2020b90313c013e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.909041 31362 tablet_copy_client.cc:806] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:25.909672 31362 tablet_copy_client.cc:670] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:25.913213 31362 tablet_copy_client.cc:538] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:25.921810 31362 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:25.942200 31362 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.943178 31362 tablet_bootstrap.cc:492] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:25.943815 31362 ts_tablet_manager.cc:1403] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 13:09:25.946676 31362 raft_consensus.cc:359] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:25.947647 31362 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:25.948311 31362 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:25.951571 31362 ts_tablet_manager.cc:1434] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:25.956638 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-61d4ac70a018496ba2020b90313c013e received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:25.957064 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-61d4ac70a018496ba2020b90313c013e on tablet 61d4ac70a018496ba2020b90313c013e with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:26.134541 31362 ts_tablet_manager.cc:933] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:26.136977 31362 tablet_copy_client.cc:323] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:26.138514 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 567508f2962f473b8fac20c97a240f35 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:26.139043 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 567508f2962f473b8fac20c97a240f35 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-567508f2962f473b8fac20c97a240f35
I20260709 13:09:26.146485 30570 tablet_copy_source_session.cc:215] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.150221 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567508f2962f473b8fac20c97a240f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.152356 31367 ts_tablet_manager.cc:933] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:26.155994 31367 tablet_copy_client.cc:323] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:26.157584 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 913c2d18b15848cd98ab0ff37874cc23 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:26.158079 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 913c2d18b15848cd98ab0ff37874cc23 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-913c2d18b15848cd98ab0ff37874cc23
I20260709 13:09:26.167443 30421 tablet_copy_source_session.cc:215] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.170588 31367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913c2d18b15848cd98ab0ff37874cc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.173899 31362 tablet_copy_client.cc:806] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.174549 31362 tablet_copy_client.cc:670] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.180243 31362 tablet_copy_client.cc:538] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.191789 31362 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:26.196455 31367 tablet_copy_client.cc:806] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.198223 31367 tablet_copy_client.cc:670] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.197693 31369 ts_tablet_manager.cc:933] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:26.207067 31367 tablet_copy_client.cc:538] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.216087 31367 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:26.222945 31369 tablet_copy_client.cc:323] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:26.225059 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 9632f38fdbf84c58a587a59a81f394ce from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:26.225524 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 9632f38fdbf84c58a587a59a81f394ce from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-9632f38fdbf84c58a587a59a81f394ce
I20260709 13:09:26.233449 30421 tablet_copy_source_session.cc:215] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:26.236821 31369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632f38fdbf84c58a587a59a81f394ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.236763 31362 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.242280 31362 tablet_bootstrap.cc:492] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:26.248059 31362 ts_tablet_manager.cc:1403] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.004s
I20260709 13:09:26.252257 31367 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.253415 31367 tablet_bootstrap.cc:492] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:26.253551 31369 tablet_copy_client.cc:806] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:26.254112 31369 tablet_copy_client.cc:670] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:26.254065 31367 ts_tablet_manager.cc:1403] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.004s
I20260709 13:09:26.256526 31362 raft_consensus.cc:359] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.260068 31369 tablet_copy_client.cc:538] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:26.258615 31362 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:26.262166 31362 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.265460 31367 raft_consensus.cc:359] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.266253 31367 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:26.266889 31367 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.269120 31362 ts_tablet_manager.cc:1434] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:09:26.269687 31367 ts_tablet_manager.cc:1434] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:09:26.269912 31369 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:26.271629 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-913c2d18b15848cd98ab0ff37874cc23 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:26.272151 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-913c2d18b15848cd98ab0ff37874cc23 on tablet 913c2d18b15848cd98ab0ff37874cc23 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:26.274652 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-567508f2962f473b8fac20c97a240f35 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:26.275090 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-567508f2962f473b8fac20c97a240f35 on tablet 567508f2962f473b8fac20c97a240f35 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:26.293741 31369 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.294636 31369 tablet_bootstrap.cc:492] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:26.295310 31369 ts_tablet_manager.cc:1403] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 13:09:26.298151 31369 raft_consensus.cc:359] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.298960 31369 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:26.299541 31369 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:26.301851 31369 ts_tablet_manager.cc:1434] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:26.303417 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-9632f38fdbf84c58a587a59a81f394ce received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:26.303792 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-9632f38fdbf84c58a587a59a81f394ce on tablet 9632f38fdbf84c58a587a59a81f394ce with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:26.313577 31152 raft_consensus.cc:1217] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:26.624204 31152 raft_consensus.cc:1217] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:09:26.748065 31152 raft_consensus.cc:1217] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:26.773545 31152 raft_consensus.cc:1217] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:26.785732 31314 raft_consensus.cc:1064] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:26.789695 31314 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:26.798897 31149 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:26.800369 31341 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.803143 30477 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:26.807844 31341 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.816239 30403 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:26.819401 31356 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.854789 31149 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.854789 30405 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.852782 31314 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.881412 30477 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.881601 30309 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.912604 30553 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:26.917392 31149 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:26.918889 30483 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:26.918869 31314 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:26.921066 31377 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:26.929153 31377 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.933503 31149 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.938489 30477 raft_consensus.cc:2955] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.951560 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61d4ac70a018496ba2020b90313c013e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:26.947587 30308 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:26.964466 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 61d4ac70a018496ba2020b90313c013e with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:26.967733 31386 tablet_replica.cc:333] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:26.969007 31386 raft_consensus.cc:2243] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:26.970296 31386 raft_consensus.cc:2272] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:26.973992 31386 ts_tablet_manager.cc:1916] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:26.990577 31386 ts_tablet_manager.cc:1929] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:26.991057 31386 log.cc:1199] T 61d4ac70a018496ba2020b90313c013e P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/61d4ac70a018496ba2020b90313c013e
I20260709 13:09:26.992838 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 61d4ac70a018496ba2020b90313c013e (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:27.176625 31345 raft_consensus.cc:1064] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:27.179569 31345 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.186941 31149 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.187042 30477 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.187824 30555 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.188686 31318 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.189451 31345 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.190837 31375 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.204682 31318 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.206738 31149 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.215567 30477 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.226519 30308 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.230230 31375 raft_consensus.cc:1064] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:27.232664 31375 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.242967 31341 raft_consensus.cc:1064] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:27.245848 31341 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.248931 30477 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.250228 31318 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.251950 31149 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.257573 30405 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.257189 30553 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.260673 31375 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.261009 30558 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:27.265159 31345 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.272871 31152 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.279026 31318 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:27.284109 30554 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.285694 31345 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.288143 31375 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.292395 30554 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.295339 31152 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:27.297735 31385 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.298621 31150 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.301209 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 913c2d18b15848cd98ab0ff37874cc23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:27.304504 30405 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:27.297089 31375 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.359007 30477 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:27.294493 31149 raft_consensus.cc:2955] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.368567 31314 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:27.368489 30308 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.370021 31341 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.374934 30307 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.410778 31314 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.420432 30558 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.431623 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 913c2d18b15848cd98ab0ff37874cc23 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:27.435097 30477 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.439940 30405 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.449052 31400 tablet_replica.cc:333] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:27.453549 31152 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.468997 31400 raft_consensus.cc:2243] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.469828 31400 raft_consensus.cc:2272] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.473361 31400 ts_tablet_manager.cc:1916] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:27.482534 30308 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.483783 30411 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.488656 30480 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.520206 31152 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.523502 31400 ts_tablet_manager.cc:1929] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:27.524008 31400 log.cc:1199] T 913c2d18b15848cd98ab0ff37874cc23 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/913c2d18b15848cd98ab0ff37874cc23
I20260709 13:09:27.523789 31345 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:27.526304 30480 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:27.529054 31345 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.537508 30554 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:27.539767 31345 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.547515 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 913c2d18b15848cd98ab0ff37874cc23 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:27.551015 30480 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:27.552906 31152 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:09:27.553699 31150 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.555323 30483 raft_consensus.cc:2955] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.554996 31341 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.561393 31385 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.571550 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9632f38fdbf84c58a587a59a81f394ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:27.573558 31314 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.578716 30305 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.589545 31150 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.593954 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 567508f2962f473b8fac20c97a240f35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:27.593763 30477 raft_consensus.cc:2955] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:27.605785 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 9632f38fdbf84c58a587a59a81f394ce with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:27.607396 30309 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.620355 31402 tablet_replica.cc:333] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:27.621483 31402 raft_consensus.cc:2243] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.622217 31402 raft_consensus.cc:2272] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.630005 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 567508f2962f473b8fac20c97a240f35 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:27.631107 31402 ts_tablet_manager.cc:1916] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:27.634395 31403 tablet_replica.cc:333] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:27.646750 31402 ts_tablet_manager.cc:1929] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:27.647212 31402 log.cc:1199] T 9632f38fdbf84c58a587a59a81f394ce P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/9632f38fdbf84c58a587a59a81f394ce
I20260709 13:09:27.648944 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 9632f38fdbf84c58a587a59a81f394ce (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:27.650609 31403 raft_consensus.cc:2243] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:27.651309 31403 raft_consensus.cc:2272] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:27.654028 31403 ts_tablet_manager.cc:1916] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:27.666966 31403 ts_tablet_manager.cc:1929] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:09:27.667341 31403 log.cc:1199] T 567508f2962f473b8fac20c97a240f35 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/567508f2962f473b8fac20c97a240f35
I20260709 13:09:27.668731 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 567508f2962f473b8fac20c97a240f35 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:28.704290 30554 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:28.709383 30477 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:28.709661 30525 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c7503235ec641f7b8929ebbf8124038. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.710244 30405 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.710639 31404 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.711695 31377 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.718605 31341 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.720175 30477 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.725327 30405 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.733829 30309 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.735518 30554 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:28.744746 30525 consensus_peers.cc:597] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5b1451644b74f359b2aae8ebfaf45d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.745625 30405 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.745798 30480 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.747722 31341 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.748739 31377 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.761446 31404 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.767076 30480 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.781370 30405 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:28.788887 30411 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.811669 30305 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:28.825414 30376 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f6773aa18b4ca9a0d9829e2021b82e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.825907 30480 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.826606 30558 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.827523 31397 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.828344 31345 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.836762 31397 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.838351 30558 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.839627 30480 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.849553 30405 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:28.855597 30309 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.862941 30558 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:28.864102 30480 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:09:28.865477 30376 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b385b950a414bce8902269df58e5bf4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.865798 31397 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.869508 31345 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.882377 31419 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.889768 30558 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.891290 30480 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:28.908526 30308 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:29.223946 31425 ts_tablet_manager.cc:933] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:29.227514 31425 tablet_copy_client.cc:323] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:29.229321 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 2c7503235ec641f7b8929ebbf8124038 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:29.229837 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 2c7503235ec641f7b8929ebbf8124038 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-2c7503235ec641f7b8929ebbf8124038
I20260709 13:09:29.238040 30570 tablet_copy_source_session.cc:215] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.240924 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7503235ec641f7b8929ebbf8124038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.252416 31425 tablet_copy_client.cc:806] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.253068 31425 tablet_copy_client.cc:670] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.256640 31425 tablet_copy_client.cc:538] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.264145 31425 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:29.265838 31427 ts_tablet_manager.cc:933] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:29.270498 31427 tablet_copy_client.cc:323] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:29.272305 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet b5b1451644b74f359b2aae8ebfaf45d3 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:29.272816 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet b5b1451644b74f359b2aae8ebfaf45d3 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-b5b1451644b74f359b2aae8ebfaf45d3
I20260709 13:09:29.282586 30570 tablet_copy_source_session.cc:215] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.285558 31425 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.286474 31425 tablet_bootstrap.cc:492] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:29.287066 31427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b1451644b74f359b2aae8ebfaf45d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.287173 31425 ts_tablet_manager.cc:1403] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:09:29.290789 31425 raft_consensus.cc:359] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.291628 31425 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:29.292307 31425 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.301911 31425 ts_tablet_manager.cc:1434] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.011s
I20260709 13:09:29.303771 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-2c7503235ec641f7b8929ebbf8124038 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:29.304190 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-2c7503235ec641f7b8929ebbf8124038 on tablet 2c7503235ec641f7b8929ebbf8124038 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:29.311738 31427 tablet_copy_client.cc:806] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.312412 31427 tablet_copy_client.cc:670] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.322830 31427 tablet_copy_client.cc:538] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.330098 31427 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:29.356487 31427 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.357442 31427 tablet_bootstrap.cc:492] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:29.358114 31427 ts_tablet_manager.cc:1403] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.014s
I20260709 13:09:29.361171 31427 raft_consensus.cc:359] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.362010 31427 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:29.362666 31427 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.365011 31427 ts_tablet_manager.cc:1434] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:09:29.368124 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-b5b1451644b74f359b2aae8ebfaf45d3 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:29.368510 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-b5b1451644b74f359b2aae8ebfaf45d3 on tablet b5b1451644b74f359b2aae8ebfaf45d3 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:29.422537 31427 ts_tablet_manager.cc:933] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:29.424351 31427 tablet_copy_client.cc:323] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:29.426141 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 6b385b950a414bce8902269df58e5bf4 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:29.426671 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 6b385b950a414bce8902269df58e5bf4 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-6b385b950a414bce8902269df58e5bf4
I20260709 13:09:29.433686 30421 tablet_copy_source_session.cc:215] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.433918 31425 ts_tablet_manager.cc:933] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:29.435949 31425 tablet_copy_client.cc:323] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:29.438831 31427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b385b950a414bce8902269df58e5bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.440774 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet e4f6773aa18b4ca9a0d9829e2021b82e from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:29.441919 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet e4f6773aa18b4ca9a0d9829e2021b82e from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-e4f6773aa18b4ca9a0d9829e2021b82e
I20260709 13:09:29.455660 31427 tablet_copy_client.cc:806] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.456357 31427 tablet_copy_client.cc:670] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.456408 30421 tablet_copy_source_session.cc:215] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:29.459401 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f6773aa18b4ca9a0d9829e2021b82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.459987 31427 tablet_copy_client.cc:538] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.470477 31427 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:29.477634 31425 tablet_copy_client.cc:806] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:29.478281 31425 tablet_copy_client.cc:670] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:29.509177 31425 tablet_copy_client.cc:538] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:29.520409 31425 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:29.533721 31427 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.534718 31427 tablet_bootstrap.cc:492] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:29.535533 31427 ts_tablet_manager.cc:1403] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.046s
I20260709 13:09:29.538673 31427 raft_consensus.cc:359] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.539363 31427 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:29.539893 31427 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.542045 31427 ts_tablet_manager.cc:1434] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:09:29.543640 31425 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:29.544251 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-6b385b950a414bce8902269df58e5bf4 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:29.544704 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-6b385b950a414bce8902269df58e5bf4 on tablet 6b385b950a414bce8902269df58e5bf4 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:29.546413 31425 tablet_bootstrap.cc:492] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:29.547281 31425 ts_tablet_manager.cc:1403] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260709 13:09:29.550246 31425 raft_consensus.cc:359] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.551954 31425 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:29.552611 31425 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:29.556337 31425 ts_tablet_manager.cc:1434] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:29.558027 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-e4f6773aa18b4ca9a0d9829e2021b82e received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:29.558424 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-e4f6773aa18b4ca9a0d9829e2021b82e on tablet e4f6773aa18b4ca9a0d9829e2021b82e with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:29.601461 31152 raft_consensus.cc:1217] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:29.819607 31152 raft_consensus.cc:1217] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:29.898805 31152 raft_consensus.cc:1217] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:30.012647 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 77905.9us
I20260709 13:09:30.071707 31149 raft_consensus.cc:1217] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:30.198275 31404 raft_consensus.cc:1064] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:30.202011 31404 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.212426 31149 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.212446 31434 raft_consensus.cc:1064] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:30.215698 30477 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.215848 30411 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.216985 31437 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.218030 31377 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.217825 31434 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.218647 31404 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.251820 31149 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.253819 31377 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.253778 31437 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.267669 30480 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.268967 30477 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.271283 31404 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.271647 30403 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.273262 31377 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.280222 31149 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.286533 30411 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.295394 30308 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.315596 31447 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.321658 30477 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.332036 31149 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.330289 30403 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.362288 31423 raft_consensus.cc:1064] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:30.364952 31423 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.384166 31149 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.385706 31345 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.386584 30558 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.388275 31443 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.391486 30477 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.394603 30558 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.395327 31443 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.400966 31152 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.404021 31457 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:30.406797 30309 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.408811 30403 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.410388 31457 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:30.422711 31447 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.429694 30403 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.435694 31149 raft_consensus.cc:2955] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.452526 30551 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.453260 31443 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.463316 30306 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.468673 30480 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.469224 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c7503235ec641f7b8929ebbf8124038 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:30.471594 31457 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:30.484052 31434 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.487797 30480 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.489220 31149 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.507732 30551 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.506377 30309 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.502511 31404 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:09:30.510943 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c7503235ec641f7b8929ebbf8124038 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:30.510370 30480 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.516013 31345 raft_consensus.cc:1064] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:30.521958 31149 raft_consensus.cc:2955] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.526849 31345 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.538720 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5b1451644b74f359b2aae8ebfaf45d3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:30.553629 31464 tablet_replica.cc:333] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:30.542651 30308 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.562922 31149 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.567337 30480 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.568683 31152 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.568884 31345 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.570946 30551 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:30.582324 31345 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.586464 31464 raft_consensus.cc:2243] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.587216 31464 raft_consensus.cc:2272] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.591382 31464 ts_tablet_manager.cc:1916] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:30.596202 31345 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.599135 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet b5b1451644b74f359b2aae8ebfaf45d3 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:30.600286 30405 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.608575 30480 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.610204 31345 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:30.611953 31152 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.615351 31467 tablet_replica.cc:333] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:30.618183 31441 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:30.622437 31443 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.625553 31467 raft_consensus.cc:2243] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.626328 31467 raft_consensus.cc:2272] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.629792 30480 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.640424 31464 ts_tablet_manager.cc:1929] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:30.644376 31464 log.cc:1199] T 2c7503235ec641f7b8929ebbf8124038 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/2c7503235ec641f7b8929ebbf8124038
I20260709 13:09:30.647897 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 2c7503235ec641f7b8929ebbf8124038 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:30.637446 31467 ts_tablet_manager.cc:1916] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:30.656949 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4f6773aa18b4ca9a0d9829e2021b82e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:30.667835 31152 raft_consensus.cc:2955] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.670764 30306 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.672986 31440 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.684718 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f6773aa18b4ca9a0d9829e2021b82e with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:30.684823 31149 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.685207 30551 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.698792 31470 tablet_replica.cc:333] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:30.700063 31467 ts_tablet_manager.cc:1929] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:30.703735 31467 log.cc:1199] T b5b1451644b74f359b2aae8ebfaf45d3 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/b5b1451644b74f359b2aae8ebfaf45d3
I20260709 13:09:30.704754 30484 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.711724 30309 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.722371 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet b5b1451644b74f359b2aae8ebfaf45d3 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:30.700095 31470 raft_consensus.cc:2243] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.723691 31470 raft_consensus.cc:2272] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.730885 31470 ts_tablet_manager.cc:1916] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:30.739570 30403 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:30.746510 31149 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.747112 30480 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:30.747786 31440 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:30.750254 31440 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:30.752143 31470 ts_tablet_manager.cc:1929] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:30.754195 31470 log.cc:1199] T e4f6773aa18b4ca9a0d9829e2021b82e P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/e4f6773aa18b4ca9a0d9829e2021b82e
I20260709 13:09:30.757241 31423 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.759260 30484 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.764981 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet e4f6773aa18b4ca9a0d9829e2021b82e (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:30.770825 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b385b950a414bce8902269df58e5bf4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:30.771222 31152 raft_consensus.cc:2955] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.777526 30309 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:30.791464 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b385b950a414bce8902269df58e5bf4 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:30.792471 31470 tablet_replica.cc:333] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:30.793697 31470 raft_consensus.cc:2243] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.794409 31470 raft_consensus.cc:2272] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.797775 31470 ts_tablet_manager.cc:1916] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:30.811746 31470 ts_tablet_manager.cc:1929] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:30.812034 31470 log.cc:1199] T 6b385b950a414bce8902269df58e5bf4 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/6b385b950a414bce8902269df58e5bf4
I20260709 13:09:30.813238 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 6b385b950a414bce8902269df58e5bf4 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:31.863727 30484 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:31.869771 30451 consensus_peers.cc:597] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02b91286dc8d477e8ebec973b266b7f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.869956 30551 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.870029 30411 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.871388 31331 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.872035 31471 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.880283 31471 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.881705 30551 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.882308 30411 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.897480 30305 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.912521 30411 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:31.922623 30376 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82023e2c5e484095a622dab241c66cd3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.924445 30551 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.925118 30480 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.925944 31423 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.929170 31423 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.940155 31473 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.943846 30480 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.948612 30551 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:31.957945 30554 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:31.960655 30309 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:31.977985 30525 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7df93ef89d784f0bab73ca5a5d399cc0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.979804 30480 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.981215 31457 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.983752 30411 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:31.985168 31457 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.001552 31404 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.003050 30480 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.004809 30411 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.014525 30403 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.017537 30306 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.022572 30554 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:32.024916 31440 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:32.025463 30480 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:32.026728 31440 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:32.029644 30376 consensus_peers.cc:597] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f0025bdb2b44775bcdb4ec9702926aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.033844 31473 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.036211 30554 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.056659 30480 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:32.061791 30309 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.455484 31491 ts_tablet_manager.cc:933] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:32.459208 31491 tablet_copy_client.cc:323] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:32.463034 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 5f0025bdb2b44775bcdb4ec9702926aa from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:32.463542 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 5f0025bdb2b44775bcdb4ec9702926aa from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-5f0025bdb2b44775bcdb4ec9702926aa
I20260709 13:09:32.471640 30421 tablet_copy_source_session.cc:215] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:32.475706 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0025bdb2b44775bcdb4ec9702926aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.482511 31496 ts_tablet_manager.cc:933] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:09:32.491492 31496 tablet_copy_client.cc:323] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:09:32.494426 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 82023e2c5e484095a622dab241c66cd3 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:09:32.494973 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 82023e2c5e484095a622dab241c66cd3 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-82023e2c5e484095a622dab241c66cd3
I20260709 13:09:32.510540 30421 tablet_copy_source_session.cc:215] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:32.515393 31491 tablet_copy_client.cc:806] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:32.516139 31491 tablet_copy_client.cc:670] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:32.519057 31496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82023e2c5e484095a622dab241c66cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.519282 31498 ts_tablet_manager.cc:933] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:32.559489 31498 tablet_copy_client.cc:323] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:09:32.564884 31491 tablet_copy_client.cc:538] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:32.569396 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 02b91286dc8d477e8ebec973b266b7f0 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:09:32.570065 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 02b91286dc8d477e8ebec973b266b7f0 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-02b91286dc8d477e8ebec973b266b7f0
I20260709 13:09:32.570274 31502 ts_tablet_manager.cc:933] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:32.581445 31502 tablet_copy_client.cc:323] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:32.585424 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 7df93ef89d784f0bab73ca5a5d399cc0 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:32.586025 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 7df93ef89d784f0bab73ca5a5d399cc0 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-7df93ef89d784f0bab73ca5a5d399cc0
I20260709 13:09:32.589211 31491 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:32.593729 30570 tablet_copy_source_session.cc:215] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:32.582437 30496 tablet_copy_source_session.cc:215] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:32.608127 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df93ef89d784f0bab73ca5a5d399cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.609436 31498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b91286dc8d477e8ebec973b266b7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.630785 31496 tablet_copy_client.cc:806] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:32.631366 31496 tablet_copy_client.cc:670] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:32.635223 31496 tablet_copy_client.cc:538] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:32.635792 31498 tablet_copy_client.cc:806] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:32.636320 31498 tablet_copy_client.cc:670] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:32.640877 31498 tablet_copy_client.cc:538] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:32.644359 31502 tablet_copy_client.cc:806] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:32.646132 31502 tablet_copy_client.cc:670] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:32.656559 31502 tablet_copy_client.cc:538] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:32.668092 31498 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:32.668092 31496 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:32.671139 31502 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:32.680732 31491 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:32.681640 31491 tablet_bootstrap.cc:492] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:32.682302 31491 ts_tablet_manager.cc:1403] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.093s	user 0.037s	sys 0.007s
I20260709 13:09:32.697381 31491 raft_consensus.cc:359] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.698335 31491 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:32.699095 31491 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.713129 31496 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:32.715724 31496 tablet_bootstrap.cc:492] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:32.730165 31491 ts_tablet_manager.cc:1434] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.008s
I20260709 13:09:32.733456 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-5f0025bdb2b44775bcdb4ec9702926aa received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:32.733999 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-5f0025bdb2b44775bcdb4ec9702926aa on tablet 5f0025bdb2b44775bcdb4ec9702926aa with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:32.734879 31502 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:32.738451 31502 tablet_bootstrap.cc:492] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:32.737021 31498 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:32.738494 31496 ts_tablet_manager.cc:1403] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.006s
I20260709 13:09:32.739428 31502 ts_tablet_manager.cc:1403] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.009s
I20260709 13:09:32.743530 31496 raft_consensus.cc:359] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.744342 31496 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:32.745016 31502 raft_consensus.cc:359] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.745921 31502 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:32.746202 31498 tablet_bootstrap.cc:492] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:32.746928 31498 ts_tablet_manager.cc:1403] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.008s
I20260709 13:09:32.746789 31502 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.749464 31502 ts_tablet_manager.cc:1434] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:32.744983 31496 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.751789 31498 raft_consensus.cc:359] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.752321 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-7df93ef89d784f0bab73ca5a5d399cc0 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:32.752610 31498 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:32.752775 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-7df93ef89d784f0bab73ca5a5d399cc0 on tablet 7df93ef89d784f0bab73ca5a5d399cc0 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:32.753289 31498 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:32.757129 31498 ts_tablet_manager.cc:1434] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:32.762049 30496 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-02b91286dc8d477e8ebec973b266b7f0 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:09:32.762550 30496 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-02b91286dc8d477e8ebec973b266b7f0 on tablet 02b91286dc8d477e8ebec973b266b7f0 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:32.778362 31496 ts_tablet_manager.cc:1434] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.007s
I20260709 13:09:32.780036 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-82023e2c5e484095a622dab241c66cd3 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:09:32.780499 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-82023e2c5e484095a622dab241c66cd3 on tablet 82023e2c5e484095a622dab241c66cd3 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:32.886672 31152 raft_consensus.cc:1217] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:32.939747 31152 raft_consensus.cc:1217] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:33.027697 31152 raft_consensus.cc:1217] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:33.058732 31152 raft_consensus.cc:1217] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:09:33.349802 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08002892c0 after lost signal to thread 29283
W20260709 13:09:33.351441 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08002054a0 after lost signal to thread 30343
W20260709 13:09:33.352561 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800038840 after lost signal to thread 30435
W20260709 13:09:33.353447 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08002309e0 after lost signal to thread 30510
W20260709 13:09:33.354291 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08002f45a0 after lost signal to thread 30584
W20260709 13:09:33.356256 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800216220 after lost signal to thread 31180
I20260709 13:09:33.410919 31404 raft_consensus.cc:1064] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:33.413137 31404 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:33.432771 31152 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.434357 31500 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.447824 30403 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.451149 30484 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.459060 31331 raft_consensus.cc:1064] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:33.461261 31331 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:33.483420 31516 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:33.487522 31516 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.508330 31495 raft_consensus.cc:1064] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:33.518450 31516 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.524210 30484 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.529991 31473 raft_consensus.cc:1064] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:33.532433 31473 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:33.550313 30306 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.558145 31150 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.576834 31495 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:33.608162 31152 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.609478 31444 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.628795 30555 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.655591 31444 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.663761 30403 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.677403 31444 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.686657 31444 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.696529 30555 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:09:33.773100 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 63462.9us
I20260709 13:09:33.800873 31150 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.803812 30555 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.810801 30554 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.814586 30485 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.817453 31521 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:33.828173 31532 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:09:33.831372 31537 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:33.856321 30411 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:33.867936 30477 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.876053 31152 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:33.889722 31535 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:33.887214 31520 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:09:33.922049 31521 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:33.931628 31150 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.013815 31520 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.015280 31473 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.040221 30558 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.049437 30306 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.059686 30477 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.069056 30411 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.076900 30484 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.083370 30555 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:34.093070 31152 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.093649 31151 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.094436 31149 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.100682 30477 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:34.102823 31515 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:34.105214 30408 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.114718 30555 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.116825 31404 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.117451 30306 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.119189 30306 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.137101 31152 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.142666 31536 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:34.155272 31151 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.156759 31511 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.157570 30411 raft_consensus.cc:2955] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.164950 31444 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.171417 30408 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:34.172917 30405 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:34.167943 31151 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.170866 30555 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.184705 31153 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.188589 31153 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.188731 30484 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.190088 31473 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.190862 31541 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:34.195178 31520 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.208390 30558 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:34.209311 31520 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.211234 31539 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.217438 31521 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.219224 31511 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.225271 30484 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.221726 31153 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.234127 30558 raft_consensus.cc:2955] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.242422 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7df93ef89d784f0bab73ca5a5d399cc0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:34.243306 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f0025bdb2b44775bcdb4ec9702926aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:34.244169 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02b91286dc8d477e8ebec973b266b7f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:34.223544 31149 raft_consensus.cc:2955] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.261441 30555 raft_consensus.cc:2955] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.297518 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82023e2c5e484095a622dab241c66cd3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:34.308835 30309 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 3 to 4, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 1 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.313719 30307 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 3 to 4, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.338555 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b91286dc8d477e8ebec973b266b7f0 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53700
I20260709 13:09:34.344795 30305 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.347668 30305 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 3 to 4, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:34.353480 31551 tablet_replica.cc:333] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:09:34.354712 31551 raft_consensus.cc:2243] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.355876 31551 raft_consensus.cc:2272] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.360446 31551 ts_tablet_manager.cc:1916] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:34.362438 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0025bdb2b44775bcdb4ec9702926aa with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37990
I20260709 13:09:34.382290 31552 tablet_replica.cc:333] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:09:34.388239 31552 raft_consensus.cc:2243] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.389232 31552 raft_consensus.cc:2272] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.398900 31551 ts_tablet_manager.cc:1929] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:34.399469 31551 log.cc:1199] T 02b91286dc8d477e8ebec973b266b7f0 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/02b91286dc8d477e8ebec973b266b7f0
I20260709 13:09:34.399641 31552 ts_tablet_manager.cc:1916] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:34.401716 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 02b91286dc8d477e8ebec973b266b7f0 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:34.430186 31552 ts_tablet_manager.cc:1929] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:34.430778 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 82023e2c5e484095a622dab241c66cd3 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:34.434010 30473 tablet_service.cc:1558] Processing DeleteTablet for tablet 7df93ef89d784f0bab73ca5a5d399cc0 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34004
I20260709 13:09:34.439420 31552 log.cc:1199] T 5f0025bdb2b44775bcdb4ec9702926aa P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/5f0025bdb2b44775bcdb4ec9702926aa
I20260709 13:09:34.440054 31553 tablet_replica.cc:333] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:34.448446 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 5f0025bdb2b44775bcdb4ec9702926aa (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:34.448107 31553 raft_consensus.cc:2243] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.451135 31553 raft_consensus.cc:2272] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.456910 31553 ts_tablet_manager.cc:1916] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:34.476191 31553 ts_tablet_manager.cc:1929] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:34.476722 31553 log.cc:1199] T 82023e2c5e484095a622dab241c66cd3 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/82023e2c5e484095a622dab241c66cd3
I20260709 13:09:34.478557 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 82023e2c5e484095a622dab241c66cd3 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:34.479578 31553 tablet_replica.cc:333] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:09:34.480715 31553 raft_consensus.cc:2243] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:34.481585 31553 raft_consensus.cc:2272] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:34.486807 31553 ts_tablet_manager.cc:1916] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:34.499006 31553 ts_tablet_manager.cc:1929] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:34.499531 31553 log.cc:1199] T 7df93ef89d784f0bab73ca5a5d399cc0 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/7df93ef89d784f0bab73ca5a5d399cc0
I20260709 13:09:34.501363 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 7df93ef89d784f0bab73ca5a5d399cc0 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:09:35.749481 31556 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.749997 31556 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.752316 31556 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.754848 31556 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.755342 31556 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.758024 31556 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.797856 31564 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.798440 31556 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.806850 31559 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.807054 31556 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.807387 31559 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.809434 31559 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.809664 31556 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.809923 31559 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.811370 31558 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.811913 31558 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.814275 31557 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.814817 31561 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.814941 31557 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.815474 31561 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.817036 31557 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.817405 31561 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.818090 31557 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.818571 31557 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.814383 31558 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.810568 31564 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.810386 31559 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.815709 31560 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.825310 31560 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.825624 31557 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.826332 31565 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.826857 31565 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.830856 31557 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.830909 31560 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.831400 31557 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.834462 31565 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.835330 31557 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.839716 31559 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.821400 31564 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.806319 31562 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.848614 31562 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.850864 31558 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.851393 31558 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.853406 31558 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:35.856489 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:35.866972 31564 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.867559 31564 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.869460 31564 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.870050 31557 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.870563 31557 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.880501 31562 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.899660 31561 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.899755 31562 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.895865 31556 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.900599 31568 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.898651 31571 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.904842 31571 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.905550 31557 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:35.899693 31572 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.906216 31572 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.906993 31571 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.902381 31570 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.907536 31571 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.906210 31562 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.896672 31565 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.907666 31570 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.908001 31571 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.904299 31556 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.933485 31563 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.939339 31564 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.940536 31558 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.971897 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:35.933738 31565 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:35.934023 31561 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:35.962661 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:35.973664 31567 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:35.912300 31568 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.012373 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.013581 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.013852 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.014268 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.014894 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.015532 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.015818 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.016415 30403 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:36.003041 31557 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:35.979516 31558 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.023104 31574 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.025449 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.025740 31568 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.019200 31555 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.007639 31153 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:36.009949 31569 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.009164 31572 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:35.980506 31564 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.018791 31567 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.023687 31574 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.027962 31555 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.045809 31559 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.043196 31560 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.045678 31576 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:35.973996 31563 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.119292 31580 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.120012 31580 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.030041 31575 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.043157 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.043217 31573 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.043612 31572 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.032557 31557 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.048044 31559 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.122861 31560 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.143567 31574 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.123383 31562 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.146786 31572 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.151116 31567 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.151687 31567 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.152105 31567 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.152376 31566 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.157545 31579 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.157738 31585 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.149544 31571 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.159235 31562 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.156474 31570 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.159099 31556 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.140983 31576 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.043627 31569 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.173477 31580 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.158074 31579 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.183135 31580 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.173789 31581 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.187099 31590 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.189587 31588 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.153048 31566 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.174611 31564 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.175042 31570 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.165076 31577 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.165501 31565 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.164505 31561 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.134011 31575 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.148780 31573 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.187668 31590 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.183658 31580 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.176918 31560 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.168164 31571 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.172868 31562 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.174321 31559 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.190094 31588 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.197436 31567 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.158342 31585 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.237560 31558 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.237087 31583 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.236923 31578 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.235056 30407 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:36.323480 31563 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.278614 31594 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.347163 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.347965 31596 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.330726 31570 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.336340 31574 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.326900 31571 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.348501 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.244508 31584 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.272657 31587 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.271791 31595 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.336934 31555 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.346428 31557 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.349503 31579 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.348577 31596 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.369194 31559 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.366508 31571 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.379560 31592 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.380162 31592 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.381156 31570 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.381677 31570 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.361148 31561 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.377952 31587 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.236182 31581 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.358440 31574 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.374630 31575 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.369377 31582 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.365896 31595 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.376664 31567 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.366371 31600 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.369266 31591 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.408025 31562 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.408178 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.410719 31581 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.410775 31585 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.382810 31569 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.350333 31583 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.336684 31577 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.418462 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.374610 31598 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.379092 31559 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.387838 31586 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.404541 31576 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.414729 31599 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.361864 31578 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.408739 31570 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.356454 31594 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.377550 31584 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.415355 31572 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.613719 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.548825 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.596735 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.591909 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.428323 31571 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.428117 31567 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.619494 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.626361 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.618391 31566 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.620679 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.619903 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.414924 31579 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.630515 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.548815 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.592542 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.513685 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.408808 31561 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.614897 31598 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:36.676011 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 81477.2us
I20260709 13:09:36.661774 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.631340 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.666009 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.824826 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.631282 31149 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.828341 30551 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.836954 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.695127 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:36.682335 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.000s
I20260709 13:09:36.428228 31564 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.514557 31580 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.615902 31590 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.582334 31587 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.851329 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.513151 31595 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.548655 31597 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.428220 31554 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.515007 31592 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.612443 31601 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.423210 31560 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.684319 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.818606 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.639678 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.660916 31566 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.930322 31151 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.850605 31556 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.926904 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.873461 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.931797 30555 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.818192 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.439201 31562 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.913899 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.929947 31566 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.800125 31589 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:36.865938 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.006s	sys 0.009s
I20260709 13:09:36.777091 31584 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.630755 31563 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:36.740020 31559 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.738891 31567 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:36.660344 31588 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.871371 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.511096 31591 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.708051 31596 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:36.890858 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcaa0 after lost signal to thread 29283
I20260709 13:09:36.824201 31574 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:36.939090 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.934394 30554 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.939236 31562 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.850464 31150 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.507874 31600 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.510735 31582 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.856489 31579 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.941648 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.945982 31580 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.873026 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.946929 31598 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.927068 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.941582 31606 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.939461 31612 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.871174 31593 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:36.850932 30407 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.952361 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:36.937227 31560 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.834775 31573 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.953178 31562 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.934177 31556 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:36.954722 30524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.003s	sys 0.027s
W20260709 13:09:36.979202 30524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.003s	sys 0.029s
I20260709 13:09:36.865561 31564 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.948154 31559 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.940884 31587 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.951069 31588 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.690428 31571 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.970456 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.973616 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.974576 31561 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:36.975140 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd180 after lost signal to thread 30343
I20260709 13:09:36.955631 31604 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:36.927343 31570 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.948658 31563 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.689882 31586 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.776561 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:37.056620 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.964936 31580 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.059513 30555 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.075855 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.076613 30555 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:36.944473 31554 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.952416 31594 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.062685 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.064224 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.080250 30484 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.064062 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.975195 31606 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:36.656307 31599 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.065042 31602 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.064867 31588 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.081220 31149 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:37.066104 31556 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.066462 31579 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.980520 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:36.978228 31582 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:36.944864 31601 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.084945 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.072520 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.073472 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:36.972002 31612 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.082012 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.091595 30480 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:36.940670 31597 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.083999 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:37.084507 31568 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:37.061874 31559 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.060998 31587 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:36.965126 31589 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.108953 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.088688 30486 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.077991 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.083127 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.089205 30553 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.096773 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.080240 31557 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:37.100659 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9f60 after lost signal to thread 30435
I20260709 13:09:37.113215 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.110884 30555 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.098153 30485 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.111373 30477 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.053558 31593 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.118959 30551 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.113795 30484 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.125293 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.126145 30486 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.128583 31597 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.130683 31593 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:37.133713 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 292426us
I20260709 13:09:37.112185 31594 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.134593 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:37.107970 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 377348us
I20260709 13:09:37.115509 31566 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.112056 30556 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.109635 30559 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.141825 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.141757 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.142320 31588 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.142596 30486 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.146239 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.142899 31610 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.115768 31568 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:37.149608 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.006s	sys 0.038s
I20260709 13:09:37.093109 31602 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.136368 31594 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.116801 31557 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:37.151224 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.006s	sys 0.038s
W20260709 13:09:37.154842 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 825571us
W20260709 13:09:37.145515 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08003088c0 after lost signal to thread 30510
I20260709 13:09:37.153630 31586 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.155215 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.157896 30484 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.147146 31610 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.133759 31583 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.134227 31578 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.155072 31594 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.161522 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.077731 31604 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.164606 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:37.165930 31568 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.166496 31557 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.166851 31571 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.167208 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.167438 31559 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.167879 30559 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.170404 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.156431 31600 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.171244 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.185082 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.184196 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.171164 31563 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.184558 31557 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.195326 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.196139 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.197014 31598 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.197562 31602 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.198735 31599 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.177858 31580 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.200256 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.200460 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.200829 30558 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:37.202338 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:37.187527 31177 debug-util.cc:398] Leaking SignalData structure 0x7b0800208260 after lost signal to thread 30584
I20260709 13:09:37.184703 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:37.185818 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.207738 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.209805 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.199808 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.216521 31577 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.199649 31606 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.216949 31566 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.217409 31566 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.217808 31566 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.206856 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.219168 30559 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:37.220181 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.220368 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.212666 31602 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.221237 31602 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.221648 31602 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.227499 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.228374 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.229314 31566 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.212144 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.230355 30552 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:37.231673 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 134200us
I20260709 13:09:37.232882 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.233443 31601 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.233980 31601 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.234104 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.208324 31612 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.235011 31612 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.235327 31612 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.235653 31612 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.205149 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.238189 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.205859 31599 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.200477 31557 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:37.199496 31591 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.241762 31600 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.241149 31554 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.245755 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:37.245936 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.248399 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.250187 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.251019 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.248840 31580 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.251729 31580 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.252089 31580 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.254114 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.258713 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.258108 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.260363 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.260716 31604 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.261024 30559 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:37.243690 31557 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.263885 31560 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.242348 31599 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.252861 31567 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.252213 31610 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.265897 31567 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.265465 31599 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.266328 31567 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.255589 31601 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:37.258919 31177 debug-util.cc:398] Leaking SignalData structure 0x7b080024c1e0 after lost signal to thread 31180
I20260709 13:09:37.255905 31600 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.257723 31615 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.276983 31615 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.277127 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.277366 31615 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.258682 31598 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.277383 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.278671 30477 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:37.273497 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.273114 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.273263 31589 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.279794 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.276494 31606 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.280421 31564 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.280473 31606 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.281028 31606 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.281296 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.276460 31600 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.278909 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.237075 31602 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.283141 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:37.288362 31564 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.288753 31564 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.289119 31564 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.271103 31601 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.252442 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.264832 31587 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.286886 31600 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.260118 31566 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.294273 31601 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.296602 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.279178 31598 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.296626 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:37.298947 31561 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.299297 31561 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.299638 31561 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.299906 31598 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.311311 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.302934 31583 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.300637 31587 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.332293 31583 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.334061 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.305784 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.334859 30480 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:37.334336 31583 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.336112 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.316249 31566 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.341187 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.344280 30554 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.346668 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.349545 30411 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.336275 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.353310 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.348157 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.348685 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.354372 30405 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.351087 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.347503 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.354682 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.354766 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.352056 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.355968 31614 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.356102 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:37.356261 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.357605 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.343099 31571 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.360926 31571 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.361344 31571 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.362205 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.362491 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.363082 30555 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.337404 31566 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.365178 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.343145 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.346710 31597 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.367995 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:37.336833 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 84462.3us
I20260709 13:09:37.347177 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.374843 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.374893 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.375556 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.375710 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.375921 31602 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.366796 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.377286 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.376513 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.356559 31587 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.375319 31566 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.379684 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.401389 30480 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.380402 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.369854 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.385265 31606 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.386451 31601 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.387964 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.388260 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.388895 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.389524 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.390007 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.390084 31580 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.391120 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.420639 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.420962 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.421589 31588 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.421814 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.356500 31614 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.422483 31614 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.392027 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.392859 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.393378 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.393620 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.394980 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.398483 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.398820 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.376467 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.400538 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.398481 31587 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.394878 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.407457 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.408169 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.412245 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.431411 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.431684 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:37.431890 30523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.585s (SENT) [suppressed 1 similar messages]
I20260709 13:09:37.433292 31612 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.434890 30478 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:37.415594 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45848.7us
I20260709 13:09:37.401590 30407 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.425333 30556 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.416687 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.398363 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.418144 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:37.407471 31597 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.418144 31564 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.426657 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:37.428858 30408 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.422169 31588 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.426589 30482 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:37.439141 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.399008 30559 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:37.441488 30485 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.442924 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.429752 31587 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.466104 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.467020 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.438383 31559 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.476456 31559 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.476902 31559 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.408090 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.464391 31570 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.467609 31606 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.472401 31588 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.469530 31604 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.478072 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.480291 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.499523 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.501502 30481 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.502784 31596 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.502965 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.503599 31596 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:37.465085 31594 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.511281 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.512444 31594 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.512637 31605 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.513175 31605 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.513605 31601 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.481982 31562 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:37.506831 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 106977us
I20260709 13:09:37.508365 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.484380 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.509243 31591 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.509358 31561 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.479700 31595 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.534090 31595 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.534637 31595 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.504843 31588 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.490854 31570 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.516834 31562 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.523331 31580 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.524569 30552 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:37.542982 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 62747.9us
I20260709 13:09:37.543944 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.545477 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.532298 31605 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.502779 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.531695 31568 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.540153 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.526015 31148 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.548265 30406 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.554670 31568 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.549777 31594 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.556187 31594 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.556573 31594 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.556788 31568 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.546950 31612 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.547113 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.550920 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.527050 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.536742 31583 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.565068 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.536916 31614 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.567309 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:37.529259 31578 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.539580 31570 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.547345 31562 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.542266 31577 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:37.553218 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.553087 31567 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.553901 31580 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.535291 31557 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.556847 31566 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.539314 31564 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.559782 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.569576 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.568584 30479 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.583243 31561 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.539938 31588 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.542889 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:37.539476 31563 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.574575 31570 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.535995 31591 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.571532 31614 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.570964 31596 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.566458 31599 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.544503 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.574014 31583 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.585805 30484 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.539628 31584 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:37.587225 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 109203us
I20260709 13:09:37.589955 30555 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.586087 30402 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:37.577625 31580 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.620529 31580 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.620472 31584 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.587937 31588 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.600219 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55783.4us
I20260709 13:09:37.626296 30482 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.591233 31563 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.581234 31577 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.628116 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.611307 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.611159 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.618743 31599 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.619311 31567 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.619822 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.577962 31578 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.624157 30485 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.627018 30523 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.630493 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.642972 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:37.644939 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.639882 31574 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.651155 30484 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.651320 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.652251 30484 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.640655 31583 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.656414 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.656744 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.633019 31615 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.648699 31593 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.661800 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.662019 30484 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.653386 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.648811 31599 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.637288 31571 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.669267 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.646733 31598 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.675204 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.672096 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.653836 31567 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.650274 31574 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.674572 30551 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.677680 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.676286 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.658859 31583 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.681286 30480 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.673243 31612 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:09:37.675562 31579 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.687073 30477 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.683300 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.684370 30483 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.687587 30558 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.673866 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.685719 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.671484 31599 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.678733 31574 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.688944 30485 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.678438 31601 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.680691 31616 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.691248 31591 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.690378 30484 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.694200 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.685454 30450 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.695115 30477 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.695297 31578 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.697053 31557 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.697811 31617 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.693696 31599 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.686038 31583 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:37.667300 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131360us
I20260709 13:09:37.703327 30558 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:37.704993 31597 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.710829 31617 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.733197 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.715867 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.733485 31617 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.699934 31616 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.718981 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.719169 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.718644 31580 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.721328 31588 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.721568 31570 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.722630 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.722884 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.723455 31584 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.703198 31620 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.723567 30556 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:37.723472 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.724205 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.749043 30480 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.749398 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.726011 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.727653 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.723801 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.750213 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.728699 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.729269 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.729771 31615 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.756772 31563 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:37.728312 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 168625us
I20260709 13:09:37.757280 31617 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.757359 31559 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.733023 31597 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.758244 31597 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.717077 31560 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.734720 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:37.708451 31566 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:37.705506 31623 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.733376 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.710958 31577 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.731513 31598 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.745050 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.747534 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.764675 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.747574 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.736829 31616 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.738368 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.752938 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.755613 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.755721 31594 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.757684 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:37.770582 30552 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.770825 30478 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.760795 31560 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:37.771970 30482 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:37.771704 31600 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.772147 31560 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.772871 30486 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.732158 30551 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:37.759322 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.763365 31615 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.773741 31600 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.765674 30483 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.774487 30485 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.775890 31622 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.775537 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.776368 31599 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.777534 31622 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.777904 31622 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.778299 31599 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.766845 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.778420 31622 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.759526 31620 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.779893 30484 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.780131 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.781309 31570 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.781399 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.781931 31570 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.782312 31570 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.782675 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.782809 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.783941 31587 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.784698 31595 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.785528 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.786257 31615 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:37.786944 31559 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.787358 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.787127 31615 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.764159 31623 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:37.788205 31623 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.790398 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.778090 31574 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.767688 31617 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.782655 31570 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.796665 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.797617 31562 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.804128 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.804359 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.805109 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.805703 30554 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.805747 30552 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.806216 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.806799 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.806937 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.807351 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.808010 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.808157 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.808439 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.809036 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.804062 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.810179 30481 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.781944 31580 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.811709 31587 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.793015 31621 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.743934 31118 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.814103 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.813654 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.813009 31588 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.813865 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:37.818059 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:37.820461 31617 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.789846 31620 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.815587 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:37.825690 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.906808 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.891988 31571 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.828544 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.831418 31580 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.916541 31580 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:37.831224 31588 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.907490 31617 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:09:37.894254 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.907788 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.831029 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:37.900815 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 85322.1us
W20260709 13:09:37.920665 30525 consensus_peers.cc:597] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e1b5d40df944767ab310e2bd822d5b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.917006 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:37.921828 31617 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.917320 31588 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:37.917708 31557 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.922462 31557 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:37.891907 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.923444 31557 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.923969 31583 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.892601 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:37.924949 31557 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.926973 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:37.801779 31596 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.816625 31599 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.905974 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.952931 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:37.914332 31616 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.970013 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.970201 31147 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.971228 31616 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.917053 31580 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.843430 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.972126 31583 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.893834 31594 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.941562 31588 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.961989 31152 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.860213 31562 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:37.858938 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.893657 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:37.963908 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:37.952852 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:37.966251 31610 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:37.976164 30477 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:37.858464 31597 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:37.966092 31577 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:37.966480 31565 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:09:38.005306 30477 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.005427 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.005775 31565 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.006157 31565 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.006852 31574 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:38.007055 31565 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.007886 31577 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.978479 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.008546 31595 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.009045 31563 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.983572 31570 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.009429 31563 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.010260 31563 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.010895 31570 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:37.984450 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.011488 31563 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.984947 31148 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.985385 31153 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:37.987918 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.015095 30477 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:37.989740 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:37.986616 31151 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.016322 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.016830 31561 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.017246 31561 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.017457 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.018162 31593 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:37.991153 31589 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.018090 31561 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.019158 31561 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.987527 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:37.992240 31610 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:37.996224 31620 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.998484 31623 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:37.999357 31606 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:37.999936 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 106357us
I20260709 13:09:37.998638 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.001425 31617 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.008355 31565 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.983276 31560 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.010720 31597 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:37.948287 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 212083us
I20260709 13:09:38.013242 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:38.018556 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.052611 31152 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:38.021313 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.027104 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.027822 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.032642 31153 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.033826 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.056293 30484 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.036769 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.039192 30483 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.057286 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.039717 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.038764 31589 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.041636 31150 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:38.057983 30483 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.058143 30480 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.041875 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:38.042104 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.041633 31586 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.043220 31151 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.016867 31555 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.032502 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.043838 31610 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.065838 31617 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:38.048063 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58413us
I20260709 13:09:38.048717 31148 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.011538 31622 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.049305 31584 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.060588 31568 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:09:38.072546 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.072649 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.072736 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.073271 30403 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.074951 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:38.052853 31580 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:38.076224 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.051465 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.046378 31588 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.020886 31574 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.056087 31591 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:09:38.055377 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.059262 30485 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.078333 31597 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:38.077729 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.079092 31149 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.079566 31597 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.079703 31555 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.079746 31588 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.080068 31597 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:38.059156 30480 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.080983 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.079777 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.058816 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.061003 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.063870 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.082557 30483 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.058385 31589 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.065623 30478 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.056044 31575 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.041010 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.067978 31578 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.066432 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.070182 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.055662 31569 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:38.084435 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:09:38.245093 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.291927 30403 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:38.083474 31589 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.083827 30479 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.091585 31595 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:38.275786 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 211955us
W20260709 13:09:38.302801 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 217844us
I20260709 13:09:38.315969 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.352782 31629 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.353670 31629 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.364522 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.299472 31617 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.387706 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71844.6us
I20260709 13:09:38.388988 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.390281 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.366219 31575 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.382754 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.386590 31584 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.407413 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.412745 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.414079 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.400677 31147 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.397516 31598 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.406440 31595 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:38.408566 31601 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.407738 31584 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.409777 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.436715 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.433624 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.435559 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.429520 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.424229 31604 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.421126 31621 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.443526 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.445153 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.450531 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.406929 31597 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.441078 31153 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.427237 31580 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.427932 31602 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.402421 31589 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.449033 31622 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.439214 31620 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:38.453922 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.443457 31623 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.449465 31570 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.458593 31568 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.457633 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:38.468626 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 327098us
I20260709 13:09:38.470302 30482 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:38.447997 31588 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:38.474123 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 389791us
I20260709 13:09:38.473907 31562 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.456099 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.471192 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.484676 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:38.480158 31555 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.503398 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.477270 31610 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.482414 31568 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.501888 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.509850 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.468509 31595 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.500053 31589 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.511199 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.510169 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.469206 31584 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.513273 31588 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.515041 31636 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:38.508152 31562 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.517599 31633 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.518626 31150 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:38.522467 31633 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.522207 31565 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:38.523527 31565 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.523892 31565 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.526083 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.526865 30485 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:38.508533 31630 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:38.525956 31628 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:38.529532 31610 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:38.516448 31146 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.530074 31633 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.524705 31565 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.530470 31633 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.531095 31565 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.531399 31633 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.531723 31568 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.532866 31633 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.516973 31570 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.527135 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.548447 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.556289 31632 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:09:38.564368 31574 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.564813 31574 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.565768 31574 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.571523 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:38.575431 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48418.1us
I20260709 13:09:38.576393 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.576607 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.577724 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.582326 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:38.583767 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.588050 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.590341 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.590515 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.547430 31554 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.525415 31563 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:38.544114 31628 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:38.597388 31631 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.598030 31610 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.600363 30410 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.547165 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:38.602849 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.603751 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.604463 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:38.600951 31554 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.629103 31554 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.607290 31574 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:38.594515 31557 consensus_queue.cc:1175] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0472fa7187444a91b443058ef89fceb9" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:09:38.587889 31579 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.587496 31614 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.549088 31638 consensus_queue.cc:1175] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "19556a24b91d452d98668a3709fbc29d" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:38.602329 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:38.587221 31570 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.620185 31637 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:09:38.588932 31589 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.601740 31615 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.648501 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.635299 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.633877 31554 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.651525 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:38.646544 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 330653us
I20260709 13:09:38.653755 30523 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.655174 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.656729 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.647110 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.657722 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.653270 31153 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:38.650321 31614 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:38.667032 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.661396 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.671855 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.666060 31565 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.666370 31575 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.685398 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:38.685107 30554 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:38.689260 30484 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.689811 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:38.690393 31644 ts_tablet_manager.cc:933] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:38.675298 31636 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:09:38.675413 31615 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:09:38.668553 31612 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.671458 31595 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.671943 31591 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.708354 31640 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.709558 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.710976 31615 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.723637 31615 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:38.724700 31615 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.726183 31615 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.670616 31610 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:09:38.727413 31610 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.727828 31610 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.728844 31610 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.730110 30410 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:38.711244 31555 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.711264 31153 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.713059 31639 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.691682 31635 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.706149 31579 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.737021 30558 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:38.715250 31591 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.741289 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.739166 31639 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.737841 31578 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:38.730403 31610 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.734725 31555 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.751459 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.759910 30559 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
W20260709 13:09:38.761812 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 242944us
I20260709 13:09:38.751617 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:38.759243 31557 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:09:38.750766 31578 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:38.747798 31639 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.775486 31646 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.780797 30554 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:38.781950 30551 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:38.784174 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.786548 30554 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.788968 30554 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.794062 31569 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.794554 31569 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.795511 31569 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.796075 31640 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.796885 31569 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.786651 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:38.772220 31578 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.762807 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.787235 31563 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.811947 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.798005 31591 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.804979 31639 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.834673 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:38.814397 31563 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.830994 31570 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.832260 31595 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.867062 31642 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:09:38.800161 31555 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.809347 31637 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:09:38.867251 31649 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:09:38.841480 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 91072.5us
I20260709 13:09:38.835978 31612 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:09:38.854934 31560 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.839414 31606 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:38.845387 31602 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:38.868570 31591 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.898674 31634 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.881690 31637 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.911263 31646 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.911865 31646 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.913062 31646 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.914682 31646 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:38.932556 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 330307us
I20260709 13:09:38.908891 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:38.880463 31563 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.940373 31652 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.940754 31151 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:38.940984 31563 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.942476 31638 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:38.942966 31595 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.943379 31595 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:38.944233 31595 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.945501 31595 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.947456 31561 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:38.910151 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:38.952136 31570 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.943655 31638 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:09:38.953469 31636 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.953871 31636 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.947638 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:38.954756 31636 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:38.955966 31636 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.956118 31630 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.956496 31630 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.954262 31638 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.909129 31560 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:38.931073 31634 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.969197 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:38.965880 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.968818 31632 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.936969 31649 consensus_queue.cc:1243] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:38.975153 31632 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.975513 31649 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.978452 31649 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:09:38.970165 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68457.2us
I20260709 13:09:38.957700 31638 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.939666 31555 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:39.007031 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.017127 31560 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:38.940757 31652 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.957257 31630 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.022805 31577 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.028658 31584 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.036283 31589 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:39.039011 31565 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.042429 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.983091 31644 tablet_copy_client.cc:323] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
W20260709 13:09:39.061403 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.067866 31640 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.979429 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:39.047925 31577 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:39.077101 31570 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.077275 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 97954.4us
I20260709 13:09:39.078197 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:39.079201 31570 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.079672 31118 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:39.079751 31642 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.080415 31642 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:39.080605 31570 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.081060 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.081303 31642 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.082059 31570 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:39.085234 31641 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.085807 31641 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:38.979341 31649 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:39.091065 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.091616 31649 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.097036 31640 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.097555 31640 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:38.978816 31632 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.061841 31630 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.040767 31634 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:39.125177 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.126217 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.082516 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.129221 31575 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.132287 31577 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.123605 31652 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.133997 30557 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:39.135131 30552 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.137249 30305 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.148679 30305 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.150221 30305 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.151665 30305 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.133181 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.156812 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:39.160874 31586 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.162456 30552 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.164151 31568 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.130205 31642 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.167855 31641 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.169090 31641 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.100383 31640 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.170778 31570 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.138406 31634 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:39.174284 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.174016 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 387476us
W20260709 13:09:39.182322 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.182725 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.182622 30480 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:39.141966 31577 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.143175 31652 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:39.194610 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.195308 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.195787 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.104863 31638 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.180922 31597 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:39.139005 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56571us
I20260709 13:09:39.207418 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:39.208472 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.196547 31630 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:39.209450 31630 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.211627 31630 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.200704 31637 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.208868 30410 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:39.212237 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:39.213302 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.180521 31559 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:09:39.221925 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 287479us
I20260709 13:09:39.180723 31600 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:09:39.226367 30411 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.222183 31570 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.218384 31637 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:39.220635 31597 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:39.178263 31635 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:09:39.234375 31569 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:39.248548 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.251643 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.227814 31630 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:39.257711 31597 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.260244 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:39.261266 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.263057 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.269531 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.269738 31151 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:39.269577 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.270604 31606 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.262394 31569 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.281448 30406 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.274147 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.326556 30552 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:09:39.327593 31578 consensus_meta.cc:287] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 13:09:39.335564 31569 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.338418 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:39.370460 30482 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.254575 31637 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:39.346057 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.322646 31570 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:09:39.374804 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.338521 31661 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.372659 31578 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.407179 31640 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.408408 31578 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:39.409093 30403 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:39.409500 31591 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.409871 31591 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:39.410610 31591 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.411741 31591 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.413923 31661 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:09:39.420625 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.394276 31660 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:39.421236 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 172769us
I20260709 13:09:39.424926 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 2e1b5d40df944767ab310e2bd822d5b0 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:39.426384 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.427471 31570 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.431246 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 2e1b5d40df944767ab310e2bd822d5b0 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-2e1b5d40df944767ab310e2bd822d5b0
I20260709 13:09:39.414942 31555 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:39.419806 31661 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:39.435258 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 183367us
W20260709 13:09:39.448271 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 144387us
I20260709 13:09:39.449054 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:39.453346 31591 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.453884 31591 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.454519 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.456228 31591 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.458738 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:39.459084 31598 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.459415 30479 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.421526 31575 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:39.461279 31575 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.433796 31633 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.469897 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.460194 31610 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:39.461602 31575 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:39.471851 31636 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.463811 31654 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.477692 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.448398 31555 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.487736 31566 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.488345 31566 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.484014 31641 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.471957 31633 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:39.503679 31633 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.511227 31575 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.513067 31575 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.514837 30408 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.515933 31555 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:39.516710 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.521339 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:39.522243 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:39.523108 31653 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.523456 31653 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:39.523821 31653 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.483734 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.526921 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:39.527518 30411 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:39.528885 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:39.530930 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47289.6us
I20260709 13:09:39.532063 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:39.533608 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.535055 31654 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:39.535101 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:39.535507 31654 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.537721 31151 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:39.538430 31654 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.538846 31650 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.542040 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.530181 31566 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.536161 31632 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.536604 31591 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.536825 31554 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.546025 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0efe22046955442f80d17ac45b08253b"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:39.556497 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.559990 30551 raft_consensus.cc:606] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.560491 30551 raft_consensus.cc:614] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.569363 31637 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.565845 30376 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.562201 31554 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:39.563503 31650 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.584635 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.630651 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:39.634156 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49583.1us
I20260709 13:09:39.635241 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:39.592216 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.638173 30551 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:39.561439 31660 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:39.597379 31640 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:39.641165 31640 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.643824 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:39.622679 31555 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.637010 31642 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.649348 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:39.583781 31554 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.638213 31578 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.591415 30557 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.591508 31641 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:39.578050 31600 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:39.649672 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:39.658545 30411 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:39.659713 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:39.657428 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.663061 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.656903 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:39.663753 31591 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.664016 31153 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:39.660879 30480 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:39.588418 31577 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.652694 31560 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.682216 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:39.669150 31641 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.671581 31565 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.651898 31555 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.670563 31591 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.670241 31640 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:39.657822 31653 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.706753 31653 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.670923 31600 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.698525 31621 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:39.698081 31565 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:39.700913 31560 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.699692 31577 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.720600 31621 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.707928 31638 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.722185 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.745966 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.708141 31660 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.723407 31565 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.743201 31654 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.726656 31621 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.747169 31591 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.776010 31653 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.728437 31577 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.727538 31560 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.776234 31641 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.788262 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.806105 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:39.791188 31653 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.815075 31650 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.815991 31591 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.816468 31591 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:39.818460 31591 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:39.827168 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.828342 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:39.829567 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.832468 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.825470 31600 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:39.830981 31638 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.832371 31591 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.865079 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.866354 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:39.864125 30308 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 2 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.872481 30480 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.872956 30406 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.839551 31650 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.825863 31653 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:39.875473 30558 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:39.875061 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.868103 30408 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:39.876195 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.873814 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:39.880745 30560 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.868466 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:39.881479 30485 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.877169 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.882951 30555 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:39.878108 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.879587 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:39.894675 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.895462 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:39.899127 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:39.861191 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:39.847167 31612 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:09:39.906458 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.878770 31650 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:39.899544 31591 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.894441 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:39.901484 30552 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:39.876012 31600 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:39.894558 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:39.983526 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:39.999496 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 93099.4us
I20260709 13:09:39.884933 31606 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:40.008705 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.917331 31650 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:39.983148 31667 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:09:40.017457 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:39.982436 31597 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.021572 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.019801 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.039413 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.041553 31149 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.042121 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.011139 31641 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.012264 31638 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.064821 31638 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:40.065315 31638 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.010473 30404 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.041517 31561 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.058413 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.041659 31652 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.072343 30405 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.069031 31149 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.067571 31653 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.010022 31591 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.022475 31642 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.045499 31560 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.079267 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:40.079547 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:09:40.047521 31636 consensus_meta.cc:287] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.005s
I20260709 13:09:40.045439 31615 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.087188 31555 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.068711 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.087283 31615 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.088003 30552 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.089401 31615 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:40.061718 31677 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:09:40.061064 31670 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:09:40.084125 30558 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.079002 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.058538 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.069424 31632 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.045691 31577 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.099609 31153 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
W20260709 13:09:40.100003 31673 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:09:40.101898 31591 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.082489 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.140450 30556 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.095746 31653 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.141469 31653 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.141875 31653 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.105157 30558 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.106849 30552 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.096748 31565 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.107348 30559 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.147987 31654 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.148922 31565 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.092372 31636 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.150372 31653 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:40.151993 31671 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.299s	user 0.004s	sys 0.000s
I20260709 13:09:40.133329 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:40.152823 30555 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:40.153182 31653 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:40.154076 31674 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.003s
I20260709 13:09:40.111629 31570 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:40.154963 31570 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.157519 31570 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.162220 31632 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.042277 31597 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.107971 30557 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.162315 31554 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.165536 31554 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:40.146665 31610 consensus_meta.cc:287] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.002s
I20260709 13:09:40.154402 31650 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.173257 31597 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.186259 31610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53476 (request call id 7) took 3132 ms. Trace:
I20260709 13:09:40.162220 31621 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.186048 31638 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.187469 31650 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.217648 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.222295 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.224140 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 899) took 1001 ms. Trace:
I20260709 13:09:40.226253 30407 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.225750 30405 rpcz_store.cc:276] 0709 13:09:39.223083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.223810 (+   727us) service_pool.cc:224] Handling call
0709 13:09:39.234210 (+ 10400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.072734 (+838524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.223617 (+150883us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54003edd54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:40.223954 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921775360}
I20260709 13:09:40.224710 30404 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.228101 30409 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:40.228790 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.229833 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.234135 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:40.237136 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:09:40.239359 30411 raft_consensus.cc:606] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:40.239948 30411 raft_consensus.cc:614] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:40.249431 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.250759 30477 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:40.254045 30409 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.256366 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.257321 30478 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.259523 30479 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.264552 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.271693 30479 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.272751 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.276068 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.280121 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.281951 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.283385 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.286384 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:40.287370 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:40.288766 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.289798 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.277299 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.290558 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.291451 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.295233 30557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:40.308243 30483 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.308727 31152 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.309391 31641 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.310292 31641 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.310674 31641 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.311054 31641 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.311173 31149 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.304045 30557 raft_consensus.cc:606] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.312353 30557 raft_consensus.cc:614] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:40.312929 31621 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.313948 30480 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.315812 31642 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.316370 31559 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.316588 31642 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.317149 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.315613 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:40.317200 31559 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.304322 31146 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:40.321633 30558 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:40.322279 30482 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:40.323853 31579 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.323916 31595 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.332707 31153 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.332247 30405 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.342891 31579 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.345114 31152 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.345381 31579 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.347191 31600 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.346899 31554 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.347795 31600 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.346937 31559 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.350095 31559 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.350164 31600 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.350513 31559 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:40.350971 31559 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.354993 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.355367 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:40.355952 30555 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.358018 31660 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.358714 31660 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.359982 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.361055 31660 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.363235 30557 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.364480 31628 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.365067 31628 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.365324 31621 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.365517 31628 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.366132 31621 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.368644 31621 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.369880 31640 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.370582 31640 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.372887 31640 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.356148 30560 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.373477 31661 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:40.375223 31598 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.375811 31598 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.381733 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.381947 31570 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:40.383391 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.386528 31554 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:40.387499 31554 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.389395 30551 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:40.389782 31565 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.390151 31591 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.390722 31554 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.390810 31591 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.391906 31641 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.390542 31565 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.393275 31591 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.400288 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.401368 31146 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.377866 31598 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.186875 31610 rpcz_store.cc:276] 0709 13:09:37.055471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.058569 (+  3098us) service_pool.cc:224] Handling call
0709 13:09:37.284845 (+226276us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4c00069380. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa043375a20 00007fa043386a29 00007fa04334c644 00007fa043373f2d 00007fa043373b93 00007fa0450021af 00007fa045001f3e 00007fa045087888 00007fa0450a475c 00007fa0450a576a 00007fa0450a491b
0709 13:09:37.332353 (+ 47508us) log.cc:844] Serialized 499 byte log entry
0709 13:09:37.509252 (+176899us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b180005af40. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa048f7d58f 00007fa041fbc571 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd
0709 13:09:37.560500 (+ 51248us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180005af40. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b1a0a 00007fa0439b1693 00007fa0439b1631
0709 13:09:37.650912 (+ 90412us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54001ad4a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045022142 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354 000000000038f199 00007fa041fbc475
0709 13:09:40.186166 (+2535254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18969,"raft.queue_time_us":106660,"raft.run_cpu_time_us":16094,"raft.run_wall_time_us":313166,"spinlock_wait_cycles":98177152,"thread_start_us":62552,"threads_started":1,"wal-append.queue_time_us":102741,"wal-append.run_cpu_time_us":2536,"wal-append.run_wall_time_us":1103024}
I20260709 13:09:40.405277 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.406397 31152 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.411691 31636 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.412290 31636 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:40.412756 31636 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.385027 31628 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.415199 30554 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:40.415743 31595 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.418179 31595 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.434919 30557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567508f2962f473b8fac20c97a240f35"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:40.435853 30557 raft_consensus.cc:606] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.440514 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.441511 30405 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.444150 31640 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.444839 31640 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.446973 31610 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.447731 31610 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.452659 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.453845 31661 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.454285 31661 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:40.454881 31661 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.461261 31577 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:40.461652 31578 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.461886 31652 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.468194 30560 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:40.465322 30552 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.486172 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.461351 31653 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:40.481562 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 163661us
I20260709 13:09:40.504400 31601 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.506349 31601 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.504647 30479 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:40.422780 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131577us
I20260709 13:09:40.462564 31652 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.513384 31610 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.513741 31591 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.514369 31701 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:40.514541 31591 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.516463 31565 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.516873 31586 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.517123 31591 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.517661 31591 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.517426 31586 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.518011 31635 raft_consensus.cc:993] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: : Instructing follower 19556a24b91d452d98668a3709fbc29d to start an election
I20260709 13:09:40.520242 31586 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.521029 31654 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.521289 31702 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.521781 31654 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.521991 31702 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.522958 31703 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.523573 31703 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.524222 31654 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.524446 31702 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.524909 31570 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:40.525637 31703 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.513829 31601 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.528779 31642 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.518308 31591 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.528903 31640 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.529423 31653 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.538228 30570 tablet_copy_source_session.cc:215] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:40.539278 30557 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.539194 31653 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.539754 30570 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:53492 (request call id 42) took 1115 ms. Trace:
I20260709 13:09:40.462494 31578 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.544020 31628 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.544673 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.545460 30404 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:40.546077 31638 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.542500 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.530875 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.532207 31652 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.532163 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.518545 31635 raft_consensus.cc:1081] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Signalling peer 19556a24b91d452d98668a3709fbc29d to start an election
I20260709 13:09:40.503119 31641 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:40.541092 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 209973us
I20260709 13:09:40.541285 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 186) took 1147 ms. Trace:
I20260709 13:09:40.528903 30552 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:40.549018 31152 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:40.544148 31578 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.534796 31660 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.552925 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.551554 30309 rpcz_store.cc:276] 0709 13:09:39.393822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.393930 (+   108us) service_pool.cc:224] Handling call
0709 13:09:40.541070 (+1147140us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:09:40.554395 30482 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
W20260709 13:09:40.556913 30485 consensus_meta.cc:287] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.011s
I20260709 13:09:40.557387 30485 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.560750 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.540123 30570 rpcz_store.cc:276] 0709 13:09:39.424451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.424743 (+   292us) service_pool.cc:224] Handling call
0709 13:09:40.409852 (+985109us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400185954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450b33f7 00007fa04a049036 00007fa04a052a3e 00007fa04191627b 00007fa04a0529ba 00007fa04a04dacc 00007fa04a048c7b 00007fa04a03d8d1 00007fa0490f14b4 00007fa0490f1442
0709 13:09:40.539647 (+129795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140827904}
I20260709 13:09:40.562641 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.554049 31702 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.556149 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.567830 31146 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.564154 31701 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.571194 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.571025 31701 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.571950 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.572795 31703 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.577889 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.578801 31152 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.578006 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:40.579826 30410 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.582147 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.583086 31555 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.585868 31691 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.586210 31555 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:40.586402 31691 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.564476 31638 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.587004 31691 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.587234 31638 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.563321 30479 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:40.590226 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.591341 30560 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.587433 31555 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.594764 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.595372 31707 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.595985 31707 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.596395 31707 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.593494 31598 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.594038 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.595451 30551 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.593712 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.577049 31660 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.603816 30558 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:40.602512 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:40.605947 30411 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.607628 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:40.615075 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:40.615131 31606 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:09:40.616462 31660 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.617902 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.620260 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.620797 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.621037 30479 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.621587 31641 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:40.622120 31641 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.623080 31641 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.624418 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.625011 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.625761 30479 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.613842 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.629187 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.630064 30484 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:40.629974 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.633203 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:40.630761 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.635376 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.638845 30560 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.640601 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.641170 30486 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.642102 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.642680 30484 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.643635 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.644675 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.646965 31589 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.647539 31589 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:40.648567 31589 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.651202 31638 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.657196 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:40.634158 31153 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.658423 31570 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:40.659055 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.659616 31701 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.660338 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:40.660717 30305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 197) took 1798 ms. Trace:
I20260709 13:09:40.660892 30558 raft_consensus.cc:606] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.661273 30558 raft_consensus.cc:614] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:40.608263 31598 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.659649 30405 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:40.665194 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59628.3us
I20260709 13:09:40.667619 31152 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
W20260709 13:09:40.669021 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 66339.2us
I20260709 13:09:40.669916 31578 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.625023 31146 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.670526 31564 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:40.670943 31564 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.671294 31564 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.674988 31604 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.675376 31604 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.675709 31604 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.603446 31559 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.685177 31559 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.637967 31660 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.685794 31559 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.626602 31702 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.686496 31559 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.685813 31598 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.683001 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.688625 30405 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.688748 31702 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.689311 31149 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.685976 31660 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.690964 31660 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.692890 31644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1b5d40df944767ab310e2bd822d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.694330 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.696866 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.705106 31578 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.707508 31578 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.712044 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:40.713301 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44605.5us
I20260709 13:09:40.639230 31606 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.704219 31636 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.710815 31702 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:40.717338 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.719329 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.720096 31652 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.721050 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.722020 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.723464 31591 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:40.726998 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 58505.3us
I20260709 13:09:40.727118 30410 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:40.729223 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:40.730741 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 95801.2us
I20260709 13:09:40.732045 30411 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:40.733282 30408 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:40.661041 30305 rpcz_store.cc:276] 0709 13:09:38.862185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.862356 (+   171us) service_pool.cc:224] Handling call
0709 13:09:40.660545 (+1798189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:39.338776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:39.411257 (+ 72481us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:39.411304 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:09:39.411327 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:39.433255 (+ 21928us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:39.433327 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:39.433356 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:39.433717 (+   361us) tablet.cc:701] Row locks acquired
0709 13:09:39.433739 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:09:39.451831 (+ 18092us) write_op.cc:270] Start()
0709 13:09:39.463769 (+ 11938us) write_op.cc:276] Timestamp: P: 1783602579448237 usec, L: 0
0709 13:09:39.466941 (+  3172us) op_driver.cc:348] REPLICATION: starting
0709 13:09:39.482651 (+ 15710us) log.cc:844] Serialized 1689 byte log entry
0709 13:09:40.188629 (+705978us) op_driver.cc:464] REPLICATION: finished
0709 13:09:40.190123 (+  1494us) write_op.cc:301] APPLY: starting
0709 13:09:40.190199 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:40.190343 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:40.190479 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:40.191336 (+   857us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:40.191584 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:09:40.191634 (+    50us) write_op.cc:312] APPLY: finished
0709 13:09:40.382152 (+190518us) log.cc:844] Serialized 40 byte log entry
0709 13:09:40.382445 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:40.382594 (+   149us) write_op.cc:454] Released schema lock
0709 13:09:40.382655 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:40.383289 (+   634us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:40.383321 (+    32us) write_op.cc:454] Released schema lock
0709 13:09:40.407597 (+ 24276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:40.407637 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140600,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":1296,"apply.run_cpu_time_us":3448,"apply.run_wall_time_us":193046,"num_ops":4,"prepare.queue_time_us":91406,"prepare.run_cpu_time_us":105461,"prepare.run_wall_time_us":507748,"raft.queue_time_us":50864,"raft.run_cpu_time_us":7017,"raft.run_wall_time_us":219454,"replication_time_us":721538,"spinlock_wait_cycles":24320,"thread_start_us":428392,"threads_started":4,"wal-append.queue_time_us":402727}]]}
I20260709 13:09:40.737619 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.742134 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.743160 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.744167 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.747792 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:40.747738 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:40.740684 31566 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:09:40.749083 31149 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.746513 31591 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:40.740989 31652 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.750079 30403 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:40.750252 31591 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.750715 31591 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.751775 31652 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.730012 31703 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.757602 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:40.757673 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44145.4us
I20260709 13:09:40.755318 31653 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.760402 31653 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.760835 31653 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.738881 30407 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:40.760519 30309 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 2 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.756758 31652 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.764396 31652 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.764859 31652 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.763065 30309 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 2 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.765945 31560 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:40.766382 31560 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.752512 31703 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.766770 31560 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.777233 31703 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.779910 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.755616 31610 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:40.784147 31610 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:40.784219 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.784768 31650 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.785284 31610 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.786759 31661 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.788415 31642 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.783586 31559 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.734282 31604 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.795257 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.797717 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:40.798496 30485 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:40.768268 31635 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:40.796628 31701 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.801681 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.808858 31146 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.808600 31701 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.785285 31650 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.810289 31650 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.812374 31604 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.803668 30484 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.788918 31642 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.806469 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.805529 31635 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.754058 31606 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.818725 31701 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.821938 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:40.822832 31146 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.823328 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:40.826110 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.788656 31653 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.830410 31654 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.831024 31661 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.832760 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:40.836880 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44119.5us
I20260709 13:09:40.836925 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.817514 31642 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.856515 30551 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:40.838660 31601 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.819020 31635 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.861033 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.870033 31596 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:40.870666 31596 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:40.872897 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.873840 30409 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:40.873835 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.874612 30407 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.871778 31596 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.876183 31606 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.877432 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.855888 31577 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:09:40.883286 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.884951 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.885635 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.886260 30407 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:40.889447 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:40.839126 31654 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.896324 31654 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.860917 31601 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.895530 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.898723 30483 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:40.900116 31602 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:40.900774 31602 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.904184 31636 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.904374 31602 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.905855 31591 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.915086 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:40.916229 31152 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:40.913692 31642 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.914397 30479 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.925482 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.941759 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.942463 30483 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.942868 31598 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:40.943432 31598 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.943866 31598 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.945403 31653 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.946367 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:40.947182 30485 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.947500 31564 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.949520 31564 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.950181 30409 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:40.952000 31652 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.952363 31598 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.954016 31652 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.897051 31601 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.954321 30485 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.955770 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.956597 31652 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:40.957099 31652 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:40.958217 31652 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.960403 31660 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.972167 31149 raft_consensus.cc:2368] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:40.962529 31660 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.966409 30483 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:40.971153 30305 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 2, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.987092 30305 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 1 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.988126 30479 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:40.988417 30451 leader_election.cc:400] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:40.988746 30451 leader_election.cc:403] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.989447 31564 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.989753 31591 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.993623 31560 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.962904 31691 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.996070 31560 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.996734 31691 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:40.998251 31707 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:40.999529 31151 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:41.000473 31707 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:40.989360 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:41.001575 30554 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:41.014868 31591 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:41.014424 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:40.991282 31601 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:40.976187 31598 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:40.994359 31635 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.013162 31653 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.016614 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:41.026314 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:41.002684 31654 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.083681 31601 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:41.093286 31564 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:41.013712 31642 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:41.034005 31636 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.113746 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:41.113969 31640 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:41.115756 30403 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:41.133325 30411 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:41.143579 31636 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:41.144830 31636 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.099872 31653 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:41.146909 31653 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.152954 31635 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:41.168089 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:41.107221 31151 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:41.168870 30411 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.140707 30479 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:41.199512 30552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.019s	sys 0.037s
W20260709 13:09:41.215476 30552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.020s	sys 0.037s
I20260709 13:09:41.153620 31640 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.197901 31146 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
W20260709 13:09:41.238329 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.002s	sys 0.030s
W20260709 13:09:41.241751 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.002s	sys 0.030s
W20260709 13:09:41.236766 31117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.029s	sys 0.038s
I20260709 13:09:41.246622 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:41.243343 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 495604us
W20260709 13:09:41.242465 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 609952us
I20260709 13:09:41.252856 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:41.255414 30405 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:41.234458 31564 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:41.239468 31555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.017s	sys 0.025s
I20260709 13:09:41.254235 30408 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:41.255200 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:41.255682 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:41.264858 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:41.291958 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:41.292883 30405 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:41.294590 31146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "567508f2962f473b8fac20c97a240f35"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:43936
W20260709 13:09:41.256085 31117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.030s	sys 0.039s
W20260709 13:09:41.259670 31555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.018s	sys 0.027s
W20260709 13:09:41.310504 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 45762.2us
I20260709 13:09:41.321539 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:41.321856 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:41.323026 31152 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:09:41.314786 31578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.013s	sys 0.016s
I20260709 13:09:41.320559 30411 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:41.336349 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:41.303563 31564 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.314226 31146 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.317220 31559 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.308320 31660 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:41.358305 31578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.015s	sys 0.017s
I20260709 13:09:41.356096 31601 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.372509 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:41.373315 31153 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:41.373885 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:41.374586 31150 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.375385 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:41.376267 31148 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:41.363426 31146 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:41.382944 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 127920us
I20260709 13:09:41.384228 31610 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.384634 31610 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.384706 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:41.385053 31610 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.370198 31559 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:41.386823 31559 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:41.387511 30525 consensus_peers.cc:597] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba4c05796efa42489d11c8a49ba476ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.387718 31555 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.388186 31555 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.388598 31555 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.389283 31635 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.389809 31635 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.392122 31635 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:41.392802 30552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:41.393487 30552 raft_consensus.cc:606] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:41.393891 30552 raft_consensus.cc:614] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:41.396855 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:41.397650 30405 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
W20260709 13:09:41.413129 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.369987 31660 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.417455 31153 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.418366 31640 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:41.418756 31660 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:41.362323 31642 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:41.429684 31151 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:09:41.405078 31710 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:09:41.395915 31601 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.396394 31560 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:41.466064 30309 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.019s	sys 0.027s
W20260709 13:09:41.467145 30558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.040s
I20260709 13:09:41.469559 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:41.479185 30558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.041s
I20260709 13:09:41.480531 30552 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:41.480748 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:41.466908 30309 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.022s	sys 0.027s
W20260709 13:09:41.466873 31586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.025s	sys 0.011s
I20260709 13:09:41.490849 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:41.484261 30560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.018s	sys 0.035s
W20260709 13:09:41.493078 30560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.018s	sys 0.036s
I20260709 13:09:41.494463 30406 raft_consensus.cc:2368] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:09:41.466418 31601 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:41.472790 31650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.007s	sys 0.044s
I20260709 13:09:41.498203 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:41.467089 31589 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.516357 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:41.489974 31586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.029s	sys 0.013s
I20260709 13:09:41.545810 30554 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
W20260709 13:09:41.551069 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.007s	sys 0.032s
I20260709 13:09:41.480547 31691 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:41.554554 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:41.605865 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.011s	sys 0.033s
W20260709 13:09:41.606307 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 843609us
W20260709 13:09:41.499922 31650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.008s	sys 0.045s
I20260709 13:09:41.615954 30551 raft_consensus.cc:2410] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:41.488982 30404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.024s	sys 0.054s
I20260709 13:09:41.489126 31150 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:41.495189 31628 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:41.687108 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:41.489830 31642 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:41.614629 31652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.010s	sys 0.027s
I20260709 13:09:41.688217 30403 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:41.678905 30404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.025s	sys 0.055s
I20260709 13:09:41.697607 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:41.698422 30411 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.706193 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:41.697116 31652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.011s	sys 0.028s
I20260709 13:09:41.706398 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:41.712349 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:41.707820 30406 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:41.716291 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:41.717661 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:41.718415 30486 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:41.687985 31554 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:41.726869 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:41.685264 31691 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.734233 31715 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.734784 31554 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:41.735425 31728 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:41.737353 31153 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:41.705004 31717 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:41.738382 31717 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.739037 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 56) took 1177 ms. Trace:
I20260709 13:09:41.739468 30404 rpcz_store.cc:276] 0709 13:09:40.561676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.566181 (+  4505us) service_pool.cc:224] Handling call
0709 13:09:40.631555 (+ 65374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.705139 (+ 73584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.705176 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.705779 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.706029 (+1000250us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:41.709466 (+  3437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.718915 (+  9449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.738766 (+ 19851us) raft_consensus.cc:1685] finished
0709 13:09:41.738788 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.738944 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7825,"raft.queue_time_us":38128,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"thread_start_us":992899,"threads_started":1,"wal-append.queue_time_us":1006071}
I20260709 13:09:41.740561 31717 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:41.734839 31715 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.742517 31554 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:41.703897 31714 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:41.726325 31564 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:41.709869 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 47) took 1147 ms. Trace:
I20260709 13:09:41.696067 31589 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.697639 31628 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.751332 30403 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:41.755071 30405 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:41.756445 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 420182us
W20260709 13:09:41.711997 31636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.026s	sys 0.038s
I20260709 13:09:41.747071 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.757542 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:41.758054 30411 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:41.734843 31660 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.760851 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:41.766235 30552 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.773761 30483 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.774200 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:41.774495 30485 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:41.775740 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:41.776623 31707 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:41.762372 31636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.026s	sys 0.038s
I20260709 13:09:41.786638 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:41.786865 30551 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.789947 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:09:41.793532 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 95552.7us
I20260709 13:09:41.777112 31707 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:41.796996 30483 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:41.777653 31653 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.802188 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:41.802839 31653 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.803295 31653 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.802255 31717 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:41.806023 31717 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:41.808133 31717 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:41.808643 31146 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.809705 31149 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:41.835701 30552 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:41.844151 30554 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:41.777499 30479 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
W20260709 13:09:41.773435 30407 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.007s	sys 0.022s
I20260709 13:09:41.878350 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:41.879463 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55404.2us
I20260709 13:09:41.884210 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.803305 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:41.794876 31650 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.763492 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:41.774072 31714 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:41.898762 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.925781 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.931483 30483 raft_consensus.cc:2368] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:09:41.872119 31604 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:41.880523 31740 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.019968 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.882017 31638 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:42.021643 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 218566us
W20260709 13:09:42.075824 31729 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:09:42.076718 30486 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:42.077268 31726 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.344s	user 0.000s	sys 0.000s
I20260709 13:09:42.077862 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.079048 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:42.079105 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:42.079980 30483 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:41.892450 31650 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.083436 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.023486 31570 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:42.078398 30481 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:42.108512 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:41.883575 31610 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:42.125398 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97026.3us
I20260709 13:09:42.082839 31560 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.143000 31560 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.143589 31653 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.145068 31560 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.145594 31653 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.146059 31560 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:42.087863 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 328724us
I20260709 13:09:42.147691 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:42.148128 30559 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:09:42.089715 31728 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:42.020663 31652 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.131912 31597 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:42.132210 31722 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.373s	user 0.000s	sys 0.000s
I20260709 13:09:42.132473 31733 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
I20260709 13:09:42.132863 30555 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.132915 31146 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.133548 31744 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:42.133911 31745 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:42.134151 30552 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.135169 31589 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:42.135514 31586 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:42.136808 31644 consensus_meta.cc:287] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 1.187s	user 0.013s	sys 0.000s
W20260709 13:09:42.137501 31720 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
I20260709 13:09:42.137151 31707 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.117178 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 946) took 1224 ms. Trace:
I20260709 13:09:41.753273 30557 rpcz_store.cc:276] 0709 13:09:40.557103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.557275 (+   172us) service_pool.cc:224] Handling call
0709 13:09:40.557715 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.591025 (+ 33310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.592610 (+  1585us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.593216 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.734523 (+141307us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:40.739111 (+  4588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.744524 (+  5413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.686175 (+941651us) raft_consensus.cc:1685] finished
0709 13:09:41.688071 (+  1896us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.704567 (+ 16496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3792,"raft.queue_time_us":19066,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9398,"thread_start_us":134150,"threads_started":1,"wal-append.queue_time_us":423374}
I20260709 13:09:42.220649 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:42.222829 31644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43936 (request call id 191) took 3696 ms. Trace:
I20260709 13:09:42.223373 31644 rpcz_store.cc:276] 0709 13:09:38.526335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.526567 (+   232us) service_pool.cc:224] Handling call
0709 13:09:38.730733 (+204166us) ts_tablet_manager.cc:934] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:09:40.690875 (+1960142us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:40.949584 (+258709us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:40.949705 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:42.221763 (+1272058us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:42.222162 (+   399us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:42.222551 (+   389us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:42.222676 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":66782,"tablet-copy.queue_time_us":122191,"thread_start_us":291046,"threads_started":2}
I20260709 13:09:42.220434 30407 rpcz_store.cc:276] 0709 13:09:40.893111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.893406 (+   295us) service_pool.cc:224] Handling call
0709 13:09:40.895531 (+  2125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.895914 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.895955 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.896466 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.239606 (+343140us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:41.899679 (+660073us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.020429 (+120750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.026053 (+  5624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.078561 (+ 52508us) raft_consensus.cc:1685] finished
0709 13:09:42.083064 (+  4503us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.109192 (+ 26128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218,"prepare.queue_time_us":20048,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":87919,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":6639,"thread_start_us":960725,"threads_started":2,"wal-append.queue_time_us":621905}
I20260709 13:09:42.225659 31644 tablet_copy_client.cc:806] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:42.138926 31714 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.227501 31714 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:42.227981 31714 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.228417 31714 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:42.139411 31718 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
I20260709 13:09:42.086865 31602 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.140015 31715 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.140384 31660 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:42.087147 31642 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.084642 31650 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.126585 31570 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.220335 31742 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:42.088598 31638 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:42.163702 30477 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:42.164412 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 85444.3us
I20260709 13:09:42.226553 31644 tablet_copy_client.cc:670] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:42.131105 31691 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:42.063386 31604 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.150240 31564 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.359555 31564 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.150403 31717 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:42.081573 31740 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.146539 31560 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.371224 31717 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.159313 31652 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:42.220031 31734 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:09:42.323361 31744 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.375900 31560 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.377031 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 50) took 1575 ms. Trace:
I20260709 13:09:42.377506 30558 rpcz_store.cc:276] 0709 13:09:40.801976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.802272 (+   296us) service_pool.cc:224] Handling call
0709 13:09:40.802621 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.803075 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.803108 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.803638 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.479742 (+676104us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:41.479804 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.479911 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.376747 (+896836us) raft_consensus.cc:1685] finished
0709 13:09:42.376779 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.376960 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32245,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":125,"thread_start_us":675596,"threads_started":1,"wal-append.queue_time_us":905821}
I20260709 13:09:42.310829 31642 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:42.383107 31642 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.385608 31642 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.191733 31606 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.148772 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.305202 31641 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.192601 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:42.286778 31586 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.359926 31749 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.194536 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:42.287446 31660 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.310012 31570 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:42.137169 31555 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.001s
I20260709 13:09:42.460227 30555 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:42.304823 31602 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.493556 31555 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.485188 31641 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.477253 30556 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.477419 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:42.502806 31749 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:42.505781 31743 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:09:42.477445 31660 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:42.510809 31750 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:09:42.514544 31606 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.517132 31606 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.367929 31742 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.522089 31742 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:42.533514 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 382638us
I20260709 13:09:42.546800 31715 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.547559 31715 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:42.549549 31601 consensus_meta.cc:287] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.032s	user 0.007s	sys 0.003s
I20260709 13:09:42.550081 31601 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.552585 31601 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.553457 31564 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.534591 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:42.587347 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52867.8us
I20260709 13:09:42.596864 31564 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:42.645694 31595 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.646404 31595 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.649211 31638 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.656333 31740 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.662765 31564 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:42.668860 31715 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:42.679519 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.670260 31752 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.675799 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:42.680953 30482 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.705520 31760 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:42.706302 31760 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.709146 31760 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:42.680166 30486 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:42.714860 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.717182 31752 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.922628 30479 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
W20260709 13:09:42.777535 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 188889us
I20260709 13:09:42.927224 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:42.927670 30556 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:42.928242 31601 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:42.928382 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1190) took 1166 ms. Trace:
I20260709 13:09:42.928805 31601 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:42.901799 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 219672us
I20260709 13:09:42.837127 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:42.939366 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 257023us
I20260709 13:09:42.912823 30482 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:42.739719 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:42.718207 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 48208.9us
I20260709 13:09:42.940979 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:42.930573 31650 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.003s
I20260709 13:09:42.949136 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:42.861730 31714 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
I20260709 13:09:42.949765 30486 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:42.941360 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.928848 30556 rpcz_store.cc:276] 0709 13:09:41.761923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.762546 (+   623us) service_pool.cc:224] Handling call
0709 13:09:42.928268 (+1165722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.929517 31601 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.956480 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:42.711426 31652 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.781297 31602 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.666543 31570 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.758908 31595 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.799360 31758 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.714931 31610 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:42.816479 31661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.028s	sys 0.027s
W20260709 13:09:42.683030 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 535399us
I20260709 13:09:42.780980 31717 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:42.960146 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:42.737951 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:42.964886 30554 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:42.962380 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:42.960423 31755 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:42.969645 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:42.967998 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:42.971338 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:42.967882 30451 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.548s (SENT) [suppressed 17 similar messages]
I20260709 13:09:42.741031 31564 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:42.966084 31661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.029s	sys 0.027s
I20260709 13:09:42.977351 30554 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:42.974928 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:42.989574 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:42.958382 31751 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:42.983577 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 209) took 1666 ms. Trace:
I20260709 13:09:42.966735 31760 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:42.955327 31650 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.959692 31714 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:42.967605 31641 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:42.969707 31733 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.011264 31733 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.013537 31733 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.987409 31752 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:42.987722 31740 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:42.996481 31150 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:43.015414 31742 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.015931 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:43.016203 31742 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:43.017606 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76699.6us
I20260709 13:09:42.969256 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:42.976598 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:42.995507 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.021627 30558 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:42.992199 31149 rpcz_store.cc:276] 0709 13:09:41.310439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.317383 (+  6944us) service_pool.cc:224] Handling call
0709 13:09:41.355569 (+ 38186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.810052 (+454483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.976102 (+1166050us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540021f2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:42.976272 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043990400}
I20260709 13:09:42.997643 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:42.992923 31638 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.014397 31740 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:42.988003 31604 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.019141 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:43.018426 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:42.985827 31755 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:42.988368 31757 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.022217 30554 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.978111 31758 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.007285 30552 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:42.997159 31760 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.018265 31751 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.028261 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:43.076309 31741 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.274s	user 0.015s	sys 0.018s
I20260709 13:09:43.076157 31755 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.076711 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.077543 31152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 214) took 1666 ms. Trace:
I20260709 13:09:43.077854 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:43.077962 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59623.5us
I20260709 13:09:43.074920 31757 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.026073 31604 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:43.078836 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:43.025643 31146 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:43.077943 31152 rpcz_store.cc:276] 0709 13:09:41.411302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.411439 (+   137us) service_pool.cc:224] Handling call
0709 13:09:41.411790 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.412022 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.412051 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.428744 (+ 16693us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.764223 (+335479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:41.764279 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.764381 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.075724 (+1311343us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:09:43.077243 (+  1519us) raft_consensus.cc:1685] finished
0709 13:09:43.077264 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.077478 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163156736,"thread_start_us":335062,"threads_started":1,"wal-append.queue_time_us":373543}
I20260709 13:09:43.085633 31740 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.080574 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.086313 31740 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.081602 31760 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.081581 31752 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:43.084077 31769 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.026938 31638 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.111039 31740 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.111327 31769 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.112709 31638 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.113235 31769 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.113448 30403 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:43.088964 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.089659 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.089872 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:43.034874 31733 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.091117 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.091676 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.092937 31742 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.074397 31654 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.093425 31586 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.093307 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.094431 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1324) took 1215 ms. Trace:
I20260709 13:09:43.094818 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:43.037124 31660 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.005s
I20260709 13:09:43.083101 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.156078 30523 leader_election.cc:400] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:09:43.030244 31641 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.100175 31604 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.108417 31597 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:43.110793 31752 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.099171 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:43.087484 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.160024 30552 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.160264 30552 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:43.160389 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 61315us
I20260709 13:09:43.157835 31660 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.034673 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:43.119525 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:43.118729 31721 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.493s	user 0.019s	sys 0.011s
W20260709 13:09:43.146011 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67243.4us
I20260709 13:09:43.023187 30556 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.036221 31714 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.156417 30523 leader_election.cc:403] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:43.172379 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:43.157320 30408 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.152683 30483 rpcz_store.cc:276] 0709 13:09:41.879464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.083653 (+204189us) service_pool.cc:224] Handling call
0709 13:09:42.116254 (+ 32601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.473441 (+357187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.473486 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.473542 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:42.473581 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.094247 (+620666us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540017b6d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:43.094287 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.094383 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820905344}
W20260709 13:09:43.157402 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 67562.9us
I20260709 13:09:43.031908 31650 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.162971 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.113253 31740 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.150662 31638 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.167833 30403 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.156091 31640 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.169703 31768 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.169860 31767 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.197081 31638 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.197647 31767 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:43.197677 31628 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.160924 31644 tablet_copy_client.cc:538] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:43.151547 30404 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.167106 30552 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.156823 30554 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:43.161656 31604 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.162515 31597 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.162312 31752 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.161141 31742 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.183111 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:43.183667 31654 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.172502 30478 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:43.214735 31654 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.215137 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1325) took 1335 ms. Trace:
I20260709 13:09:43.184249 31777 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.218832 31777 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.220836 31777 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.180719 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:43.203878 31554 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:09:43.223428 31586 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.223953 31586 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.166930 31769 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.224749 31769 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.225927 31586 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.226684 31769 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.204094 31628 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.227267 31595 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.227411 31628 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.229548 31628 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.230379 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:43.187674 30481 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:43.231000 30485 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:43.231725 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1218) took 1087 ms. Trace:
I20260709 13:09:43.213734 31767 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.181823 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:43.168761 31641 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.196736 31740 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:43.171202 31744 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.168512 31555 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.159088 31733 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.203015 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.211896 31768 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.235253 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.236269 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.236622 31768 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.231017 31638 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.237262 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:43.205042 31735 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.386s	user 0.016s	sys 0.009s
I20260709 13:09:43.205153 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.207223 31660 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.208504 31751 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.209697 31757 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.189294 31707 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:43.189199 31596 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:43.247763 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 65981.8us
I20260709 13:09:43.218348 31654 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.211527 31640 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.163659 31739 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.231211 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1331) took 1155 ms. Trace:
W20260709 13:09:43.233188 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50148.1us
W20260709 13:09:43.233397 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59914.1us
I20260709 13:09:43.264468 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:43.242214 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.267079 30554 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:43.243539 30558 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:43.203445 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 168891us
I20260709 13:09:43.231995 30485 rpcz_store.cc:276] 0709 13:09:42.144007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.146667 (+  2660us) service_pool.cc:224] Handling call
0709 13:09:43.230232 (+1083565us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:09:43.231653 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4796800}
I20260709 13:09:43.188817 31601 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.215575 30478 rpcz_store.cc:276] 0709 13:09:41.879714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.141076 (+261362us) service_pool.cc:224] Handling call
0709 13:09:43.115476 (+974400us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:43.148756 (+ 33280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.214823 (+ 66067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.215057 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17368448}
I20260709 13:09:43.244338 31610 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.222078 30403 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:43.260473 31778 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.268723 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.244716 31744 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:43.273648 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.252907 31596 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.252658 31707 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.278827 30554 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:43.259019 30406 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.275545 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.257968 31554 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.258142 31589 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.259546 31586 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.302253 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:43.305706 31774 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:09:43.304069 31654 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.306252 31773 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.306519 31654 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.306876 31773 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.308709 31601 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.309051 30558 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:43.271103 31758 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.314950 31586 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:43.309813 31554 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.272888 31606 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.318466 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:43.278585 31628 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.325655 31152 raft_consensus.cc:2368] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:43.278280 31650 raft_consensus.cc:2764] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:09:43.301036 31707 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.302536 31596 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.332192 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.347712 30403 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:43.337138 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.337026 31606 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.338765 30411 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:43.345235 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69936.9us
I20260709 13:09:43.340394 30451 leader_election.cc:400] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:43.352020 30451 leader_election.cc:403] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:43.304021 31555 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.310055 31757 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.301036 31610 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.302191 31744 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.355361 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.362219 30554 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.263825 30481 rpcz_store.cc:276] 0709 13:09:42.075997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.131953 (+ 55956us) service_pool.cc:224] Handling call
0709 13:09:43.187160 (+1055207us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:43.187348 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.230959 (+ 43611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.231160 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39308544}
I20260709 13:09:43.361045 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.339021 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.338148 31150 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:43.338748 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.364717 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.310187 31760 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.347499 31773 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.339823 30556 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:43.319007 31589 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.395450 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.354416 31650 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.394424 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131062us
I20260709 13:09:43.327023 31586 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.407835 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:43.346966 31628 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.385113 31559 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.418052 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:43.312860 31778 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.390287 30407 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:43.409906 31654 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.423866 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.424749 31151 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:43.354457 30404 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:43.467453 30554 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:43.428665 30524 leader_election.cc:400] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:09:43.428562 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:43.366940 31555 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.363981 31757 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.435523 31768 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:43.469779 30524 leader_election.cc:403] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:43.429898 31742 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.411208 31650 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.435827 31733 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.458178 30411 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:43.459173 31781 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.465878 31640 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.430733 31638 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:09:43.481209 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 113998us
I20260709 13:09:43.435266 31777 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:09:43.472527 31644 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
W20260709 13:09:43.491225 31782 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:43.491531 31610 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.492729 31586 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.493415 31757 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.493708 31744 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.494297 30403 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:43.494519 31554 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.458184 31739 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:43.473291 31714 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:43.511948 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 83458.3us
I20260709 13:09:43.474332 31641 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.514981 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:43.482306 31733 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.513027 31640 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:43.522718 31744 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:09:43.516875 31610 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:43.525312 31610 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.482383 31768 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:43.516234 31783 ts_tablet_manager.cc:933] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.513471 31714 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.489629 31752 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.513777 31757 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:43.481725 31742 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.514767 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.578233 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.578871 31768 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.558496 31650 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.581259 30410 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:43.582823 31589 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.527813 31628 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.583452 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:43.584055 31760 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.549499 31733 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.585583 31604 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.556980 31714 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.482669 31781 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:43.665251 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 197353us
I20260709 13:09:43.672227 31564 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.666715 31628 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:43.672950 31564 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:43.678174 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 195112us
I20260709 13:09:43.665959 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:43.712204 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46317.8us
I20260709 13:09:43.664162 31595 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.599316 31757 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.634328 31597 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.702853 31146 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:43.779925 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65627.3us
I20260709 13:09:43.780050 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.740794 31785 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:43.781844 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 267383us
W20260709 13:09:43.794306 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 81831.5us
I20260709 13:09:43.800069 31564 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.800428 31733 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.788656 31604 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.721621 31628 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.808853 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1186) took 2123 ms. Trace:
I20260709 13:09:43.782878 31785 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.809425 30551 rpcz_store.cc:276] 0709 13:09:41.679949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.680099 (+   150us) service_pool.cc:224] Handling call
0709 13:09:41.702549 (+ 22450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.787397 (+ 84848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.801702 (+2014305us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54003f2d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:43.803426 (+  1724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160773504}
I20260709 13:09:43.756214 31595 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:43.822746 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.822182 31596 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.830291 31554 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:43.807891 31778 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.832049 31757 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.835740 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.845712 30554 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:43.839191 31781 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.816780 31785 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.842427 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:43.836611 31723 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 2.077s	user 0.008s	sys 0.027s
I20260709 13:09:43.845008 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.849932 31742 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.851079 31597 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.851979 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.852497 31628 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.854651 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.839107 31610 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:43.857632 30551 raft_consensus.cc:2376] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2. Re-sending same reply.
I20260709 13:09:43.815693 31756 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:43.860908 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 72744.2us
I20260709 13:09:43.838289 31596 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.867473 31790 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.867498 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:43.869380 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.869982 30554 raft_consensus.cc:2376] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3. Re-sending same reply.
I20260709 13:09:43.870646 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:43.862867 31755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.018s	sys 0.041s
I20260709 13:09:43.867663 31756 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.880456 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.881104 30410 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.883513 31767 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.883879 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 48) took 3188 ms. Trace:
I20260709 13:09:43.883972 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.874585 31554 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:43.863469 31559 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:43.884755 31554 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:43.861091 31752 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.884770 30551 raft_consensus.cc:2410] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:43.887086 31744 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.889493 31554 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.890591 31554 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:43.877838 31755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.018s	sys 0.041s
W20260709 13:09:43.878085 31707 consensus_meta.cc:287] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:09:43.888598 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 954) took 1148 ms. Trace:
I20260709 13:09:43.893087 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.884238 30560 rpcz_store.cc:276] 0709 13:09:40.695760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.700807 (+  5047us) service_pool.cc:224] Handling call
0709 13:09:40.728303 (+ 27496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.739427 (+ 11124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.739458 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.741372 (+  1914us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.493564 (+752192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:41.493614 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.493681 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.836030 (+2342349us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:09:43.883617 (+ 47587us) raft_consensus.cc:1685] finished
0709 13:09:43.883635 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.883825 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6564,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9714,"spinlock_wait_cycles":77097344,"thread_start_us":704585,"threads_started":1,"wal-append.queue_time_us":917948}
I20260709 13:09:43.895913 30551 raft_consensus.cc:2376] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4. Re-sending same reply.
I20260709 13:09:43.868036 31790 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:43.897090 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.900329 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:43.900985 30551 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:43.903525 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.904575 30551 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.906184 31790 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.909929 30551 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:43.911093 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:43.899688 31707 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.918398 31796 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:43.896618 31717 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:43.916612 30405 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:43.920779 31796 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:43.921164 31707 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.921316 31756 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.897338 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.884001 31767 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.926723 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.927409 30405 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.928097 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:43.928186 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:43.929672 30405 raft_consensus.cc:2368] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:43.930730 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:43.912146 31752 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.934300 30404 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:43.934765 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.935685 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:43.904040 31783 tablet_copy_client.cc:323] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:09:43.937654 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.932135 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:43.938288 31755 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:43.941296 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1213) took 2694 ms. Trace:
I20260709 13:09:43.938253 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:43.950924 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55752.8us
W20260709 13:09:43.944875 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1188) took 2216 ms (client timeout 1995 ms). Trace:
W20260709 13:09:43.952396 30559 rpcz_store.cc:269] 0709 13:09:41.721255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.743910 (+ 22655us) service_pool.cc:224] Handling call
0709 13:09:43.937365 (+2193455us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54001e50d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:43.937549 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793177856}
I20260709 13:09:43.943032 31752 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:43.962738 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:43.959444 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:43.968981 31150 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:43.974741 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1291) took 2577 ms. Trace:
I20260709 13:09:43.974942 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 956) took 1237 ms. Trace:
I20260709 13:09:43.978521 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:43.928551 31796 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:43.966531 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.959538 31595 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.978837 31559 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:43.945117 30480 rpcz_store.cc:276] 0709 13:09:41.241614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.241764 (+   150us) service_pool.cc:224] Handling call
0709 13:09:41.246622 (+  4858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.296305 (+ 49683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.296357 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.480763 (+2184406us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b2c00010828. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:09:43.481130 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.807785 (+326655us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:43.807835 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.808020 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.931826 (+123806us) raft_consensus.cc:1685] finished
0709 13:09:43.931848 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.935448 (+  3600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673,"raft.queue_time_us":30196,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":10849,"spinlock_wait_cycles":12260736,"thread_start_us":258377,"threads_started":1,"wal-append.queue_time_us":328629}
I20260709 13:09:43.978397 31769 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:43.975198 30402 rpcz_store.cc:276] 0709 13:09:41.396719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.704147 (+307428us) service_pool.cc:224] Handling call
0709 13:09:43.040048 (+1335901us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:43.040313 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.040572 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:43.164757 (+124185us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.973958 (+809201us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b18003c34c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a
0709 13:09:43.974245 (+   287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.974298 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:43.974348 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.974425 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.974539 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163790,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":633,"spinlock_wait_cycles":56135936,"thread_start_us":190846,"threads_started":2,"wal-append.queue_time_us":122828}
I20260709 13:09:43.960286 31767 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:43.982029 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 281) took 2608 ms. Trace:
I20260709 13:09:43.996397 31752 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.004829 31153 rpcz_store.cc:276] 0709 13:09:41.374009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.383387 (+  9378us) service_pool.cc:224] Handling call
0709 13:09:41.383713 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.737761 (+354048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.981682 (+2243921us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b54004f3dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:43.981925 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77304576}
I20260709 13:09:43.981163 31151 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:43.993100 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:44.011399 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.011737 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.013484 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:43.979768 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.007161 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.016973 30551 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:44.017297 30482 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:43.984242 31149 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:44.023994 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:43.980489 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:43.988632 31555 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.988816 31559 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:43.989645 31749 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:43.980764 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.034536 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.035043 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.035262 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:43.980125 31756 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:43.980123 31570 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:44.008621 31586 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:09:44.018412 31597 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:44.034325 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:44.054170 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:43.975389 30556 rpcz_store.cc:276] 0709 13:09:42.737924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.426022 (+688098us) service_pool.cc:224] Handling call
0709 13:09:43.469732 (+ 43710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.526036 (+ 56304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.526079 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.836788 (+310709us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.889227 (+ 52439us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:43.889283 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.889376 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.971429 (+ 82053us) raft_consensus.cc:1685] finished
0709 13:09:43.974748 (+  3319us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.974884 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36946,"raft.queue_time_us":37330,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":48274,"threads_started":1,"wal-append.queue_time_us":116428}
I20260709 13:09:43.983494 31714 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.054078 31789 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:09:44.203249 31768 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:09:44.214546 30402 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:44.201284 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.215337 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.216403 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.216619 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.217489 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.217744 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.208460 31749 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:44.219431 31749 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.217167 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.219781 31749 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:44.220810 31749 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.211637 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.221895 31152 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:44.222030 31749 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.223009 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.209836 31756 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:44.224280 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.225158 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1195) took 2099 ms. Trace:
I20260709 13:09:44.225459 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.226291 30404 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.225512 30553 rpcz_store.cc:276] 0709 13:09:42.125747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.134169 (+  8422us) service_pool.cc:224] Handling call
0709 13:09:43.938628 (+1804459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.938950 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.938981 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.939019 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:43.939053 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.939115 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.224879 (+285764us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54001e50d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:44.225004 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5648,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8992,"spinlock_wait_cycles":4146685824}
I20260709 13:09:44.037957 31559 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:44.101033 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 164152us
I20260709 13:09:44.134768 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.220806 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.231966 30402 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
I20260709 13:09:44.232604 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.232913 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.233204 30403 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:44.018723 31595 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.016675 31755 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.019922 31596 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:44.238610 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.240540 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.241258 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.241683 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.224299 31756 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.242309 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.243641 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.243974 31769 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.244410 31769 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.244982 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.246117 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.246973 31606 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.247215 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.221508 31714 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.252763 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.218611 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.254565 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.255530 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.256939 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.256516 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.258620 30410 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:43.895046 30558 rpcz_store.cc:276] 0709 13:09:42.737392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.312385 (+574993us) service_pool.cc:224] Handling call
0709 13:09:43.312649 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.314976 (+  2327us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:43.662324 (+347348us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.885217 (+222893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.885265 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:43.885327 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.885396 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.885497 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85381,"prepare.queue_time_us":476030,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":80703,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2364,"thread_start_us":440070,"threads_started":2,"wal-append.queue_time_us":182663}
I20260709 13:09:44.260478 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.262789 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.285527 30410 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:44.202440 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 159055us
I20260709 13:09:44.286110 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1295) took 2873 ms. Trace:
I20260709 13:09:44.206377 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:44.287241 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 80939.6us
I20260709 13:09:44.201673 30486 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.209261 30478 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.207741 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:44.212909 31732 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:43.988261 31785 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.231380 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet ba4c05796efa42489d11c8a49ba476ad from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:09:44.292135 31596 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.292210 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet ba4c05796efa42489d11c8a49ba476ad from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-ba4c05796efa42489d11c8a49ba476ad
I20260709 13:09:44.292732 31596 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.294929 31596 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:44.295073 31147 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:44.295480 30560 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:44.036072 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.297315 31785 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:44.297639 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.233515 30402 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.236193 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.234297 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.237711 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.208699 30557 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:44.257768 30479 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.271061 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.272747 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1206) took 3386 ms. Trace:
I20260709 13:09:44.303957 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.304191 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 949) took 1568 ms. Trace:
I20260709 13:09:44.274420 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.305084 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.276288 31559 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.306061 30483 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.277617 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.199303 30482 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:44.298249 30481 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.304349 30484 rpcz_store.cc:276] 0709 13:09:40.886364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.886521 (+   157us) service_pool.cc:224] Handling call
0709 13:09:40.886840 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.889082 (+  2242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.889119 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.889583 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.317536 (+427953us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:41.317572 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.317630 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.271833 (+2954203us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b2400108218. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041e429c4 00007fa041e40acb 00007fa041ffbdc9 00007fa041ffba55 00007fa041ffafb0 00007fa044c71488 00007fa044c71be8 00007fa044c49398 00007fa044c4476a 00007fa044c43bb6
0709 13:09:44.272492 (+   659us) raft_consensus.cc:1685] finished
0709 13:09:44.272512 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.272693 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1781,"raft.queue_time_us":5525,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14588,"spinlock_wait_cycles":5811968,"thread_start_us":427546,"threads_started":1,"wal-append.queue_time_us":735153}
I20260709 13:09:44.304581 30557 rpcz_store.cc:276] 0709 13:09:42.735768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.980510 (+1244742us) service_pool.cc:224] Handling call
0709 13:09:44.304120 (+323610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.309412 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.309988 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.311192 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.311285 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.312290 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.312613 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.313382 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.313809 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.313992 30483 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.315189 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.307801 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.284861 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.317183 30480 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.284649 31769 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.285329 31589 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:44.286051 31740 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:44.288101 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.207454 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.207726 31148 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:44.284890 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 975) took 1196 ms. Trace:
I20260709 13:09:44.322976 30478 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:44.290807 31755 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.324899 30552 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.289799 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:44.296068 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.325621 30486 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.325820 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.286687 30409 rpcz_store.cc:276] 0709 13:09:41.412621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.729174 (+316553us) service_pool.cc:224] Handling call
0709 13:09:44.285195 (+2556021us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:44.285424 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.285649 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.285692 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.285752 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:44.285798 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.285892 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.286040 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13160192}
I20260709 13:09:44.326920 31755 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:44.290299 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 84966.4us
I20260709 13:09:44.298095 31732 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.300908 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:44.316284 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.328435 30411 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.310572 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.338200 30477 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:44.342665 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:44.318770 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.328678 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.327975 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.344470 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.345235 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.345463 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.346041 30481 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.346164 30407 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.346911 31604 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.347280 31604 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.347628 31604 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.348824 31769 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.282383 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:44.323464 30408 rpcz_store.cc:276] 0709 13:09:43.088518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.091446 (+  2928us) service_pool.cc:224] Handling call
0709 13:09:44.284662 (+1193216us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b54003999d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:44.284789 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19321600}
I20260709 13:09:44.300945 30404 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:44.304209 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.301949 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.351110 30450 leader_election.cc:400] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:44.343927 30552 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.351497 30450 leader_election.cc:403] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:44.351773 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 54) took 1333 ms. Trace:
I20260709 13:09:44.343860 30483 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:44.319067 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.345831 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.327477 31755 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:44.355463 30485 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:44.355919 30408 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.355387 31755 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.342967 31606 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.356503 31606 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.356855 31606 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:44.350818 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 68525.2us
I20260709 13:09:44.352433 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:44.376442 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:44.378238 30483 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:44.383877 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.352178 30552 rpcz_store.cc:276] 0709 13:09:43.017948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.087258 (+ 69310us) service_pool.cc:224] Handling call
0709 13:09:44.324546 (+1237288us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b58001100d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450050aa 00007fa045087447 00007fa04509ffe7 00007fa0450a17de 00007fa0450ad27c 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c
0709 13:09:44.351668 (+ 27122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578469632}
I20260709 13:09:44.400072 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.401276 30407 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.403560 31601 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.405603 31601 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.404922 31564 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.409494 31564 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.409987 31564 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.415520 31601 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:44.416332 31732 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:44.377866 31769 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.418862 31769 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.419342 31769 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.427078 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.431723 30552 raft_consensus.cc:2410] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:44.432556 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.433197 30552 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:44.374470 31595 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:44.437793 31808 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.438131 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.438678 31786 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.439109 31786 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.439468 31786 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.439913 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.440604 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.441632 30554 raft_consensus.cc:2410] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:44.417133 31555 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.438205 31808 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.420037 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.445652 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.445977 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.446101 31714 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.455992 31714 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.392788 31740 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:44.461761 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.435348 31660 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.476608 30477 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.445091 31808 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.479395 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.463779 31714 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.460485 30481 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.539587 30411 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.542863 30477 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.543740 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.545452 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.548709 30555 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:09:44.563233 30555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 948) took 1845 ms (client timeout 2439 ms). Trace:
I20260709 13:09:44.563959 31800 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:44.563728 30555 rpcz_store.cc:269] 0709 13:09:42.717568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.479472 (+1761904us) service_pool.cc:224] Handling call
0709 13:09:44.563147 (+ 83675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.582041 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.582677 30552 raft_consensus.cc:2376] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3. Re-sending same reply.
I20260709 13:09:44.482723 31660 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.565085 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.586583 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.604192 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:44.606119 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:44.603399 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 277627us
I20260709 13:09:44.608500 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.609090 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.609827 30411 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:44.604239 30555 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.612053 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:44.613554 31589 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:44.620340 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.625968 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.626389 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.630513 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.631086 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.632452 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.566020 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:44.663661 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.603678 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.605302 31559 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.662356 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.641793 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.665238 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:44.668061 30403 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:44.668586 30553 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:44.669449 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.613605 31640 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.614670 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.671509 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.629894 30570 tablet_copy_source_session.cc:215] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:44.626431 31714 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:44.674109 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.634729 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.641351 31768 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:44.626859 31644 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.047s	sys 0.071s
I20260709 13:09:44.687857 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.683347 30553 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.685246 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:44.685817 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:44.686321 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.705098 30405 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:44.663292 31781 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:44.701896 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 80856.2us
I20260709 13:09:44.685285 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:44.707598 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.711542 30551 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:44.713630 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:44.674321 31791 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:44.673126 31640 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.715554 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.676548 31714 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.684280 30557 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.683746 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:44.715289 31773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.026s
W20260709 13:09:44.703644 31644 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.047s	sys 0.072s
I20260709 13:09:44.705165 31570 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.731010 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:44.708326 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 163913us
I20260709 13:09:44.718902 31640 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.720924 31589 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.718009 31791 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.721800 31714 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.732636 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:44.733412 31773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.002s	sys 0.027s
I20260709 13:09:44.737769 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.745818 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.747555 31786 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.748584 31564 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.749634 31786 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:44.750043 30556 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.732931 30407 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:44.750188 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:44.753450 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:44.760313 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.761216 31570 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:44.767980 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.769330 31660 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.740621 31589 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.757485 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.742336 31791 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.792202 31773 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:44.820868 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.804785 30479 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:44.804903 31601 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:44.806260 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.798720 30486 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
W20260709 13:09:44.820952 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65719.3us
I20260709 13:09:44.814941 31589 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.797469 31800 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.806088 31570 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:44.832221 30411 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:44.833297 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.834794 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:44.824313 31660 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:44.840184 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.813555 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:44.814384 31769 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.852896 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:44.845405 31564 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:44.849828 30402 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260709 13:09:44.822626 31773 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:44.842427 31660 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.842196 31793 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:44.862568 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.851011 31596 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:44.867170 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 471129us
W20260709 13:09:44.854472 31752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.022s
I20260709 13:09:44.862392 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:44.852582 30410 consensus_meta.cc:287] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:09:44.855010 31146 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:44.844128 31717 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:09:44.846455 31604 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.881441 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:44.858667 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:44.863746 31606 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.001s
I20260709 13:09:44.891076 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:44.892158 30408 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.033s
W20260709 13:09:44.920617 30408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.009s	sys 0.033s
I20260709 13:09:44.867444 31660 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.862715 30402 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.867318 31793 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:44.924734 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.928455 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:44.929231 30551 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:44.890388 31814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.016s
I20260709 13:09:44.933749 30477 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:44.868611 31752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.022s
W20260709 13:09:44.921057 31796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.020s	sys 0.044s
W20260709 13:09:44.944972 31796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.021s	sys 0.044s
W20260709 13:09:44.910082 31153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.011s	sys 0.021s
W20260709 13:09:44.945817 31153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.011s	sys 0.021s
I20260709 13:09:44.868234 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:44.944036 31604 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.875196 30410 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:44.951347 31570 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.953501 31570 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:44.956559 31628 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.957060 31628 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:44.963289 31773 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:44.964521 31773 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.890818 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:44.969293 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 105231us
I20260709 13:09:44.971410 30481 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:44.975790 31640 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.978116 31769 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:44.922760 31606 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.979833 31808 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:44.923156 31559 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:44.928295 31740 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:44.928584 31793 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:44.933447 31814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.017s
I20260709 13:09:44.970268 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.006475 30486 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:09:44.995081 30402 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:45.010303 30477 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:44.958107 31628 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.001289 31744 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.026151 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.001282 31559 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:45.027412 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.028144 31752 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.054524 31591 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.006s	sys 0.025s
I20260709 13:09:45.036602 31146 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:45.034775 31559 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.050254 31555 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.068132 31628 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:45.087460 31591 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.006s	sys 0.025s
W20260709 13:09:45.094940 30483 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.026s	sys 0.042s
W20260709 13:09:45.032444 31763 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.013s	sys 0.030s
W20260709 13:09:45.078508 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 90690.7us
W20260709 13:09:45.113471 30483 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.026s	sys 0.043s
I20260709 13:09:45.033474 31744 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:45.116426 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 447023us
I20260709 13:09:45.122427 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:45.116930 31763 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.013s	sys 0.030s
I20260709 13:09:45.118173 30481 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:45.089128 31752 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.096266 31555 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.125022 31769 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:45.174496 30406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.023s	sys 0.049s
W20260709 13:09:45.183444 30406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.024s	sys 0.049s
I20260709 13:09:45.188818 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.189775 30477 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:45.124584 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:09:45.214751 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 413243us
W20260709 13:09:45.216248 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 91721.6us
W20260709 13:09:45.218019 30555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.019s	sys 0.005s
I20260709 13:09:45.187088 31769 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:45.225471 30555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.019s	sys 0.005s
I20260709 13:09:45.225165 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.191843 31744 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:45.180050 31756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.011s	sys 0.025s
I20260709 13:09:45.208817 31596 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.181869 31791 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.220825 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.181080 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.216658 31808 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:45.258895 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:45.259284 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.218051 31781 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.234676 31769 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.275344 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 73) took 1055 ms. Trace:
W20260709 13:09:45.276407 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 526252us
W20260709 13:09:45.267493 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46483.7us
I20260709 13:09:45.222383 31749 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:45.279021 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.277000 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:45.246347 31640 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:45.263839 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 352020us
W20260709 13:09:45.264607 31756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.011s	sys 0.026s
I20260709 13:09:45.267387 31744 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.283896 30477 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:09:45.295771 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 250785us
I20260709 13:09:45.272759 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:45.280283 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.297112 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.299773 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.309317 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.294495 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.316548 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.275005 31653 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:45.273994 31148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.008s	sys 0.017s
W20260709 13:09:45.328783 31148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.019s
I20260709 13:09:45.329411 31570 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.329774 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:45.330966 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:45.331921 31783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4c05796efa42489d11c8a49ba476ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.320773 31636 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.319201 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.321568 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.317580 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 59) took 2223 ms. Trace:
I20260709 13:09:45.327592 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:45.314114 31640 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.352384 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:45.283708 31785 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.354111 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.354480 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:45.378407 30477 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:45.377008 31151 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.335106 31786 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:09:45.313901 31781 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:45.405939 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:45.334348 31635 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:45.290004 31749 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.339973 31744 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.351171 31636 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:45.426949 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 125967us
I20260709 13:09:45.436038 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 60) took 2341 ms. Trace:
I20260709 13:09:45.419267 31781 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.445211 31789 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.439396 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 64) took 1525 ms. Trace:
W20260709 13:09:45.430433 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 275996us
I20260709 13:09:45.446045 30558 rpcz_store.cc:276] 0709 13:09:43.913680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.763166 (+849486us) service_pool.cc:224] Handling call
0709 13:09:44.763528 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.763758 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:45.209133 (+445375us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.439009 (+229876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.439060 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.439099 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.439224 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.439343 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5556,"prepare.queue_time_us":590303,"prepare.run_cpu_time_us":1629,"prepare.run_wall_time_us":22258,"raft.queue_time_us":5727,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"thread_start_us":668800,"threads_started":2}
I20260709 13:09:45.448652 31781 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.450767 31632 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.451555 31632 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.451644 31843 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:45.451871 31833 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:45.452363 31632 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.452450 31843 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.431577 31555 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:45.453601 31150 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:45.453958 31843 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:45.459024 31819 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:09:45.431301 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:45.460942 31146 raft_consensus.cc:2368] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:45.466109 31793 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.467062 31606 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:45.468015 31749 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:45.440104 31752 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:45.469223 31752 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.470086 31644 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:45.475162 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 158707us
I20260709 13:09:45.475617 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1224) took 1265 ms. Trace:
I20260709 13:09:45.476099 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1227) took 1227 ms. Trace:
W20260709 13:09:45.423614 31714 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.005s
I20260709 13:09:45.475965 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.468114 31793 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:45.476589 30554 rpcz_store.cc:276] 0709 13:09:44.249112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.764669 (+515557us) service_pool.cc:224] Handling call
0709 13:09:44.765031 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.765266 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.765309 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.765851 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.192191 (+426340us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:45.192243 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.192329 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.475918 (+283589us) raft_consensus.cc:1685] finished
0709 13:09:45.475935 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.476045 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":425941,"threads_started":1,"wal-append.queue_time_us":697375}
I20260709 13:09:45.475951 30559 rpcz_store.cc:276] 0709 13:09:44.210380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.731404 (+521024us) service_pool.cc:224] Handling call
0709 13:09:44.738772 (+  7368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.739050 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.739088 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.753349 (+ 14261us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.240148 (+486799us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:45.240185 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.240251 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.475427 (+235176us) raft_consensus.cc:1685] finished
0709 13:09:45.475445 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.475565 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":452577,"threads_started":1,"wal-append.queue_time_us":672211}
I20260709 13:09:45.441104 30555 rpcz_store.cc:276] 0709 13:09:43.094547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.612571 (+1518024us) service_pool.cc:224] Handling call
0709 13:09:44.612957 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.613184 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:45.226910 (+613726us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.435592 (+208682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.435664 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.435723 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.435810 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.435967 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23950,"prepare.queue_time_us":646892,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1976,"thread_start_us":777472,"threads_started":2}
W20260709 13:09:45.470613 31589 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
W20260709 13:09:45.494310 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 163704us
I20260709 13:09:45.427462 31850 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.508495 31857 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:45.509054 31828 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:09:45.500470 31589 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.512645 31151 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:45.512885 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 99) took 4763 ms. Trace:
W20260709 13:09:45.515436 31827 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:09:45.487020 31714 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.517233 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1253) took 1250 ms. Trace:
I20260709 13:09:45.517717 30478 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.518296 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 294) took 1156 ms. Trace:
I20260709 13:09:45.518981 31714 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:45.519239 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 56) took 1249 ms. Trace:
I20260709 13:09:45.519798 31152 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:45.520088 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1331) took 1303 ms. Trace:
I20260709 13:09:45.520452 30404 rpcz_store.cc:276] 0709 13:09:44.216549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.350618 (+134069us) service_pool.cc:224] Handling call
0709 13:09:44.351683 (+  1065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.374450 (+ 22767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.374487 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.413919 (+ 39432us) log.cc:844] Serialized 499 byte log entry
0709 13:09:44.869190 (+455271us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:44.869226 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.869290 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.519880 (+650590us) raft_consensus.cc:1685] finished
0709 13:09:45.519899 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.520034 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":435949,"threads_started":1,"wal-append.queue_time_us":790263}
I20260709 13:09:45.519577 30484 rpcz_store.cc:276] 0709 13:09:44.269897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.345573 (+ 75676us) service_pool.cc:224] Handling call
0709 13:09:45.519080 (+1173507us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400002154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:45.519185 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780569344}
I20260709 13:09:45.524065 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:45.524647 30404 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:45.517716 30482 rpcz_store.cc:276] 0709 13:09:44.267065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.353320 (+ 86255us) service_pool.cc:224] Handling call
0709 13:09:44.353688 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.353931 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.353968 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.374523 (+ 20555us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.928371 (+553848us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:44.928409 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.928472 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.516973 (+588501us) raft_consensus.cc:1685] finished
0709 13:09:45.516999 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.517166 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":487777,"threads_started":1,"wal-append.queue_time_us":846079}
I20260709 13:09:45.511797 31589 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:45.498976 31824 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:09:45.527053 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.530009 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:45.580637 30411 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.495846 31785 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.500881 31644 tablet_bootstrap.cc:492] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:45.499984 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:45.504729 31820 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:09:45.591513 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1222) took 1554 ms. Trace:
I20260709 13:09:45.495565 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 290) took 1466 ms. Trace:
W20260709 13:09:45.581115 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51251.4us
I20260709 13:09:45.477675 31636 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.497689 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1226) took 1249 ms. Trace:
I20260709 13:09:45.592005 30553 rpcz_store.cc:276] 0709 13:09:44.037099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.714079 (+676980us) service_pool.cc:224] Handling call
0709 13:09:44.714331 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.742972 (+ 28641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.743013 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.745628 (+  2615us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.912185 (+166557us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b1800408b80. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:09:45.277888 (+365703us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:45.277934 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.278002 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.520480 (+242478us) raft_consensus.cc:1685] finished
0709 13:09:45.520507 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.591425 (+ 70918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11876,"raft.queue_time_us":21407,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":12897664,"thread_start_us":365511,"threads_started":1,"wal-append.queue_time_us":768050}
I20260709 13:09:45.617111 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.613765 31559 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.513281 30309 rpcz_store.cc:276] 0709 13:09:40.749402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.749606 (+   204us) service_pool.cc:224] Handling call
0709 13:09:45.512744 (+4763138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:41.779979 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:42.135934 (+355955us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:42.135983 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:09:42.136000 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:42.136491 (+   491us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:42.136570 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:42.136601 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:42.137015 (+   414us) tablet.cc:701] Row locks acquired
0709 13:09:42.137063 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:09:42.137244 (+   181us) write_op.cc:270] Start()
0709 13:09:42.137396 (+   152us) write_op.cc:276] Timestamp: P: 1783602582137177 usec, L: 0
0709 13:09:42.137418 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:42.138136 (+   718us) log.cc:844] Serialized 912 byte log entry
0709 13:09:44.005426 (+1867290us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18002b2c40. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:09:44.005718 (+   292us) op_driver.cc:464] REPLICATION: finished
0709 13:09:44.277337 (+271619us) write_op.cc:301] APPLY: starting
0709 13:09:44.277432 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:44.277581 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:44.277619 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:44.279665 (+  2046us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:44.279835 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:44.279890 (+    55us) write_op.cc:312] APPLY: finished
0709 13:09:44.280098 (+   208us) log.cc:844] Serialized 28 byte log entry
0709 13:09:45.015288 (+735190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.024038 (+  8750us) write_op.cc:454] Released schema lock
0709 13:09:45.024101 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:45.087397 (+ 63296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.089684 (+  2287us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":271364,"apply.run_cpu_time_us":28694,"apply.run_wall_time_us":781417,"mutex_wait_us":1072,"num_ops":2,"prepare.queue_time_us":975410,"prepare.run_cpu_time_us":22620,"prepare.run_wall_time_us":837654,"raft.queue_time_us":1537294,"raft.run_cpu_time_us":60870,"raft.run_wall_time_us":1134928,"replication_time_us":1868155,"spinlock_wait_cycles":9225472,"thread_start_us":2100452,"threads_started":5,"wal-append.queue_time_us":528727,"wal-append.run_cpu_time_us":88423,"wal-append.run_wall_time_us":1353653}]]}
I20260709 13:09:45.620680 31644 ts_tablet_manager.cc:1403] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 2.195s	user 0.071s	sys 0.121s
I20260709 13:09:45.579770 31596 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:45.591228 31800 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:45.602753 31793 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:45.619386 31773 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.654s	user 0.013s	sys 0.000s
W20260709 13:09:45.590582 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 90992.4us
I20260709 13:09:45.504961 31791 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:45.531047 31740 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:09:45.641345 31769 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.642493 30404 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.614665 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:45.644378 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.621328 31781 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.646684 31559 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:45.590286 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 142391us
I20260709 13:09:45.630846 31800 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.648581 31800 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:45.636579 31660 consensus_meta.cc:287] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.002s
I20260709 13:09:45.603389 31153 rpcz_store.cc:276] 0709 13:09:44.029632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.032009 (+  2377us) service_pool.cc:224] Handling call
0709 13:09:44.200805 (+168796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.201042 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.201074 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.207522 (+  6448us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.946321 (+738799us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:44.946406 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.946502 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.479515 (+533013us) raft_consensus.cc:1685] finished
0709 13:09:45.486007 (+  6492us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.493494 (+  7487us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":738385,"threads_started":1,"wal-append.queue_time_us":949597}
I20260709 13:09:45.632607 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.638418 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 998) took 1441 ms. Trace:
I20260709 13:09:45.614357 30557 rpcz_store.cc:276] 0709 13:09:44.248756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.756041 (+507285us) service_pool.cc:224] Handling call
0709 13:09:44.767408 (+ 11367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.767871 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.767913 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.768461 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.186971 (+418510us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:45.205002 (+ 18031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.222146 (+ 17144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.486153 (+264007us) raft_consensus.cc:1685] finished
0709 13:09:45.487149 (+   996us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.495700 (+  8551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1185,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":406682,"threads_started":1,"wal-append.queue_time_us":523603}
I20260709 13:09:45.518790 31148 rpcz_store.cc:276] 0709 13:09:44.361835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.414496 (+ 52661us) service_pool.cc:224] Handling call
0709 13:09:44.464352 (+ 49856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.541634 (+ 77282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.541678 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.542309 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.329181 (+786872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:45.329226 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.329310 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.518021 (+188711us) raft_consensus.cc:1685] finished
0709 13:09:45.518060 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.518229 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3988,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":18013,"thread_start_us":786458,"threads_started":1,"wal-append.queue_time_us":966746}
I20260709 13:09:45.647179 30405 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:45.647912 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.672241 31861 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.672644 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:45.672968 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.673897 31865 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.673846 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.674180 31861 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.674889 31861 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:09:45.623579 31628 consensus_meta.cc:287] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 13:09:45.653374 30411 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:45.528656 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 99665.2us
W20260709 13:09:45.657617 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 303575us
I20260709 13:09:45.664914 31800 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.631390 31596 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.678722 31859 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.679222 31859 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:45.675395 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.676867 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.677096 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.681973 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.677130 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.671298 30406 rpcz_store.cc:276] 0709 13:09:44.197055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.197177 (+   122us) service_pool.cc:224] Handling call
0709 13:09:44.200700 (+  3523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.207993 (+  7293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.208022 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.226856 (+ 18834us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.183804 (+956948us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:45.183840 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.183900 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.638184 (+454284us) raft_consensus.cc:1685] finished
0709 13:09:45.638209 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.638359 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1983,"raft.queue_time_us":2287,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5348,"thread_start_us":956590,"threads_started":1,"wal-append.queue_time_us":959905}
I20260709 13:09:45.682046 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.684315 30374 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.680132 31859 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.699501 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.681941 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.672747 31793 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.683727 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:45.684849 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.708513 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:09:45.684525 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.680148 31596 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:45.670639 31644 raft_consensus.cc:359] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:45.708943 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:45.715698 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.683660 31773 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.723982 30482 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:45.719316 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:45.724053 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.683314 31628 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.670996 31660 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.736385 30523 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.737751 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:45.737718 31791 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.739372 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.720260 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:45.700639 31860 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.740276 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:45.724452 31632 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.719756 31864 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.699719 31863 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.709373 31865 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.722611 31644 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:09:45.724691 31793 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.711184 31714 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:45.760886 31860 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.683405 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:09:45.771551 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52368.7us
I20260709 13:09:45.764008 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.724912 31773 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:45.773805 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.757861 31632 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:45.738483 31785 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.770287 31863 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:09:45.768718 31153 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:45.769511 31717 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.779474 31714 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.779587 31148 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:45.720233 31861 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.779723 31858 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:45.780411 31589 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:45.777946 31793 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:45.781648 31791 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:45.781903 31660 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:45.775368 31632 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.784493 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.784870 31856 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:45.785657 31860 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:45.785339 31644 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:45.787451 31800 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:45.774485 30479 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:45.774560 31773 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:45.831490 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 154036us
W20260709 13:09:45.828723 31826 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.650s	user 0.008s	sys 0.008s
I20260709 13:09:45.832866 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:45.776752 31865 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.776047 31628 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:45.834780 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 74900.1us
I20260709 13:09:45.789580 31151 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.841274 30406 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.839922 31856 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:45.831056 31714 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:09:45.847858 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 94773.5us
I20260709 13:09:45.275728 30408 rpcz_store.cc:276] 0709 13:09:44.219465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.356545 (+137080us) service_pool.cc:224] Handling call
0709 13:09:44.356775 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.356933 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:44.921087 (+564154us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.274071 (+352984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.274125 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.274170 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.274831 (+   661us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.275288 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272199,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":1202,"thread_start_us":916200,"threads_started":2}
W20260709 13:09:45.850844 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 78406.6us
I20260709 13:09:45.855296 31749 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.845392 30451 leader_election.cc:400] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3.
I20260709 13:09:45.858741 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:45.862052 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 77648.3us
I20260709 13:09:45.862944 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.865588 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.865612 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.866551 31717 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.866837 31869 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.849627 31739 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:45.867362 31635 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:45.867815 31714 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.852159 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:45.869477 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.870249 31873 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.866597 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.863991 31744 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.871547 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.871845 31744 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.872263 31873 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.872642 31873 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:45.873008 31873 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.873368 30405 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.873977 31744 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:45.874745 31644 ts_tablet_manager.cc:1434] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.252s	user 0.006s	sys 0.009s
I20260709 13:09:45.871539 30408 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.871699 31860 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:45.879221 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:45.879899 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.880812 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:45.881136 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.881925 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.884320 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.867811 31635 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:45.887667 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:45.888324 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.890182 31591 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.890269 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.890929 31591 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:45.891183 31597 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.892871 30558 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:45.883702 31869 raft_consensus.cc:2764] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:45.892109 31858 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:45.894413 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:45.894850 31875 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:45.894959 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:45.895272 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.887334 31756 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:09:45.895756 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.896406 31756 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:45.896550 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.896778 31756 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:45.864619 31783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43936 (request call id 215) took 2630 ms. Trace:
I20260709 13:09:45.864938 31749 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:45.880378 31744 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.892253 31601 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.885156 31739 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.886425 31589 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:45.921262 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.924647 30553 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.916400 30555 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:45.887202 31717 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:45.891883 31591 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:45.925351 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.897605 31756 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:45.937709 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 53421.4us
I20260709 13:09:45.940150 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.940853 30555 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:45.942442 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:45.945310 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:45.941756 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:45.949065 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.931119 31739 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:45.928550 31589 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.932638 31867 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.952965 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:45.885317 31865 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:09:45.963462 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:45.965415 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.966574 30553 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:45.970685 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:45.974671 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:45.975102 30408 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:45.954247 31869 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:45.945593 31793 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.966826 31591 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:45.960069 31589 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.036412 31878 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:45.974228 31756 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.960386 31867 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:46.032087 31601 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:45.977653 31606 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:45.973965 31864 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:09:46.021194 31869 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:45.977485 31825 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.023061 31793 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:45.926244 31856 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.100399 31601 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:46.121282 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 160757us
W20260709 13:09:46.112543 31880 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:09:46.113564 31876 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:09:45.953192 31749 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:46.028843 31591 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:09:46.126024 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 155411us
I20260709 13:09:46.055873 31867 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.099187 31869 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.906387 31783 rpcz_store.cc:276] 0709 13:09:43.232336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.232751 (+   415us) service_pool.cc:224] Handling call
0709 13:09:43.555843 (+323092us) ts_tablet_manager.cc:934] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:09:45.330381 (+1774538us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:45.664994 (+334613us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:45.665118 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:45.805772 (+140654us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:45.842383 (+ 36611us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:45.859789 (+ 17406us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:45.863015 (+  3226us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":36144,"tablet-copy.queue_time_us":191999,"thread_start_us":100384,"threads_started":2}
I20260709 13:09:46.097165 31606 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.138971 31591 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.154884 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.026685 31739 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.126827 31601 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.155376 31749 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.144687 31632 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.159909 31601 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.160413 31632 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.145294 31825 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:09:46.155464 31783 tablet_copy_client.cc:806] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:46.162021 31783 tablet_copy_client.cc:670] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:46.162084 31606 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.162882 30406 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.165706 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.149053 31878 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:46.167887 31740 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.172171 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.173909 31886 raft_consensus.cc:2764] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:46.174443 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.174554 31886 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:46.171481 31632 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.180033 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.181210 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.182292 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:46.171617 31878 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:46.186635 31825 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.182286 31740 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.189941 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.190948 31146 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:46.186563 31886 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:09:46.191267 31825 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.199123 31589 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.199445 31873 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.165851 31793 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.204144 31793 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.208040 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.208632 30405 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:46.209697 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.201453 31885 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.213297 31628 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.219482 31628 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.221467 31628 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.222972 31146 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:46.223385 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:46.223954 30407 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.227734 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:46.229620 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:46.232636 31879 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:46.232411 31865 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.233045 31755 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:46.222489 31635 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.233618 31755 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.236451 31882 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:09:46.238824 31640 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:46.245277 31882 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:46.251186 31882 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.253485 31882 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.253754 30305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 187) took 5490 ms. Trace:
I20260709 13:09:46.254627 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:45.335603 30552 rpcz_store.cc:276] 0709 13:09:43.094162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.605703 (+1511541us) service_pool.cc:224] Handling call
0709 13:09:44.627816 (+ 22113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.628078 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:45.128909 (+500831us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.317257 (+188348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.317305 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.317346 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.317411 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.317527 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25725,"prepare.queue_time_us":653086,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":20712,"thread_start_us":621079,"threads_started":2}
I20260709 13:09:46.190971 31878 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:46.261559 31890 consensus_queue.cc:1175] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "19556a24b91d452d98668a3709fbc29d" responder_term: 4 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:46.239202 31640 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.262786 31635 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.263427 31640 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.264822 31640 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.254256 30305 rpcz_store.cc:276] 0709 13:09:40.764434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.778925 (+ 14491us) service_pool.cc:224] Handling call
0709 13:09:46.253689 (+5474764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:42.598870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:42.718750 (+119880us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:42.763421 (+ 44671us) write_op.cc:435] Acquired schema lock
0709 13:09:42.777833 (+ 14412us) tablet.cc:662] Decoding operations
0709 13:09:42.921468 (+143635us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:42.921535 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:42.921574 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:42.921913 (+   339us) tablet.cc:701] Row locks acquired
0709 13:09:42.921930 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:42.922076 (+   146us) write_op.cc:270] Start()
0709 13:09:42.922185 (+   109us) write_op.cc:276] Timestamp: P: 1783602582922027 usec, L: 0
0709 13:09:42.922206 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:42.923111 (+   905us) log.cc:844] Serialized 979 byte log entry
0709 13:09:44.227305 (+1304194us) op_driver.cc:464] REPLICATION: finished
0709 13:09:45.120088 (+892783us) write_op.cc:301] APPLY: starting
0709 13:09:45.124394 (+  4306us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:45.153428 (+ 29034us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:45.169479 (+ 16051us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:45.240612 (+ 71133us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:45.265570 (+ 24958us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:45.272195 (+  6625us) write_op.cc:312] APPLY: finished
0709 13:09:45.289784 (+ 17589us) log.cc:844] Serialized 28 byte log entry
0709 13:09:45.323553 (+ 33769us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.331066 (+  7513us) write_op.cc:454] Released schema lock
0709 13:09:45.331108 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:45.331431 (+   323us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:45.331471 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":187535,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":868599,"apply.run_cpu_time_us":8079,"apply.run_wall_time_us":213902,"num_ops":2,"prepare.queue_time_us":1575907,"prepare.run_cpu_time_us":3784,"prepare.run_wall_time_us":324509,"replication_time_us":1288283,"thread_start_us":896425,"threads_started":1}]]}
I20260709 13:09:46.268061 30560 raft_consensus.cc:2410] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:46.269085 31773 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:46.203541 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:46.273372 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 75700.8us
I20260709 13:09:46.274145 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.275090 31873 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.277056 30402 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.283520 31752 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.291363 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.295100 31755 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.297605 31653 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:46.298208 31653 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.299485 31773 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.303225 31800 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:46.303628 31800 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.304251 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:46.304370 31800 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.305691 31800 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.307482 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:46.308203 30557 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:46.309688 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 13:09:46.317994 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.321287 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.331938 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.334232 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-2e1b5d40df944767ab310e2bd822d5b0 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:46.334884 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-2e1b5d40df944767ab310e2bd822d5b0 on tablet 2e1b5d40df944767ab310e2bd822d5b0 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.334811 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.336117 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.336541 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.337054 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.337553 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.338016 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.339166 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.340682 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:46.341077 31570 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.342159 30552 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:46.342969 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.344106 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.344647 31858 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.345108 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.345968 31858 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:46.346100 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.350528 31858 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.350909 31858 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.347401 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.352494 30484 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:46.346566 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.298256 30407 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:46.356585 30558 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.359869 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:46.361083 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:46.354122 30482 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:46.348483 31793 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:09:46.354576 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.362716 30404 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:46.315554 31850 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.331050 31597 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:46.375124 31597 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.377655 31597 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.366168 31147 raft_consensus.cc:1217] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:46.334270 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.347698 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.365104 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.366186 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:46.363551 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.386032 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:46.373400 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:46.374305 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.389145 30480 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:46.389210 30558 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.388203 31890 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.391038 31570 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:46.391749 31890 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.348583 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.394341 31890 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.349771 31769 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.400727 31783 tablet_copy_client.cc:538] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:46.401031 31781 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:46.401592 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 208306us
I20260709 13:09:46.406755 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.403010 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:46.382475 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:46.428146 30557 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:46.429069 30553 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:46.429730 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.430050 31892 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:46.434782 31892 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.436290 31756 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:46.436661 31756 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.436775 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:46.437559 31756 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.439424 31756 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.441766 31869 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.445190 31865 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:46.445753 31865 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.446856 31660 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:46.446967 31564 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.448092 31564 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.448426 31564 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.449191 31564 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.450291 31564 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.409847 31789 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:46.451234 31789 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.451570 31789 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.455121 30477 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:46.418278 31597 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.423081 31793 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.437067 31796 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.466141 31796 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.456696 31628 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:46.467458 31628 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.467803 31628 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.468658 31628 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.469400 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:46.469743 31628 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.470002 30554 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:46.471916 31151 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:46.471844 31867 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.472257 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.473608 31589 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:46.474532 30405 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.475421 31636 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.477103 31867 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.456749 31869 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:46.464879 31145 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.465498 31793 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.483759 31867 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.489095 30480 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.489380 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:46.489971 30553 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:46.492540 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.488178 31867 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.521605 31864 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:46.522063 31864 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:46.523077 31867 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.522878 31864 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.493984 31865 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.493703 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.524143 31864 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.493647 31796 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.495113 31793 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.526567 31796 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:46.535794 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 352353us
I20260709 13:09:46.536763 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.538210 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:46.504936 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.550149 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.548316 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:46.554790 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.556605 30374 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.558060 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.554790 30555 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:46.558403 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:46.563859 31867 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:46.566123 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.566257 31888 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.549779 31865 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.550500 30481 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.564812 30409 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:46.567174 31869 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.570307 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.563650 31596 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.567373 30407 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:09:46.563624 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.569311 31791 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.571435 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:46.606864 30374 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.630900 30553 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:46.629786 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:46.600988 31636 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.632196 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.500430 31591 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.651194 31791 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.609272 31740 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.663113 31791 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.670646 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:46.663954 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.651361 31781 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:46.666931 31894 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:46.604866 31865 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.664597 31856 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.673830 30558 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:46.683651 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.686424 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.704532 30555 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:46.711890 30408 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:46.670276 31890 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:46.741459 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57919.4us
I20260709 13:09:46.725713 31785 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.719911 31800 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.721503 30409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:09:46.747963 31597 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:46.767190 31893 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:46.801079 30376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.006s	sys 0.030s
W20260709 13:09:46.804891 30376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.031s
W20260709 13:09:46.791803 31148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.015s
I20260709 13:09:46.708539 31888 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:09:46.725899 31752 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:09:46.823568 31893 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.824561 31893 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.804383 30409 raft_consensus.cc:606] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:46.827651 31865 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:46.832381 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.833124 30409 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
W20260709 13:09:46.835458 31653 consensus_meta.cc:287] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 13:09:46.835973 31653 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.837147 30402 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:46.838944 31653 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:46.792121 31739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.010s	sys 0.010s
I20260709 13:09:46.767735 31785 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:46.802320 31597 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.819005 31888 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.750384 31858 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.840926 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.861128 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.862087 30477 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:46.805773 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 596341us
I20260709 13:09:46.842269 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.868031 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:46.871454 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:46.837179 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:46.804510 31808 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.036s
W20260709 13:09:46.816200 31148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.004s	sys 0.016s
I20260709 13:09:46.855762 30409 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:46.856501 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.859934 31149 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.018s	sys 0.031s
W20260709 13:09:46.881327 31149 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.018s	sys 0.031s
I20260709 13:09:46.875658 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.877612 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:46.879436 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:46.882467 30477 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:09:46.883510 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.883666 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:46.878540 31660 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:46.884419 31895 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:46.885169 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:46.855178 31739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.011s
I20260709 13:09:46.892742 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.898805 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:46.903020 31564 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.903426 31564 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.904187 31564 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.905498 31564 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.906371 30477 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:09:46.906936 30477 pending_rounds.cc:85] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 4
I20260709 13:09:46.887917 31756 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:46.885193 31660 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.908854 31756 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:46.909291 31756 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.859690 31888 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:46.911666 31888 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:46.912475 31636 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.885552 31895 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.913229 31888 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.913609 31895 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:46.914021 31895 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.915043 30410 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.910224 31756 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.918373 31756 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:46.919715 31640 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.007s
I20260709 13:09:46.920382 31597 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.921330 31597 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.908862 30477 pending_rounds.cc:107] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:46.923101 30477 raft_consensus.cc:2889] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.924089 31783 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:09:46.924523 30477 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:46.925611 30477 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.927062 31785 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.928193 31785 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.879701 31606 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:46.873740 31808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.001s	sys 0.036s
I20260709 13:09:46.933104 30404 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:46.935499 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.930976 31606 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:46.938416 31606 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:46.938560 31635 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:46.939003 30557 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:46.886667 31653 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:46.939695 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.941627 31858 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:46.942584 31636 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.943384 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:46.943238 31895 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:46.947239 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:46.962862 30404 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:46.880709 31800 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:46.952663 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.949601 31640 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:46.864055 31150 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.018s
I20260709 13:09:46.975952 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:46.977244 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:46.980161 30485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.029s
W20260709 13:09:46.975124 31825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.008s	sys 0.020s
W20260709 13:09:46.981504 30485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.029s
I20260709 13:09:46.956724 31869 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:09:46.992117 30449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.000s	sys 0.027s
I20260709 13:09:46.968538 31800 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:09:46.975732 31150 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.006s	sys 0.019s
I20260709 13:09:46.957763 31653 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:46.981909 31860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.024s	sys 0.014s
I20260709 13:09:46.975709 31145 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
W20260709 13:09:47.017233 30484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.018s	sys 0.012s
W20260709 13:09:47.076576 30484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.018s	sys 0.012s
W20260709 13:09:47.012512 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.000s	sys 0.029s
I20260709 13:09:46.980069 31769 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.011154 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:09:46.987234 31825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.008s	sys 0.021s
W20260709 13:09:47.037545 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.078533 30480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.015s	sys 0.019s
I20260709 13:09:46.981801 31890 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.987953 31864 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.082105 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.013545 31786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.037s	sys 0.042s
I20260709 13:09:47.007468 31640 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:47.081343 30480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.016s	sys 0.019s
W20260709 13:09:47.016958 31860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.024s	sys 0.014s
I20260709 13:09:47.013875 31895 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:47.151847 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.177814 31892 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:47.015347 31800 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:47.141244 31786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.037s	sys 0.042s
I20260709 13:09:47.010612 31636 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
W20260709 13:09:47.214519 30486 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.013s	sys 0.024s
W20260709 13:09:47.241241 30486 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.014s	sys 0.027s
W20260709 13:09:47.274272 30551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.029s
W20260709 13:09:47.274861 30551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.011s	sys 0.030s
I20260709 13:09:47.200790 31869 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:47.290648 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1009) took 1401 ms. Trace:
I20260709 13:09:47.210455 31890 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.306885 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.001s	sys 0.041s
W20260709 13:09:47.372761 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.004s	sys 0.043s
W20260709 13:09:47.376348 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 707949us
I20260709 13:09:47.308157 30551 rpcz_store.cc:276] 0709 13:09:45.889017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.889124 (+   107us) service_pool.cc:224] Handling call
0709 13:09:45.889355 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.889535 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:45.908635 (+ 19100us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.193507 (+284872us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800449140. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:09:47.290288 (+1096781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.290364 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:47.290404 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.290472 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.290593 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18954,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2075,"raft.queue_time_us":68828,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":27413248,"thread_start_us":1096087,"threads_started":2,"wal-append.queue_time_us":923430}
I20260709 13:09:47.268250 31895 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:47.199249 31640 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:47.290686 31865 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:47.404726 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:47.455386 30551 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.289562 31786 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.297353 31869 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:47.296408 31739 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.213147 31892 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:47.473348 31756 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.002s
I20260709 13:09:47.488837 31786 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:47.392105 31890 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:47.529994 30553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.117s	sys 0.181s
W20260709 13:09:47.533993 30553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.117s	sys 0.181s
I20260709 13:09:47.534961 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1039) took 1043 ms. Trace:
I20260709 13:09:47.454345 31895 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:47.579456 30553 rpcz_store.cc:276] 0709 13:09:46.491426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.631805 (+140379us) service_pool.cc:224] Handling call
0709 13:09:46.660239 (+ 28434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.660519 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:46.669511 (+  8992us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.534492 (+864981us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.534563 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:47.534621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.534728 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.534896 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8739,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":158486,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":864662,"threads_started":1}
I20260709 13:09:47.489261 31739 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:47.643715 30551 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:47.645141 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:47.627007 31902 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:09:47.559938 31653 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:47.557358 31869 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:47.703807 31869 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.715497 31920 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:47.716156 31920 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:47.723439 31919 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:47.724190 31919 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:47.767973 31149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.004s	sys 0.032s
W20260709 13:09:47.768618 31149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.004s	sys 0.033s
W20260709 13:09:47.780659 31808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.000s	sys 0.008s
W20260709 13:09:47.781195 31808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.000s	sys 0.008s
W20260709 13:09:47.821234 30478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.013s	sys 0.038s
W20260709 13:09:47.821964 30478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.013s	sys 0.038s
I20260709 13:09:47.823144 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1375) took 1497 ms. Trace:
I20260709 13:09:47.661089 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:47.659758 31916 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:09:47.669729 31901 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:09:47.670511 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:47.864538 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 64) took 1537 ms. Trace:
I20260709 13:09:47.864624 31151 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:09:47.679231 31907 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 13:09:47.865000 30480 rpcz_store.cc:276] 0709 13:09:46.390477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.494777 (+104300us) service_pool.cc:224] Handling call
0709 13:09:46.495094 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.495400 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.495428 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.495895 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.141909 (+646014us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:47.141966 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.142052 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.864310 (+722258us) raft_consensus.cc:1685] finished
0709 13:09:47.864329 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.864478 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4438,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":50005,"thread_start_us":576496,"threads_started":1,"wal-append.queue_time_us":1042200}
I20260709 13:09:47.866571 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 74) took 1563 ms. Trace:
I20260709 13:09:47.866946 30556 rpcz_store.cc:276] 0709 13:09:46.302869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.305612 (+  2743us) service_pool.cc:224] Handling call
0709 13:09:46.306026 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.306442 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.306492 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.337858 (+ 31366us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.801706 (+463848us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:46.811673 (+  9967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.816399 (+  4726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.866370 (+1049971us) raft_consensus.cc:1685] finished
0709 13:09:47.866388 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.866518 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":584,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":453581,"threads_started":1,"wal-append.queue_time_us":745796}
I20260709 13:09:47.869267 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:47.870223 30556 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:47.871297 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1249) took 1004 ms. Trace:
I20260709 13:09:47.871789 30556 rpcz_store.cc:276] 0709 13:09:46.866915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.868909 (+1001994us) service_pool.cc:224] Handling call
0709 13:09:47.870675 (+  1766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.873163 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:47.874346 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1246) took 1008 ms. Trace:
I20260709 13:09:47.874840 30556 rpcz_store.cc:276] 0709 13:09:46.865771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.872847 (+1007076us) service_pool.cc:224] Handling call
0709 13:09:47.874098 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.687829 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 119) took 1739 ms. Trace:
I20260709 13:09:47.875638 31148 rpcz_store.cc:276] 0709 13:09:45.948169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.951395 (+  3226us) service_pool.cc:224] Handling call
0709 13:09:46.024329 (+ 72934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.132329 (+108000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.142971 (+ 10642us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.170852 (+ 27881us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.894272 (+723420us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:46.943789 (+ 49517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.943901 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.687552 (+743651us) raft_consensus.cc:1685] finished
0709 13:09:47.687576 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.687752 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2330,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":21640,"thread_start_us":707375,"threads_started":1,"wal-append.queue_time_us":919335}
I20260709 13:09:47.686228 31890 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:47.823709 30478 rpcz_store.cc:276] 0709 13:09:46.325452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.394711 (+ 69259us) service_pool.cc:224] Handling call
0709 13:09:46.395056 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.395287 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:46.817794 (+422507us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.822597 (+1004803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.822688 (+    91us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:47.822768 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.822878 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.823067 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138717,"prepare.queue_time_us":1160751,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":1563,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":1420943,"threads_started":2,"wal-append.queue_time_us":897816}
I20260709 13:09:47.875957 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:47.885876 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1242) took 1022 ms. Trace:
I20260709 13:09:47.886399 30556 rpcz_store.cc:276] 0709 13:09:46.863976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.875697 (+1011721us) service_pool.cc:224] Handling call
0709 13:09:47.885799 (+ 10102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.887538 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:47.894281 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1038) took 1404 ms. Trace:
I20260709 13:09:47.978042 30555 rpcz_store.cc:276] 0709 13:09:46.490041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.564089 (+ 74048us) service_pool.cc:224] Handling call
0709 13:09:46.689539 (+125450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.714116 (+ 24577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.893963 (+1179847us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003f3750. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:47.894204 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287648128}
I20260709 13:09:47.896476 31717 raft_consensus.cc:3055] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:47.899947 31628 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.430s	user 0.022s	sys 0.002s
W20260709 13:09:47.900359 30482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.531s	user 0.030s	sys 0.039s
W20260709 13:09:47.980749 30482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.030s	sys 0.039s
W20260709 13:09:47.901191 30408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.030s	sys 0.013s
I20260709 13:09:47.912470 30406 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:47.982174 30408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.030s	sys 0.013s
I20260709 13:09:47.983148 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 86) took 1162 ms. Trace:
I20260709 13:09:47.983656 30408 rpcz_store.cc:276] 0709 13:09:46.821208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.821366 (+   158us) service_pool.cc:224] Handling call
0709 13:09:46.821744 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.822075 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.822107 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.822560 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.982686 (+1160126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:47.982761 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.982844 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.982914 (+    70us) raft_consensus.cc:1685] finished
0709 13:09:47.982931 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.983081 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"thread_start_us":1159707,"threads_started":1,"wal-append.queue_time_us":889153}
I20260709 13:09:47.913094 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1369) took 1556 ms. Trace:
I20260709 13:09:47.985984 30402 rpcz_store.cc:276] 0709 13:09:46.356580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.356709 (+   129us) service_pool.cc:224] Handling call
0709 13:09:47.912055 (+1555346us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003ed354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:47.913015 (+   960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035463936}
W20260709 13:09:47.913903 30552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.436s	user 0.016s	sys 0.021s
I20260709 13:09:47.930753 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1361) took 1721 ms. Trace:
W20260709 13:09:47.987448 30552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.016s	sys 0.021s
I20260709 13:09:47.987488 30405 rpcz_store.cc:276] 0709 13:09:46.209284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.230440 (+ 21156us) service_pool.cc:224] Handling call
0709 13:09:46.230719 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.475042 (+244323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.930368 (+1455326us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400209754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:47.930645 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560205184}
I20260709 13:09:47.988250 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1237) took 1635 ms. Trace:
I20260709 13:09:47.988677 30552 rpcz_store.cc:276] 0709 13:09:46.352615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.401912 (+ 49297us) service_pool.cc:224] Handling call
0709 13:09:46.416303 (+ 14391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.416564 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.416600 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.431786 (+ 15186us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.987932 (+1556146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:47.987972 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.988038 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.988079 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:47.988090 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.988199 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1509643,"threads_started":1,"wal-append.queue_time_us":1262114}
W20260709 13:09:47.991101 30524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.031s
W20260709 13:09:47.938166 31909 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.431s	user 0.007s	sys 0.010s
I20260709 13:09:47.939843 31555 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:47.942055 31796 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:47.949448 31749 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.002576 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1037) took 1102 ms. Trace:
I20260709 13:09:47.953073 31865 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:47.956034 31739 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:47.957039 30376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.011s	sys 0.007s
W20260709 13:09:48.022847 30376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.011s	sys 0.007s
W20260709 13:09:48.023168 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.04233e+06us
I20260709 13:09:48.023923 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:47.958266 31606 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.004s
I20260709 13:09:47.959261 31919 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:47.959929 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 50) took 3691 ms. Trace:
I20260709 13:09:47.960927 30407 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:47.962284 31640 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:47.963433 31895 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:47.977479 31878 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:47.963996 31857 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:47.965463 30449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.005s	sys 0.006s
W20260709 13:09:48.048242 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.005s	sys 0.007s
I20260709 13:09:47.966789 31591 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:47.967751 31888 consensus_meta.cc:287] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.054s	user 0.008s	sys 0.008s
I20260709 13:09:47.967746 31786 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:47.968669 31597 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.047s	user 0.013s	sys 0.004s
I20260709 13:09:47.971666 31920 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:47.972080 30554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.009s	sys 0.004s
W20260709 13:09:47.974993 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.009s
W20260709 13:09:48.059301 30554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.009s	sys 0.004s
W20260709 13:09:48.059429 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.009s
W20260709 13:09:48.059921 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 650049us
W20260709 13:09:47.975155 30374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.017s	sys 0.001s
W20260709 13:09:48.061388 30374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.017s	sys 0.001s
I20260709 13:09:48.061668 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 83) took 1607 ms. Trace:
I20260709 13:09:48.062022 30406 rpcz_store.cc:276] 0709 13:09:46.454673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.454985 (+   312us) service_pool.cc:224] Handling call
0709 13:09:47.912207 (+1457222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.981832 (+ 69625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.061495 (+ 79663us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003ed350. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:48.061616 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3350613376}
I20260709 13:09:48.063161 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:47.975642 30484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.003s	sys 0.025s
I20260709 13:09:48.063856 30406 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:48.063934 30484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.003s	sys 0.025s
I20260709 13:09:48.028617 31929 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.994278 30524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.031s
W20260709 13:09:48.026651 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 127750us
I20260709 13:09:48.030953 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1041) took 1194 ms. Trace:
I20260709 13:09:48.047379 31653 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:48.037647 30551 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:48.075732 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1243) took 1211 ms. Trace:
I20260709 13:09:48.044996 31927 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.041064 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:48.043228 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:09:47.964143 31150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.011s	sys 0.008s
W20260709 13:09:48.018914 30409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.004s	sys 0.020s
I20260709 13:09:47.980981 31717 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:48.031510 30485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.000s	sys 0.014s
W20260709 13:09:48.089485 30485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.000s	sys 0.015s
I20260709 13:09:48.029187 30483 rpcz_store.cc:276] 0709 13:09:44.268498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.437426 (+168928us) service_pool.cc:224] Handling call
0709 13:09:44.437723 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.579843 (+142120us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:45.117957 (+538114us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.281211 (+163254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.281266 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.281303 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.550966 (+1269663us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800361180. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419
0709 13:09:47.959633 (+1408667us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400343fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:47.959702 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.959857 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179649,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":74,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11325,"spinlock_wait_cycles":331328640,"thread_start_us":693471,"threads_started":2,"wal-append.queue_time_us":375325,"wal-append.run_cpu_time_us":1462,"wal-append.run_wall_time_us":1013792}
I20260709 13:09:48.091174 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:47.999961 31604 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:48.011485 31744 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:48.052769 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.008s	sys 0.010s
W20260709 13:09:48.096647 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.010s
W20260709 13:09:48.053551 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.000293 31892 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:48.030336 31785 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.102s	user 0.018s	sys 0.002s
I20260709 13:09:48.055101 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 300) took 1874 ms. Trace:
W20260709 13:09:48.027060 31660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.016s	sys 0.008s
I20260709 13:09:47.932090 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 79) took 1574 ms. Trace:
I20260709 13:09:48.029096 31781 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:48.068006 30526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.034s
I20260709 13:09:48.019989 30403 rpcz_store.cc:276] 0709 13:09:46.900361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.900798 (+   437us) service_pool.cc:224] Handling call
0709 13:09:46.901118 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.964082 (+1062964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.964120 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.964172 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:47.964214 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.002242 (+ 38028us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400268254. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:48.002308 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.002499 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444159872}
I20260709 13:09:48.044716 30407 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:48.071107 30552 rpcz_store.cc:276] 0709 13:09:46.836131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.999429 (+1163298us) service_pool.cc:224] Handling call
0709 13:09:48.030467 (+ 31038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.030629 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.030653 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.030712 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:48.030738 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.030787 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.030901 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.034063 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:48.082243 31596 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:48.061055 30525 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:48.061807 30556 raft_consensus.cc:2410] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:48.081602 31786 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.076049 30551 rpcz_store.cc:276] 0709 13:09:46.864445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.644825 (+780380us) service_pool.cc:224] Handling call
0709 13:09:48.075675 (+430850us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:48.108769 31660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.016s	sys 0.008s
I20260709 13:09:48.044881 31890 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.027842 31796 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.027453 31749 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.054663 31911 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.079525 30404 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:48.030978 31865 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.081485 30477 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:48.077327 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:48.049612 31900 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.095238 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:48.099946 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.065814 31591 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.045145 31606 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:48.081790 31150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.011s	sys 0.008s
W20260709 13:09:48.077265 31893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.024s	sys 0.009s
W20260709 13:09:48.085160 30409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.004s	sys 0.020s
W20260709 13:09:48.109220 30526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.034s
I20260709 13:09:48.074612 31888 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:48.067869 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1034) took 1586 ms. Trace:
I20260709 13:09:48.102733 31744 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:48.075177 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1272) took 1753 ms. Trace:
I20260709 13:09:48.115053 31857 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:48.116602 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:48.038590 30553 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:48.100880 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:48.117920 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 56956.4us
W20260709 13:09:48.107632 31885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.890s	user 0.043s	sys 0.068s
I20260709 13:09:48.106406 31149 rpcz_store.cc:276] 0709 13:09:46.180901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.186432 (+  5531us) service_pool.cc:224] Handling call
0709 13:09:46.191197 (+  4765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.191385 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:46.891653 (+700268us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.054384 (+1162731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.054452 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.054516 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.054707 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.054907 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1302549,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":194594,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":1852298,"threads_started":3,"wal-append.queue_time_us":830669}
I20260709 13:09:48.109051 31935 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:48.124119 31591 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.124786 31900 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.125629 31796 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:48.073475 31929 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.110687 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1276) took 1787 ms. Trace:
I20260709 13:09:48.127202 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:48.128206 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:48.130053 31660 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.113502 31785 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.086758 31927 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.106729 31604 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.151013 31653 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:48.143004 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:48.120674 31786 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:48.297784 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.112169 31781 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:48.223662 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 87809us
W20260709 13:09:48.209983 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.383244 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1042) took 1546 ms. Trace:
I20260709 13:09:48.274612 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:48.123114 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1244) took 1258 ms. Trace:
I20260709 13:09:48.351145 30480 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:48.264219 30484 rpcz_store.cc:276] 0709 13:09:46.321470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.355080 (+ 33610us) service_pool.cc:224] Handling call
0709 13:09:46.355348 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.355521 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:47.077028 (+721507us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.074779 (+997751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.074839 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:48.074879 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.074990 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.075121 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135430,"prepare.queue_time_us":952645,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":89,"raft.queue_time_us":44857,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3599,"thread_start_us":1708189,"threads_started":2,"wal-append.queue_time_us":883058}
I20260709 13:09:48.198805 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1271) took 1877 ms. Trace:
I20260709 13:09:48.274159 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:48.340869 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1275) took 2018 ms. Trace:
I20260709 13:09:48.427019 30482 rpcz_store.cc:276] 0709 13:09:46.322192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.368787 (+ 46595us) service_pool.cc:224] Handling call
0709 13:09:46.369079 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.369287 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:47.993878 (+1624591us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.340406 (+346528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.340482 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:48.340541 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.340631 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.340796 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156189,"prepare.queue_time_us":1139953,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":7749,"raft.queue_time_us":162553,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":25075,"thread_start_us":1802191,"threads_started":2,"wal-append.queue_time_us":190700}
I20260709 13:09:48.421135 30552 rpcz_store.cc:276] 0709 13:09:46.836361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.301721 (+1465360us) service_pool.cc:224] Handling call
0709 13:09:48.382577 (+ 80856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.382808 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.382845 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.382913 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:48.382956 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.383026 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.383174 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.273500 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:48.430064 30404 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:48.188138 31732 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:48.432916 30403 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:48.281905 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:48.266077 30554 rpcz_store.cc:276] 0709 13:09:46.481174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.482425 (+  1251us) service_pool.cc:224] Handling call
0709 13:09:46.482812 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.483072 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.483112 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.944364 (+461252us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:09:46.944928 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.059865 (+1114937us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:48.059904 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.059994 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.060054 (+    60us) raft_consensus.cc:1685] finished
0709 13:09:48.060071 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.067777 (+  7706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202560768,"thread_start_us":1114476,"threads_started":1,"wal-append.queue_time_us":1020764}
I20260709 13:09:48.420481 30551 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:48.421058 30477 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:48.419525 30553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1245) took 1554 ms (client timeout 1952 ms). Trace:
W20260709 13:09:48.440200 30553 rpcz_store.cc:269] 0709 13:09:46.865379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.637350 (+771971us) service_pool.cc:224] Handling call
0709 13:09:48.419456 (+782106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.199271 30560 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:48.156338 31749 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:48.206482 31944 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.376911 31783 tablet_bootstrap.cc:700] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Time spent opening tablet: real 0.236s	user 0.000s	sys 0.002s
W20260709 13:09:48.182492 31893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.024s	sys 0.009s
I20260709 13:09:48.216144 31861 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.201375 31949 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.209426 31938 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.231s
I20260709 13:09:48.341363 31595 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.122961 31911 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.425532 30486 rpcz_store.cc:276] 0709 13:09:46.321221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.351087 (+ 29866us) service_pool.cc:224] Handling call
0709 13:09:46.351348 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.351536 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:47.928317 (+1576781us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b18003614e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa048aa13c7 00007fa0450b39a7 00007fa0450c30bf
0709 13:09:47.928546 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.198376 (+269830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.198443 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:48.198496 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.198571 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.198743 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63949,"prepare.queue_time_us":889203,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":81092,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6359,"spinlock_wait_cycles":100140800,"thread_start_us":1095202,"threads_started":3,"wal-append.queue_time_us":179845}
W20260709 13:09:48.182937 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 165353us
I20260709 13:09:48.448971 31894 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.202545 31856 consensus_meta.cc:287] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 1.494s	user 0.009s	sys 0.010s
W20260709 13:09:48.226358 31931 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:09:48.263293 31885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.046s	user 0.053s	sys 0.068s
I20260709 13:09:48.136695 31717 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.298535 31660 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.235888 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 299) took 2057 ms. Trace:
I20260709 13:09:48.126543 31890 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.202243 31933 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.260s
I20260709 13:09:48.151350 31951 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.305482 31785 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.142551 31886 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.202170 31559 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.461427 30554 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:48.606400 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1247) took 1740 ms. Trace:
I20260709 13:09:48.606752 30554 rpcz_store.cc:276] 0709 13:09:46.866139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.437390 (+1571251us) service_pool.cc:224] Handling call
0709 13:09:48.437785 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.606143 (+168358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.606344 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:48.607182 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.139499 31917 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.447739 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:48.593838 31953 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:09:48.447412 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.462371 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 317881us
W20260709 13:09:48.356779 31800 consensus_meta.cc:287] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.115s	user 0.009s	sys 0.009s
I20260709 13:09:48.152925 31919 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:48.198212 31789 consensus_meta.cc:287] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.746s	user 0.013s	sys 0.014s
I20260709 13:09:48.341691 31950 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.471951 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 328983us
I20260709 13:09:48.380744 31597 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.567461 31595 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.298945 31796 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.381381 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:48.343027 31808 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.377202 31957 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:48.478452 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 435317us
I20260709 13:09:48.474859 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 82) took 1634 ms. Trace:
I20260709 13:09:48.481321 31947 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.481139 31739 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.108914 30557 rpcz_store.cc:276] 0709 13:09:46.357431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.429296 (+ 71865us) service_pool.cc:224] Handling call
0709 13:09:46.429605 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.953301 (+523696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.931742 (+978441us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001d9cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:47.932003 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171099904}
I20260709 13:09:48.340830 30481 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:48.443063 31793 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:48.216557 30478 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:48.526980 31959 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:48.527845 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 141037us
I20260709 13:09:48.647207 31591 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.586768 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1274) took 2264 ms. Trace:
I20260709 13:09:48.530144 31949 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.469398 31749 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.143232 31940 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.349s
I20260709 13:09:48.424999 30556 rpcz_store.cc:276] 0709 13:09:46.864866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.887268 (+1022402us) service_pool.cc:224] Handling call
0709 13:09:48.121160 (+233892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.299274 31888 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:48.443724 30551 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:48.589883 31954 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:48.590533 31960 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.588447 31606 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:48.223219 30407 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.297880 31935 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:48.594960 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.379566 31653 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.567847 31755 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:48.611902 30484 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:48.461699 30483 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
W20260709 13:09:48.762342 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.588755 31885 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:48.643224 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:48.643242 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:48.668954 31808 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:48.642230 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 115703us
I20260709 13:09:48.470225 31944 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.666850 30552 rpcz_store.cc:276] 0709 13:09:46.840255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.442735 (+1602480us) service_pool.cc:224] Handling call
0709 13:09:48.474152 (+ 31417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.474390 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.474422 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.474480 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.474547 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.474622 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.474785 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.668294 30410 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:48.668494 31962 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.639554 31919 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.592681 31894 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.677699 31967 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.642758 31917 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:48.679069 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 397222us
I20260709 13:09:48.762051 31781 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.640967 31933 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.446341 31564 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:48.698514 30485 rpcz_store.cc:276] 0709 13:09:46.321919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.356269 (+ 34350us) service_pool.cc:224] Handling call
0709 13:09:46.384854 (+ 28585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.387318 (+  2464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.387360 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.397989 (+ 10629us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.567344 (+169355us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b48000b19d8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:09:47.009189 (+441845us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.089984 (+1080795us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.534914 (+444930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.535024 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.535086 (+    62us) raft_consensus.cc:1685] finished
0709 13:09:48.584506 (+ 49420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.586674 (+  2168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114021,"prepare.queue_time_us":549496,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":29499,"raft.run_cpu_time_us":5895,"raft.run_wall_time_us":174708,"spinlock_wait_cycles":23198080,"thread_start_us":1966664,"threads_started":3,"wal-append.queue_time_us":1149585}
I20260709 13:09:48.266027 30479 rpcz_store.cc:276] 0709 13:09:46.322468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.379451 (+ 56983us) service_pool.cc:224] Handling call
0709 13:09:46.379873 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.380539 (+   666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.380583 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.381184 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.880330 (+499146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:46.880438 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.891346 (+ 10908us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.937434 (+1046088us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:09:48.081061 (+143627us) raft_consensus.cc:1685] finished
0709 13:09:48.084594 (+  3533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.109356 (+ 24762us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6711,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":17908,"spinlock_wait_cycles":47180544,"thread_start_us":471029,"threads_started":1,"wal-append.queue_time_us":988364}
I20260709 13:09:48.586547 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:48.666687 31957 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.642959 31800 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.669715 31786 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:48.717482 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:48.678130 31628 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.750416 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1043) took 1794 ms. Trace:
I20260709 13:09:48.842178 30551 rpcz_store.cc:276] 0709 13:09:46.955627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.443255 (+1487628us) service_pool.cc:224] Handling call
0709 13:09:48.443564 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.750130 (+306566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.750355 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.809552 31919 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:48.680836 31947 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.855934 31947 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.808543 31962 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.861308 31942 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.809056 31963 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.862030 31942 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:48.881199 31955 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:09:48.800320 31755 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.733970 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:48.650616 31597 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.666276 31796 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:48.718912 31924 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:09:48.611004 31951 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.917441 31911 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.594417 31150 rpcz_store.cc:276] 0709 13:09:46.178522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.180314 (+  1792us) service_pool.cc:224] Handling call
0709 13:09:46.180692 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.180920 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:47.079785 (+898865us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.153573 (+1073788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.188501 (+ 34928us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.202579 (+ 14078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.209807 (+  7228us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.231361 (+ 21554us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1291303,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":51635,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":1767271,"threads_started":2,"wal-append.queue_time_us":880284}
I20260709 13:09:48.644728 31789 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.719798 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1040) took 1884 ms. Trace:
I20260709 13:09:48.776612 31149 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:48.611303 31886 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.919698 30555 rpcz_store.cc:276] 0709 13:09:46.835859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.993321 (+1157462us) service_pool.cc:224] Handling call
0709 13:09:48.018072 (+ 24751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.018432 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.018472 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.028331 (+  9859us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.187164 (+158833us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:48.187215 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.187297 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.719529 (+532232us) raft_consensus.cc:1685] finished
0709 13:09:48.719559 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.719721 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124823,"threads_started":1,"wal-append.queue_time_us":135922}
I20260709 13:09:48.920739 30408 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:48.921181 31789 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:48.921813 30558 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:48.781742 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:48.793130 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:48.721127 31966 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:09:48.815343 30552 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:48.816665 30484 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:48.797868 30407 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:48.643417 31865 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:48.759433 31927 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.798770 31965 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.765071 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:48.647840 31950 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.747113 31749 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.789921 31604 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.817850 31917 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.886483 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 80) took 2489 ms. Trace:
I20260709 13:09:48.911759 31858 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.892081 31893 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.817613 31970 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:48.903923 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 170997us
I20260709 13:09:48.852278 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:48.858513 31962 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.846504 31957 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:48.849332 30551 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:48.850030 31943 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 13:09:48.801005 31954 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:48.908831 31785 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:48.833407 31591 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:48.760092 31882 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:48.715255 31959 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.884596 31660 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:48.878484 31900 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:48.846170 31564 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.904592 31636 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.934571 31973 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.863867 31628 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.939930 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:49.037739 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 97924.9us
I20260709 13:09:49.038445 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:48.941462 31978 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.942286 31865 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:48.946280 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.950510 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:49.039445 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:49.040875 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.041265 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:48.953070 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 309897us
I20260709 13:09:49.040925 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:48.963950 31856 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:48.890162 31929 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:48.911445 31890 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:48.916412 31781 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.986380 30559 rpcz_store.cc:276] 0709 13:09:46.396653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.434797 (+ 38144us) service_pool.cc:224] Handling call
0709 13:09:46.435166 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.435613 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.435649 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.002931 (+1567282us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:09:48.030041 (+ 27110us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.158394 (+128353us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:48.158442 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.158543 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.886096 (+727553us) raft_consensus.cc:1685] finished
0709 13:09:48.886125 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.886408 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"spinlock_wait_cycles":293145472,"thread_start_us":91030,"threads_started":1,"wal-append.queue_time_us":396637}
I20260709 13:09:49.000389 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:49.060271 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60018.7us
I20260709 13:09:49.002774 31858 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.801313 31960 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.007681 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.010279 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:09:49.015141 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.008617 31857 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:49.034446 30480 consensus_meta.cc:287] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
W20260709 13:09:49.042189 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 91780.9us
I20260709 13:09:49.074285 30480 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:49.076103 31152 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:49.076994 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:49.042523 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:48.951794 31793 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:48.845856 31967 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.048345 31785 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.007126 31893 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.013875 31640 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:49.023523 31595 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.061071 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:48.847419 31933 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:48.907840 31963 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.064936 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1039) took 2163 ms. Trace:
I20260709 13:09:49.036038 31959 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.043130 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.075915 31591 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.080662 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:49.108336 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65912.3us
I20260709 13:09:49.044334 31888 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.035732 31882 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.056062 31900 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.087993 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 81) took 2593 ms. Trace:
I20260709 13:09:49.210098 30558 rpcz_store.cc:276] 0709 13:09:46.494858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.741497 (+246639us) service_pool.cc:224] Handling call
0709 13:09:46.741824 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.922223 (+2180399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.087729 (+165506us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003f2854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:49.087911 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5013139840}
I20260709 13:09:49.082949 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.048914 31786 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.059849 31961 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.063500 31886 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.048821 31865 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.103034 31947 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.103618 31597 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.103847 31951 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.104066 31564 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.104135 31894 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.104393 30481 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:49.067312 31890 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.043880 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:49.263500 31900 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:49.039951 31636 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.073959 31857 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:49.078612 31927 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.141713 30486 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:49.092085 31929 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.205024 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:48.992571 31885 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.207690 31717 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.208017 31960 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.106029 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.087231 31756 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.087970 31940 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.087505 31962 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:49.136183 31935 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.146257 31949 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.205214 31800 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.266664 31786 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:49.047982 31978 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.002548 31965 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.274885 31967 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.211649 31982 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.022886 31970 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:49.278720 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 234976us
I20260709 13:09:49.303879 31962 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.144660 31591 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.269639 31796 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.267647 31944 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.236481 31975 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:49.271989 31886 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.063051 31973 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.277202 31947 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.276616 31954 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.285650 31977 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:49.286199 31994 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:09:49.291502 31869 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.587s	user 0.009s	sys 0.007s
I20260709 13:09:49.288450 31985 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:49.349730 31985 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.350193 31985 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.287161 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.082168 31983 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.228s
I20260709 13:09:49.289731 31749 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.265331 31793 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.295951 31628 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.319769 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.359302 30554 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:49.320163 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.058063 31660 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:49.293567 31927 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.293053 31929 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.361452 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.365450 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.305267 30478 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:49.106474 30409 rpcz_store.cc:276] 0709 13:09:46.901771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.903190 (+  1419us) service_pool.cc:224] Handling call
0709 13:09:46.903620 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.903915 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.903970 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.904678 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.300322 (+1395644us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:48.338737 (+ 38415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.354900 (+ 16163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.056391 (+701491us) raft_consensus.cc:1685] finished
0709 13:09:49.059469 (+  3078us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.064867 (+  5398us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1357805,"threads_started":1,"wal-append.queue_time_us":1164463}
I20260709 13:09:49.271756 31961 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.307080 31940 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.317153 31982 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:49.326041 31976 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 13:09:49.341599 30307 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.382187 30307 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.305083 31756 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.326156 31962 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.347399 31994 consensus_queue.cc:1243] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:09:49.348304 31878 consensus_meta.cc:287] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.298s	user 0.012s	sys 0.000s
I20260709 13:09:49.323722 31858 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:49.404210 31919 consensus_meta.cc:287] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.003s
I20260709 13:09:49.358093 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.344743 31947 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.366506 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.365876 31152 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:49.368984 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.311846 31857 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.360785 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.341116 31975 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.373638 31882 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.343102 31900 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.373979 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.342958 31786 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.374395 31983 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.379134 31596 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:49.379693 31825 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.343600 31886 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.360206 31636 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.358431 31917 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.395592 31963 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.396443 31744 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.359905 31893 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.331846 31151 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:49.406097 31149 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:49.406859 31972 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.381464 31628 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.381165 31982 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.426280 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.423442 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:49.465163 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.430528 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.405279 31867 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.432303 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.404096 31591 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.441949 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.470685 30477 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:49.471936 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.472651 30477 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:49.473765 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.399770 31950 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.436538 31857 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:49.445798 31973 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.436139 31983 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:49.457924 30450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.795s (SENT) [suppressed 30 similar messages]
I20260709 13:09:49.419727 31919 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.444455 31596 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.444221 31756 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.438665 31957 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.449468 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.475950 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.477043 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.477388 31636 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.480242 31960 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.456291 31970 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.474450 30477 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:49.468047 31628 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.536798 30554 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:49.537192 31744 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:49.547034 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.482841 31825 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.549104 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.467852 31972 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:49.552584 30551 raft_consensus.cc:2368] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4.
I20260709 13:09:49.580904 30483 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:49.543306 31756 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.536641 31978 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:49.566124 31989 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:09:49.486222 31867 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.595745 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:49.548349 31960 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:49.543584 31591 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.562898 31920 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.565744 31929 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.576810 31825 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.592970 31756 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.608011 31940 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.609259 31756 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.552738 31950 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:09:49.593541 31970 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.563663 31975 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.613476 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.553138 31636 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.560227 31962 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:49.609758 31997 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:09:49.599905 31927 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.603667 31825 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.606099 31957 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.605688 31920 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.602367 31591 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:49.629017 30407 consensus_meta.cc:287] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
I20260709 13:09:49.636482 30484 raft_consensus.cc:2368] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5.
I20260709 13:09:49.636818 30477 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:49.626034 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.629992 30410 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 13:09:49.640690 31632 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:49.640839 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 87) took 1680 ms. Trace:
I20260709 13:09:49.620904 31961 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.619129 31970 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.644948 31591 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.633641 30478 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.635115 31947 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.645750 30410 pending_rounds.cc:85] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 4
I20260709 13:09:49.627815 31972 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.658612 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1033) took 3179 ms. Trace:
I20260709 13:09:49.657672 31966 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.665419 30560 rpcz_store.cc:276] 0709 13:09:46.478813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.481666 (+  2853us) service_pool.cc:224] Handling call
0709 13:09:46.482033 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.441281 (+1959248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.658321 (+1217040us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400071cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:49.658539 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3948772224}
I20260709 13:09:49.669446 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.670203 30560 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:49.648149 30407 rpcz_store.cc:276] 0709 13:09:47.960256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.960381 (+   125us) service_pool.cc:224] Handling call
0709 13:09:47.960794 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.640254 (+1679460us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:49.640327 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.640407 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:49.640473 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.640581 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.640767 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5407,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":1419}
I20260709 13:09:49.671392 31628 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.649575 31151 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:49.681001 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:49.688977 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.664572 30410 pending_rounds.cc:107] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:49.655804 30478 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:49.661306 31919 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.692946 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.678122 31962 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.667830 31966 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:49.695560 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:49.707329 31636 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.703157 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:49.708722 31146 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:49.715031 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.716148 31974 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:49.716620 31974 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.700727 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.701406 31938 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:49.716936 31974 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.717154 31938 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:49.701661 31596 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.691125 30410 raft_consensus.cc:2889] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.626400 31983 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.719412 30560 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:49.695218 31972 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.694795 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:49.724323 31970 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.724004 31966 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.728423 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:49.729235 30558 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:49.736457 30559 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:49.718324 31938 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.741629 31938 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:49.742063 31941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.030s	sys 0.064s
W20260709 13:09:49.742558 31941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.030s	sys 0.064s
I20260709 13:09:49.735373 31983 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.746961 31966 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.771883 31951 raft_consensus.cc:993] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:09:49.772661 32002 raft_consensus.cc:1081] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:09:49.780382 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 123) took 1823 ms. Trace:
I20260709 13:09:49.780911 31148 rpcz_store.cc:276] 0709 13:09:47.957168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.957316 (+   148us) service_pool.cc:224] Handling call
0709 13:09:47.957706 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.609315 (+651609us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:48.614439 (+  5124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.615967 (+  1528us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:48.643213 (+ 27246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.780015 (+1136802us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54006d01d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:49.780081 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.780279 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2309,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8639,"spinlock_wait_cycles":1447741824}
W20260709 13:09:49.784318 30480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1283) took 1719 ms (client timeout 2041 ms). Trace:
W20260709 13:09:49.784837 30480 rpcz_store.cc:269] 0709 13:09:48.064723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.066389 (+  1666us) service_pool.cc:224] Handling call
0709 13:09:49.784107 (+1717718us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54001c6e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:49.784247 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527941504}
I20260709 13:09:49.791179 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1248) took 2924 ms. Trace:
I20260709 13:09:49.791715 30553 rpcz_store.cc:276] 0709 13:09:46.866491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.444045 (+1577554us) service_pool.cc:224] Handling call
0709 13:09:48.444308 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.614514 (+170206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:48.703913 (+ 89399us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.929085 (+225172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.929136 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.929177 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.790894 (+861717us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001d97d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:49.790964 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.791114 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40774,"prepare.queue_time_us":190750,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":34326,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":390974208,"thread_start_us":238180,"threads_started":2,"wal-append.queue_time_us":247299}
W20260709 13:09:49.798282 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.800843 31867 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.804052 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.809816 31911 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:49.810254 31911 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:49.811131 31911 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.812325 31911 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.733176 30478 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.786548 30480 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:49.822044 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.831171 30552 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:49.843366 31791 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:49.848842 31959 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 13:09:49.849292 31959 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:49.851675 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.865006 30553 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:09:49.867349 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.869764 31796 raft_consensus.cc:1064] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:49.872138 31796 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.831665 31867 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.875042 31867 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.854048 32002 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.862061 31965 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.866451 30478 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.895938 31934 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:49.896716 31934 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.898516 31555 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.899267 31555 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.899677 31934 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:49.886955 31985 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.011s
I20260709 13:09:49.886415 31596 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:49.919960 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 289779us
W20260709 13:09:49.921095 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 463139us
I20260709 13:09:49.930879 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1251) took 1854 ms. Trace:
I20260709 13:09:49.931309 30557 rpcz_store.cc:276] 0709 13:09:48.076447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.686501 (+610054us) service_pool.cc:224] Handling call
0709 13:09:48.770001 (+ 83500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.033698 (+263697us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:49.065179 (+ 31481us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.569636 (+504457us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b180043cfc0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a
0709 13:09:49.569895 (+   259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.569968 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:49.570027 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.930594 (+360567us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000712d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:49.930651 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.930809 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36748,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":3420,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":15137,"spinlock_wait_cycles":609260544,"thread_start_us":50583,"threads_started":1,"wal-append.queue_time_us":209333}
W20260709 13:09:49.937196 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.937904 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.924907 31596 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:49.925117 31959 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:49.927763 31808 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.907511 31985 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.888247 32002 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.956362 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.957180 31151 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:49.922483 31982 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:49.952353 31596 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.974804 31959 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:49.975456 31959 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:49.977802 31959 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.977461 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.974877 31800 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:49.979111 31150 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:49.979671 31150 pending_rounds.cc:85] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Aborting all ops after (but not including) 5
I20260709 13:09:49.980317 31150 pending_rounds.cc:107] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:49.978664 31867 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.980671 31150 raft_consensus.cc:2889] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.981498 31825 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.983745 31982 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.984546 30554 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:49.984333 31985 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.987396 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.992473 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.992868 30408 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:49.978302 31785 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:49.979740 31942 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:49.986074 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.978348 31959 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.987756 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.995162 31959 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:49.995674 30407 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:49.996152 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.996675 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.997205 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.991745 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:49.992223 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.994297 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.000715 30404 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:49.997414 30407 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:49.977566 32002 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:49.978681 31147 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:50.001714 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.010062 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:50.001858 31596 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.010887 31147 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:50.011384 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.012506 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.013087 31974 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.998662 31146 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:50.014859 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.015539 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:49.998034 30408 raft_consensus.cc:2410] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:50.022784 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:49.998487 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.023461 31151 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.026350 31942 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.027016 31942 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.995760 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:49.994117 31785 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:49.997560 31959 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.129701 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.013090 30404 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:50.132486 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.153379 30411 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:50.126127 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.144259 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.154340 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.154450 30486 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:50.155253 30403 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 1.
I20260709 13:09:50.157788 30411 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:50.167076 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.186604 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.142452 32002 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:50.190013 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:50.126231 32006 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:09:50.149883 31951 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.189699 30374 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:50.142652 31972 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.068131 31974 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.167457 30405 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:50.193050 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:50.198333 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.142975 31938 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:50.027522 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.199302 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:50.200378 32010 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:50.200814 31951 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:50.166988 32005 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:09:50.204185 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.030138 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.185992 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.207376 30408 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:50.184587 32011 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.006s
I20260709 13:09:50.206045 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.206552 30411 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:50.023665 30406 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:50.207608 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.167544 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.206775 31636 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:50.211859 31938 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.213146 31147 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:50.196738 32002 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.216118 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.224857 30411 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:50.217267 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:50.227424 30450 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.216216 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:50.216632 31145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.040s	sys 0.088s
I20260709 13:09:50.214936 30409 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:50.220949 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:50.218503 31900 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.229071 30406 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:50.214553 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:50.233822 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.206995 31867 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.222465 31951 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.241632 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:50.222081 31957 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:50.244119 30406 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:50.206879 31972 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.238474 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:50.231695 31145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.040s	sys 0.089s
I20260709 13:09:50.249578 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.252954 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.236138 31974 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.254935 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.237408 31900 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.241005 31636 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.244170 31808 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:50.262822 31965 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.240172 31867 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:50.254041 31962 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.381991 30478 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.403559 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:50.393231 31988 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.160s	user 0.000s	sys 0.009s
I20260709 13:09:50.387436 31865 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.250743 31959 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:50.378255 32002 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:50.406001 30481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1384) took 2307 ms (client timeout 2181 ms). Trace:
I20260709 13:09:50.255753 31974 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:50.320010 31942 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.401571 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 89) took 1092 ms. Trace:
I20260709 13:09:50.256207 31970 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:50.255205 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.382845 31933 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.255609 31957 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.347879 30408 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:50.527347 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.528088 30408 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 1.
W20260709 13:09:50.434662 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.398352 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 1.26071e+06us
I20260709 13:09:50.391551 31946 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:50.421960 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.390940 31983 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:50.385710 31886 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.404846 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.537668 30480 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:50.538925 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.540216 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.396806 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1047) took 1077 ms. Trace:
I20260709 13:09:50.540009 31960 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.541218 30552 rpcz_store.cc:276] 0709 13:09:49.319703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.319837 (+   134us) service_pool.cc:224] Handling call
0709 13:09:50.396559 (+1076722us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400186354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:50.396722 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058240384}
I20260709 13:09:50.541935 31960 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.445855 31144 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:50.543077 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 305) took 1760 ms. Trace:
I20260709 13:09:50.447722 30407 pending_rounds.cc:85] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 4
I20260709 13:09:50.448561 31555 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.255445 31825 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.255445 31559 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:50.323067 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.351962 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:50.321252 31911 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.006s
I20260709 13:09:50.265731 31900 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.320297 31938 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.332340 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.380599 31972 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.350574 31785 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.391310 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.265161 31987 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:50.392516 31783 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:50.270625 31636 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.596400 31636 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.367707 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.598869 31942 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:50.599081 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 231461us
I20260709 13:09:50.599506 31942 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:50.601274 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.601694 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.602167 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.477895 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 87) took 1437 ms. Trace:
I20260709 13:09:50.449846 31808 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.603078 31808 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.601711 31942 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.515813 30559 rpcz_store.cc:276] 0709 13:09:49.309378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.309567 (+   189us) service_pool.cc:224] Handling call
0709 13:09:49.317755 (+  8188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.736988 (+419233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.401203 (+664215us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54001d9cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:50.401491 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962175744}
I20260709 13:09:50.456621 31962 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.485872 31606 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:09:50.481594 31632 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.513749 31959 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:50.530637 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:50.486174 30481 rpcz_store.cc:269] 0709 13:09:48.098216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.748121 (+649905us) service_pool.cc:224] Handling call
0709 13:09:50.405742 (+1657621us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003444d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:50.405911 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381652736}
W20260709 13:09:50.536264 32015 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.269s	user 0.003s	sys 0.006s
I20260709 13:09:50.445317 31951 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:50.617460 31951 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.517889 31974 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.517303 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.620126 31951 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.530526 31946 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:50.608682 31962 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.629323 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:50.630455 30481 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:50.631183 31959 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.632488 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.633924 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.635385 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.636778 30481 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:50.567633 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:50.642549 31152 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:09:50.580323 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.543577 31144 rpcz_store.cc:276] 0709 13:09:48.782663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.802394 (+ 19731us) service_pool.cc:224] Handling call
0709 13:09:50.445310 (+1642916us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84eee 0000000000375939 00007fa049ff81e0 00007fa04a0c10c4 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:50.445504 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.542657 (+ 97153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.542990 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60827008}
I20260709 13:09:50.554991 31559 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.456429 31867 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.580094 31146 raft_consensus.cc:2410] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:50.454582 31965 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.602857 30555 rpcz_store.cc:276] 0709 13:09:49.040750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.041448 (+   698us) service_pool.cc:224] Handling call
0709 13:09:49.041727 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.445257 (+403530us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:49.455242 (+  9985us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.479300 (+ 24058us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18000410e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:09:49.884896 (+405596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.884971 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:49.885030 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.477626 (+592596us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003098d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:50.477683 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.477832 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3875,"prepare.queue_time_us":9839,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":4091,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12545,"spinlock_wait_cycles":930591488,"thread_start_us":425824,"threads_started":1,"wal-append.queue_time_us":472310}
W20260709 13:09:50.609535 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78982.2us
I20260709 13:09:50.658761 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:50.606134 31783 tablet_bootstrap.cc:492] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:09:50.606266 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:50.615314 31785 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:50.595227 31987 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:50.671728 31987 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:50.671801 31933 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:50.672329 31933 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.673460 31946 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.674450 31933 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.674856 31946 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.675827 31933 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:50.676656 32012 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.357s	user 0.004s	sys 0.009s
I20260709 13:09:50.625907 31147 raft_consensus.cc:2410] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:50.677542 30555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:50.623092 31944 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.646162 31892 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.658601 31151 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.000s
I20260709 13:09:50.736971 31151 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:50.669749 31152 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:50.665005 31785 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:50.671298 31983 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.739174 31785 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.739295 31983 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.739781 31892 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.741565 31983 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.676369 31933 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.743485 31933 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.665162 31938 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:50.623696 31632 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:50.655105 31559 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.744165 31938 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:50.744616 31938 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.746023 31632 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.620719 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:50.709604 31944 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.749395 31944 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.715390 31920 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.742481 31892 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.659229 31965 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.709935 31783 ts_tablet_manager.cc:1403] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 3.786s	user 0.040s	sys 0.049s
I20260709 13:09:50.736151 31957 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.712942 31970 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:50.656915 31636 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.749635 31150 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:50.734365 31808 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.762657 31783 raft_consensus.cc:359] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.794775 31783 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
W20260709 13:09:50.818035 32017 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.486s	user 0.006s	sys 0.008s
I20260709 13:09:50.821462 31942 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.767970 31938 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.768210 31970 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:50.770251 31636 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.801918 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.823498 31938 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:50.825013 31555 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.825598 31555 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.828153 31555 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:50.806833 32018 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.425s	user 0.007s	sys 0.007s
I20260709 13:09:50.814668 31755 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:50.814951 31808 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.805022 31965 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.834066 31965 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.790133 31559 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.837690 31559 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.838672 31867 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.841310 31867 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.765481 31944 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.845288 31944 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.847644 31970 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:50.820623 32019 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.440s	user 0.002s	sys 0.010s
I20260709 13:09:50.820999 31962 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:50.829485 32014 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.462s	user 0.004s	sys 0.008s
I20260709 13:09:50.830200 31900 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.842402 31987 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:50.856822 31962 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:50.860704 31987 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:50.482527 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.887843 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1053) took 1783 ms. Trace:
I20260709 13:09:50.888548 30402 rpcz_store.cc:276] 0709 13:09:49.103689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.105487 (+  1798us) service_pool.cc:224] Handling call
0709 13:09:50.885591 (+1780104us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:50.886202 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.886761 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.886838 (+    77us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.886943 (+   105us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:50.887017 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.887148 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.887499 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14563584}
I20260709 13:09:50.896042 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.897542 30403 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:50.899295 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.900306 30402 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:50.901515 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.902908 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:50.905468 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.906316 30402 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:50.907107 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.558023 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1041) took 2525 ms. Trace:
I20260709 13:09:50.551512 30407 pending_rounds.cc:107] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:51.055200 30407 raft_consensus.cc:2889] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.055088 30405 rpcz_store.cc:276] 0709 13:09:48.032846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.033038 (+   192us) service_pool.cc:224] Handling call
0709 13:09:48.052110 (+ 19072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.206383 (+2154273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.557767 (+351384us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400287dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:50.557964 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4864204160}
I20260709 13:09:51.056599 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:50.908874 30406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.008s	sys 0.023s
I20260709 13:09:51.057360 30405 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
W20260709 13:09:51.057652 30406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.009s	sys 0.024s
I20260709 13:09:50.909842 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.910233 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.912289 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.916941 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.924157 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:50.927263 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1393) took 1559 ms. Trace:
I20260709 13:09:50.518117 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1394) took 1136 ms. Trace:
I20260709 13:09:50.645447 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.068565 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.070122 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:50.928429 30485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.019s	sys 0.024s
W20260709 13:09:51.070978 30485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.020s	sys 0.025s
I20260709 13:09:51.072208 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 68) took 2031 ms. Trace:
I20260709 13:09:50.928800 30479 raft_consensus.cc:2368] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.075210 30411 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:51.075477 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 72) took 1635 ms. Trace:
I20260709 13:09:51.076400 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.076913 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.077205 31959 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.077328 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.077899 31959 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.078708 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.078991 31596 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:51.079603 30405 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:51.080137 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 163572us
I20260709 13:09:51.079839 31596 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.080489 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:51.081657 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.082228 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.929581 30480 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:51.077214 30411 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.083104 31987 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:51.083302 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.083598 31987 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.932534 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1069) took 1568 ms (client timeout 1902 ms). Trace:
I20260709 13:09:51.084009 31987 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:51.084100 30554 rpcz_store.cc:269] 0709 13:09:49.363593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.598964 (+235371us) service_pool.cc:224] Handling call
0709 13:09:50.931944 (+1332980us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002468d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:50.932236 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845779328}
I20260709 13:09:51.085615 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.086323 30554 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:50.660190 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1252) took 2583 ms. Trace:
W20260709 13:09:50.933876 30484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1392) took 1566 ms (client timeout 2067 ms). Trace:
W20260709 13:09:51.087779 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 163999us
W20260709 13:09:51.087845 30484 rpcz_store.cc:269] 0709 13:09:49.367739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.368761 (+  1022us) service_pool.cc:224] Handling call
0709 13:09:50.933352 (+1564591us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001bf3d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:50.933610 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496187136}
I20260709 13:09:51.087550 31962 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.088840 31962 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:51.089215 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.940061 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.089581 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:50.930184 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.090437 30558 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:51.081682 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:50.939838 30555 raft_consensus.cc:606] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:50.943063 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:50.929595 30486 raft_consensus.cc:2368] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:50.944141 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.091684 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.092588 30553 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.092839 30558 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.093622 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.093806 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:50.944198 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.095329 30557 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.096477 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.096544 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.097470 30557 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.097783 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:50.945940 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:50.947625 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:50.976997 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.951249 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:50.954908 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:50.980326 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.984102 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:50.818415 31783 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:51.104547 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 153650us
I20260709 13:09:51.104755 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:50.817083 31785 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.076692 31800 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:50.990643 31900 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.107959 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.108371 30551 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:50.985546 31867 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:50.991971 31886 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:50.999733 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.001297 31970 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:51.002015 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.006088 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:51.020830 31972 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.098881 30411 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.043219 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:51.043829 31145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.096s	sys 0.148s
W20260709 13:09:51.045092 32007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.010s	sys 0.014s
W20260709 13:09:51.120429 32007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.010s	sys 0.014s
I20260709 13:09:51.120863 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.122109 30481 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:09:51.119159 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.058975 30408 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:51.124148 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.045454 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.124881 30408 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:51.125340 30402 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.059860 30477 rpcz_store.cc:276] 0709 13:09:49.368015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.552189 (+184174us) service_pool.cc:224] Handling call
0709 13:09:49.552479 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.641369 (+ 88890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.926568 (+1285199us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b5400360954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:50.927040 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193580800}
I20260709 13:09:51.125569 31972 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.082149 31974 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:51.091140 30483 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.126511 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.127102 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1301) took 1017 ms. Trace:
I20260709 13:09:51.127358 30402 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:51.095217 32025 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:51.127857 31972 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.089339 31962 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.128182 32025 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.128423 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.129345 30402 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:51.129504 32025 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:50.981762 31636 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:50.975697 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 383129us
I20260709 13:09:50.978987 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:51.135167 31144 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:51.091778 30405 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:51.136482 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 130744us
I20260709 13:09:51.094602 30553 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.137699 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.139125 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.101364 30559 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.103732 31965 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.103976 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.005066 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.064190 30478 rpcz_store.cc:276] 0709 13:09:49.368248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.592991 (+224743us) service_pool.cc:224] Handling call
0709 13:09:49.625352 (+ 32361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.475086 (+849734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.504607 (+ 29521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.144181 31632 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:51.144973 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.145169 31148 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:51.145838 31596 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.098460 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.106566 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.144392 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.087100 30556 rpcz_store.cc:276] 0709 13:09:48.076739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.777333 (+700594us) service_pool.cc:224] Handling call
0709 13:09:48.827109 (+ 49776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.866383 (+ 39274us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:48.928939 (+ 62556us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.399203 (+1470264us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b18003f9940. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:09:50.624891 (+225688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.626233 (+  1342us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:50.628562 (+  2329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.646091 (+ 17529us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.658747 (+ 12656us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42888,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1820,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":1359,"spinlock_wait_cycles":39699712,"thread_start_us":207753,"threads_started":1,"wal-append.queue_time_us":1698021}
I20260709 13:09:51.147156 30560 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:51.147343 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.147621 30553 raft_consensus.cc:2368] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.148073 30557 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.148216 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.148561 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.148775 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1296) took 1040 ms. Trace:
I20260709 13:09:51.149109 30556 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.149297 30553 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:51.142551 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.151160 30551 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:51.110805 31785 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.148085 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.111091 31951 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.112053 31808 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.078465 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.031424 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.091684 30555 raft_consensus.cc:614] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:51.119160 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.119526 30403 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:09:51.119151 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.119982 31145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.096s	sys 0.148s
W20260709 13:09:51.122609 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.125962 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:51.040648 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.983227 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.165207 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.166103 31911 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.166543 30479 raft_consensus.cc:2376] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4. Re-sending same reply.
I20260709 13:09:51.167106 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:51.167625 30408 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.167941 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.133350 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.072597 30485 rpcz_store.cc:276] 0709 13:09:49.040557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.040653 (+    96us) service_pool.cc:224] Handling call
0709 13:09:49.065984 (+ 25331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.066181 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:49.210995 (+144814us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.805607 (+594612us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b18003620e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:09:50.346322 (+540715us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b18003620e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a
0709 13:09:51.071596 (+725274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.071732 (+   136us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.071862 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.071959 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.072149 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166230,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":63039,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":64097536,"thread_start_us":877161,"threads_started":3,"wal-append.queue_time_us":63193,"wal-append.run_cpu_time_us":1143,"wal-append.run_wall_time_us":1003499}
I20260709 13:09:51.131105 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.141497 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.141559 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.166395 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:51.142820 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 45151.7us
I20260709 13:09:51.174080 31636 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.176750 30405 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:51.179632 30481 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.180433 30410 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 1.
I20260709 13:09:51.142722 30554 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.178731 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:51.143807 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.146306 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.150424 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.149178 30486 rpcz_store.cc:276] 0709 13:09:50.108323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.155204 (+ 46881us) service_pool.cc:224] Handling call
0709 13:09:50.403288 (+248084us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:09:51.148593 (+745305us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540017b6d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:51.148726 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091333760}
I20260709 13:09:51.177253 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.150408 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.128445 31974 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.159687 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.154098 31951 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.155203 31153 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:51.162072 31555 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.154488 31632 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:51.166851 31911 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.127467 30483 rpcz_store.cc:276] 0709 13:09:50.109844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.929391 (+819547us) service_pool.cc:224] Handling call
0709 13:09:51.127030 (+197639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.193264 31632 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.182384 31867 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.195055 31867 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.195920 31959 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.170341 31789 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:51.197546 31867 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.171028 31744 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.131558 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.198486 31744 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.199134 30558 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.200250 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:51.200695 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 57004.8us
I20260709 13:09:51.200883 31744 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.200922 30558 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.201841 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.202066 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.202621 30554 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:51.203666 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.204350 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.204576 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.205060 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.205610 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.205737 30556 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.172518 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.207077 31994 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.173310 31946 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.171159 30484 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.172374 32029 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.208149 30404 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:51.207990 31946 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.208479 32029 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.208573 31994 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.177753 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.209064 31994 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.209017 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.209808 30404 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.210635 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:51.159080 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 154518us
I20260709 13:09:51.211966 30558 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.212294 31911 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.212416 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.212834 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:51.213337 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.213953 31796 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:51.214087 30552 raft_consensus.cc:2376] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2. Re-sending same reply.
I20260709 13:09:51.213500 31744 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:51.179980 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.173621 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.215152 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.215631 30405 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:51.215781 30552 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.216260 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.216555 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.217036 30555 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.217294 30405 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.217841 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.218529 30555 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.225050 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.156652 31965 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.246616 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.248128 30555 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:51.174398 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 126) took 2444 ms. Trace:
I20260709 13:09:51.249336 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:51.189615 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.189610 31555 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.191963 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.197239 31789 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.171794 31785 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.206249 30411 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.214630 30558 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.176994 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1313) took 1040 ms. Trace:
I20260709 13:09:51.179986 31636 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.225574 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.188141 31951 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.218874 31783 ts_tablet_manager.cc:1434] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.401s	user 0.011s	sys 0.000s
I20260709 13:09:51.207100 30551 raft_consensus.cc:2410] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:51.185544 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.210490 31946 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.222900 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.274340 30408 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.274735 30559 raft_consensus.cc:2368] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4.
W20260709 13:09:51.274897 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85449.3us
W20260709 13:09:51.224282 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 45686us
I20260709 13:09:51.273411 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.228205 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.225557 31596 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:51.224004 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.149027 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.226619 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.208909 32029 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.227949 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.264102 31941 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:51.291136 31941 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.291397 30479 raft_consensus.cc:2368] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.291694 31941 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:51.075824 30482 rpcz_store.cc:276] 0709 13:09:49.440303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.774755 (+334452us) service_pool.cc:224] Handling call
0709 13:09:50.212816 (+438061us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:50.212995 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.213169 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:50.545647 (+332478us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.074858 (+529211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.074954 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.075101 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.075202 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.075330 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15391,"prepare.queue_time_us":634963,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":21382,"spinlock_wait_cycles":4048768,"thread_start_us":830590,"threads_started":2,"wal-append.queue_time_us":496475}
I20260709 13:09:51.294423 30557 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:51.233119 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.295351 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1304) took 1184 ms. Trace:
I20260709 13:09:51.295475 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.295678 30477 rpcz_store.cc:276] 0709 13:09:50.118773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.232729 (+1113956us) service_pool.cc:224] Handling call
0709 13:09:51.295289 (+ 62560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.205693 30554 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.296164 30557 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.297114 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.239542 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.246214 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1083) took 1058 ms. Trace:
I20260709 13:09:51.253947 31555 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.246666 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.176188 30403 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:51.259809 30405 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:51.259596 30480 rpcz_store.cc:276] 0709 13:09:50.136470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.539949 (+403479us) service_pool.cc:224] Handling call
0709 13:09:51.176809 (+636860us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540035ff54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:51.176942 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892982656}
I20260709 13:09:51.248064 31965 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.261236 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:51.302363 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63006.6us
I20260709 13:09:51.302825 30555 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.303172 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.304255 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.306002 31796 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.306402 31796 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:51.274453 31783 ts_tablet_manager.cc:1467] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Tablet startup took 511ms
I20260709 13:09:51.306811 31796 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.307173 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.307857 30551 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:51.306990 31783 ts_tablet_manager.cc:1469] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Trace:
0709 13:09:43.232336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.232751 (+   415us) service_pool.cc:224] Handling call
0709 13:09:43.555843 (+323092us) ts_tablet_manager.cc:934] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:09:45.330381 (+1774538us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:45.664994 (+334613us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:45.665118 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:45.805772 (+140654us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:45.842383 (+ 36611us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:45.859789 (+ 17406us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:45.863015 (+  3226us) inbound_call.cc:177] Queueing success response
0709 13:09:46.923767 (+1060752us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:50.754960 (+3831193us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:50.759690 (+  4730us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:50.760502 (+   812us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":36144,"mutex_wait_us":6726,"raft.queue_time_us":4269,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"tablet-copy.queue_time_us":191999,"tablet-download-pool.queue_time_us":164,"tablet-download-pool.run_cpu_time_us":1179,"tablet-download-pool.run_wall_time_us":237020,"thread_start_us":100384,"threads_started":2}
I20260709 13:09:51.312556 30555 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.312826 31938 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.313612 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.314283 30555 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.313685 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.315233 30403 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.235342 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 94) took 1209 ms. Trace:
I20260709 13:09:51.263933 30485 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:51.222322 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.333613 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.334192 30556 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.334790 31744 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.335191 31744 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.335258 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.335666 31744 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.336005 30482 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.336138 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.336902 30485 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:51.337808 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.338348 30485 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.334501 30477 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.340101 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.340405 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.341125 30484 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.341387 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.341590 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.341908 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.283421 30410 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.342873 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.336189 30555 raft_consensus.cc:2410] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:09:51.343616 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67990.4us
I20260709 13:09:51.344379 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.347618 31987 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.321844 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.299510 30406 rpcz_store.cc:276] 0709 13:09:50.188245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.247835 (+ 59590us) service_pool.cc:224] Handling call
0709 13:09:50.248202 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.248443 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:51.058054 (+809611us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.182382 (+124328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.241732 (+ 59350us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:51.245920 (+  4188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.246013 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.246168 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10232,"prepare.queue_time_us":386958,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":27700,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6765,"thread_start_us":884084,"threads_started":2,"wal-append.queue_time_us":167755}
I20260709 13:09:51.329273 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.388736 30552 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.339740 31559 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.319330 30478 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:51.284332 31785 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.344663 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.287001 31789 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.249907 31145 rpcz_store.cc:276] 0709 13:09:48.719324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.748663 (+ 29339us) service_pool.cc:224] Handling call
0709 13:09:48.821706 (+ 73043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.864564 (+ 42858us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:49.830590 (+966026us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa041f9f0ac 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa048aa13c7
0709 13:09:50.266986 (+436396us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.163533 (+896547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.163634 (+   101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.163730 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.163852 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.164055 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104771,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":3444,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":21403008,"thread_start_us":1954811,"threads_started":2,"wal-append.queue_time_us":736783}
I20260709 13:09:51.282469 30553 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.343101 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.313294 31938 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.348591 30555 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.349089 31744 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.344664 31796 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.334384 30554 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.342516 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.350850 30556 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.361513 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-ba4c05796efa42489d11c8a49ba476ad received from {username='slave'} at 127.0.0.1:53492
I20260709 13:09:51.363144 30557 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.364600 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:51.365813 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 60144.1us
I20260709 13:09:51.366036 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.367048 31962 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.405850 31789 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.368733 30551 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:51.402846 31800 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.403896 31559 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.404639 31938 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.370944 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:51.373108 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1297) took 1264 ms. Trace:
I20260709 13:09:51.374764 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.375362 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.320046 30560 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:51.386883 30485 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
W20260709 13:09:51.389933 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 282154us
I20260709 13:09:51.394444 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:51.395862 30410 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.397859 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.414966 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.415084 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.428577 30482 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:51.429461 30405 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:51.398978 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 286075us
I20260709 13:09:51.401115 30411 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.404680 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1310) took 1284 ms. Trace:
W20260709 13:09:51.408193 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63638.9us
I20260709 13:09:51.410315 30484 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.430909 30477 rpcz_store.cc:276] 0709 13:09:50.120628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.342252 (+1221624us) service_pool.cc:224] Handling call
0709 13:09:51.404624 (+ 62372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.422977 30479 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.423307 30480 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:51.431624 30552 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:51.423434 30486 rpcz_store.cc:276] 0709 13:09:50.108608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.372122 (+1263514us) service_pool.cc:224] Handling call
0709 13:09:51.372526 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.372772 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.372812 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.372856 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:51.372885 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.372939 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.373038 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.431062 30410 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:51.422896 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.424487 30559 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:51.435117 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1311) took 1300 ms. Trace:
I20260709 13:09:51.435211 30411 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.413645 30406 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.418871 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-ba4c05796efa42489d11c8a49ba476ad on tablet ba4c05796efa42489d11c8a49ba476ad with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:51.399075 31951 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.398094 31994 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.510249 30404 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
W20260709 13:09:51.511080 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 77355us
I20260709 13:09:51.512048 30484 rpcz_store.cc:276] 0709 13:09:50.134453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.342816 (+1208363us) service_pool.cc:224] Handling call
0709 13:09:51.435063 (+ 92247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:51.513257 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 266747us
I20260709 13:09:51.414518 31785 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.517375 30482 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:51.517930 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 76) took 1295 ms. Trace:
I20260709 13:09:51.518217 30482 rpcz_store.cc:276] 0709 13:09:50.222253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.435160 (+1212907us) service_pool.cc:224] Handling call
0709 13:09:51.517212 (+ 82052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.517765 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.517891 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.520032 30483 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:51.412668 32025 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:51.521822 30477 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:51.420311 31796 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.413105 31789 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:51.522801 32043 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.523764 31145 pending_rounds.cc:85] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Aborting all ops after (but not including) 4
I20260709 13:09:51.415683 30551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38014
W20260709 13:09:51.528276 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97057.5us
I20260709 13:09:51.421948 30557 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:51.525439 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1315) took 1277 ms. Trace:
I20260709 13:09:51.420485 31744 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.420993 30478 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:51.414440 31962 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.422538 31941 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.422183 31559 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.516716 31596 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.601681 30552 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:51.530406 30480 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:51.529470 30477 rpcz_store.cc:276] 0709 13:09:50.248176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.431719 (+1183543us) service_pool.cc:224] Handling call
0709 13:09:51.515502 (+ 83783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.525187 (+  9685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.525384 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.600076 30402 raft_consensus.cc:2368] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:09:51.607321 30553 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.578094 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.568850 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:51.608462 30555 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:51.531059 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 108266us
I20260709 13:09:51.527273 31789 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.606210 30480 pending_rounds.cc:85] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 1
I20260709 13:09:51.615123 31596 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.615538 30552 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.569727 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:51.530035 31785 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:51.569252 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1299) took 1460 ms. Trace:
I20260709 13:09:51.577273 32025 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.533751 31145 pending_rounds.cc:107] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:51.613193 30480 pending_rounds.cc:107] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:51.617149 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:51.617442 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.625278 31148 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.649978 32029 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.625458 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.604033 31951 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.627985 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.644073 31941 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.644754 31987 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.646871 30480 raft_consensus.cc:2889] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.325230 30407 rpcz_store.cc:276] 0709 13:09:50.026043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.248140 (+222097us) service_pool.cc:224] Handling call
0709 13:09:50.329053 (+ 80913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.056443 (+727390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.056492 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.056991 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.139587 (+ 82596us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.187532 (+ 47945us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.223482 (+ 35950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.223615 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.223722 (+   107us) raft_consensus.cc:1685] finished
0709 13:09:51.223741 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.235212 (+ 11471us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29533,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":681,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":57490,"threads_started":1,"wal-append.queue_time_us":92306}
I20260709 13:09:51.654105 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.655247 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.532768 31994 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:51.658833 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44782.4us
I20260709 13:09:51.623111 31808 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:51.661273 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131592us
I20260709 13:09:51.662012 30408 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:51.662786 30411 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.663034 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.626982 31785 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:51.670569 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.656615 31145 raft_consensus.cc:2889] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:51.671399 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.671711 31744 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.673986 32024 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:51.674052 31744 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.663314 30409 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:51.674206 30410 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:51.675912 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58096.4us
I20260709 13:09:51.530992 32043 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:51.677629 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 146874us
W20260709 13:09:51.684809 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71779.9us
I20260709 13:09:51.672230 31785 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.674602 31744 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.686721 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:51.626823 30478 rpcz_store.cc:276] 0709 13:09:50.109254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.420416 (+1311162us) service_pool.cc:224] Handling call
0709 13:09:51.420803 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.568950 (+148147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.569171 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.687240 30558 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:51.674633 32024 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:09:51.695019 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.691733 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 86429us
I20260709 13:09:51.688055 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.692361 30408 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:51.695586 31796 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.684772 31808 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.699180 31796 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.700924 30403 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.707171 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.701742 31867 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.704969 31796 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.717788 32047 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.718253 32047 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.718461 30374 leader_election.cc:400] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.718654 32047 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.718866 30374 leader_election.cc:403] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:51.726512 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.727303 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:51.735075 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.736469 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.722896 31867 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.734223 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.695693 32024 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.755771 30411 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:51.758827 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:51.777101 31867 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:51.777770 31867 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:51.779001 32055 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.778836 31867 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.779500 32055 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:51.779973 32055 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.781701 30374 leader_election.cc:400] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.782120 30374 leader_election.cc:403] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:51.782970 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.783941 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:51.785076 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.786214 31636 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.786980 31632 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.761065 31555 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.787444 31632 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.787859 31632 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.788204 32055 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.789094 31555 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.789721 31555 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:51.790385 32055 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.792407 32043 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.793689 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:51.794384 30558 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:51.739753 31994 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:51.795396 31808 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.796722 31938 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:51.797894 32047 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.798350 30559 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:51.798924 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:51.800235 32047 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.795773 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:51.803193 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.790359 31555 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.792426 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:51.807888 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.722867 32025 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.765774 32029 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.781608 31789 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.805248 31636 raft_consensus.cc:2764] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:09:51.832837 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74127.7us
I20260709 13:09:51.775341 31596 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.838479 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:51.839270 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 115299us
I20260709 13:09:51.809636 31994 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:51.806669 31555 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.848738 30554 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:51.830536 32043 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:51.828927 32055 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.849512 30551 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.834921 31951 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.829665 31962 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.835363 31965 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:51.855145 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59465.5us
W20260709 13:09:51.846457 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45513.8us
I20260709 13:09:51.856360 30551 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:51.865306 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73067.2us
I20260709 13:09:51.866606 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.853668 31555 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.844959 31994 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:51.854656 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.857923 31596 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.871275 30374 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:51.877796 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 151378us
I20260709 13:09:51.856353 32043 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.892554 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.863951 31965 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:09:51.893419 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85634.7us
I20260709 13:09:51.897426 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:51.897799 30374 leader_election.cc:400] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:51.899255 30374 leader_election.cc:403] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:51.877352 31636 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:51.902227 30403 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:51.903327 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:51.876475 31962 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.897172 32043 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.899976 31942 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.900239 31965 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.901899 32029 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:51.913616 30551 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.884725 31951 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.898765 30409 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:51.923159 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.905496 31636 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.903597 31596 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:51.934811 31559 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.935864 31596 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.934072 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:51.917914 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:51.918457 32055 raft_consensus.cc:697] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:51.924613 32029 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.944818 31957 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.945783 32063 raft_consensus.cc:2764] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:51.945667 31994 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:51.946837 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49178.1us
I20260709 13:09:51.947170 31994 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.950768 31938 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:51.951591 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.951895 31785 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.954130 31785 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:51.937124 31636 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.937029 31808 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:51.964403 31951 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:51.943723 32029 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:51.965041 32064 consensus_queue.cc:1175] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce312b0d7a1747c8898a748f8d76df81" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:09:51.943661 31962 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.959348 31789 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:51.972883 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 87842us
I20260709 13:09:51.943853 30407 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.941928 31148 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:09:51.980595 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 117791us
I20260709 13:09:51.965107 31951 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:51.986716 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.990784 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:51.990796 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:51.982962 31941 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:51.994758 32058 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:09:51.977315 31632 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:51.988320 31938 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:52.005048 31789 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:52.005559 31789 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:52.005769 31145 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:52.006000 31789 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.006856 30523 leader_election.cc:400] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5.
I20260709 13:09:52.007174 30523 leader_election.cc:403] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.014314 31150 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:52.015152 32070 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.024075 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.024109 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:52.026640 30525 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:51.990263 31744 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.001652 31785 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.034128 31800 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.011919 32063 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5.
I20260709 13:09:52.034646 31800 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.011905 31144 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:52.036684 32029 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.032024 32062 raft_consensus.cc:2764] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:52.039196 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:51.995442 31951 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.041692 31951 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.042562 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1266) took 1086 ms. Trace:
W20260709 13:09:52.043048 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60169.7us
I20260709 13:09:52.042999 30554 rpcz_store.cc:276] 0709 13:09:50.956581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.408557 (+451976us) service_pool.cc:224] Handling call
0709 13:09:51.408777 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.849359 (+440582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.042284 (+192925us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001e50d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:52.042462 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011251072}
I20260709 13:09:51.994771 32055 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.046141 31636 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.002195 31938 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:52.031718 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:52.032392 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1314) took 1810 ms. Trace:
I20260709 13:09:52.051702 30485 rpcz_store.cc:276] 0709 13:09:50.222027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.428795 (+1206768us) service_pool.cc:224] Handling call
0709 13:09:51.521058 (+ 92263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.623694 (+102636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.623721 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.659439 (+ 35718us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.715143 (+ 55704us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:51.715181 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.715260 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.032163 (+316903us) raft_consensus.cc:1685] finished
0709 13:09:52.032182 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.032314 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969,"raft.queue_time_us":11174,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":30562,"thread_start_us":25125,"threads_started":1,"wal-append.queue_time_us":123893}
I20260709 13:09:52.054436 32047 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.002589 32073 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.059535 30407 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:52.057034 31938 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:52.059239 30376 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.550s (SENT)
I20260709 13:09:52.079106 32071 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:09:52.080348 32071 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.080752 32071 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:52.081671 32071 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.084048 32078 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:52.085356 32078 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:52.085776 32078 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.086299 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:52.086648 32066 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.152s	user 0.004s	sys 0.000s
I20260709 13:09:52.074460 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.059916 32029 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.067469 32062 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:52.066171 31785 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.101984 32080 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.111224 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:52.089322 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.117564 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:52.099090 32062 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:52.123950 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 68999.1us
W20260709 13:09:52.124248 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50790.8us
W20260709 13:09:52.137223 30376 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.802s (SENT)
I20260709 13:09:52.137750 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.134220 32062 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.109863 32078 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.105993 32043 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.140434 32078 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.141453 31800 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.141862 32043 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.107636 31951 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:52.143030 31149 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:52.143733 31800 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.099732 31796 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.145048 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:52.145539 31796 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.145742 31789 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.147296 31147 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:52.146379 31796 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:52.148170 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.148743 30407 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.148960 31796 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.149425 31965 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.151546 31965 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.152746 31555 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.155027 32062 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.159403 31744 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.160604 32062 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.163719 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:52.164222 30407 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:52.164448 31789 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.120719 32029 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:09:52.164595 31150 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:52.149452 31796 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.165860 31144 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:09:52.166330 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.167084 32067 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.166815 31796 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:52.167603 32067 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.169894 32067 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.139561 30307 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 198) took 7252 ms. Trace:
I20260709 13:09:52.156991 31636 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.110345 31632 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:52.173506 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 48094.9us
W20260709 13:09:52.175506 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 130416us
I20260709 13:09:52.176276 30523 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.135160 32071 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:52.180122 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 104002us
I20260709 13:09:52.186340 31938 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.189531 31938 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.181734 32063 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.192184 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.193064 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:52.193449 32063 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.194185 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.177760 31951 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:52.199347 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68114us
W20260709 13:09:52.199150 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 142677us
I20260709 13:09:52.180861 31555 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.203213 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.175760 31789 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:09:52.198639 32072 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.203703 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:52.170470 30307 rpcz_store.cc:276] 0709 13:09:44.811904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.817766 (+  5862us) service_pool.cc:224] Handling call
0709 13:09:45.510381 (+692615us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:09:52.058791 (+6548410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.939169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:50.126987 (+187818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:50.130234 (+  3247us) write_op.cc:435] Acquired schema lock
0709 13:09:50.132092 (+  1858us) tablet.cc:662] Decoding operations
0709 13:09:50.202766 (+ 70674us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:50.202853 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:50.202889 (+    36us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:50.244553 (+ 41664us) tablet.cc:701] Row locks acquired
0709 13:09:50.248281 (+  3728us) write_op.cc:260] PREPARE: finished
0709 13:09:50.263396 (+ 15115us) write_op.cc:270] Start()
0709 13:09:50.267712 (+  4316us) write_op.cc:276] Timestamp: P: 1783602590263327 usec, L: 0
0709 13:09:50.268434 (+   722us) op_driver.cc:348] REPLICATION: starting
0709 13:09:50.367830 (+ 99396us) log.cc:844] Serialized 922 byte log entry
0709 13:09:50.816656 (+448826us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa041f9f0ac 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b
0709 13:09:51.262746 (+446090us) op_driver.cc:464] REPLICATION: finished
0709 13:09:51.676997 (+414251us) write_op.cc:301] APPLY: starting
0709 13:09:51.689405 (+ 12408us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:51.708926 (+ 19521us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:51.708996 (+    70us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:51.709644 (+   648us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:51.709971 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:51.710018 (+    47us) write_op.cc:312] APPLY: finished
0709 13:09:51.710406 (+   388us) log.cc:844] Serialized 28 byte log entry
0709 13:09:51.710607 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.710787 (+   180us) write_op.cc:454] Released schema lock
0709 13:09:51.710866 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:51.711346 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:51.711382 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":756899072,"child_traces":[["op",{"apply.queue_time_us":306925,"apply.run_cpu_time_us":3053,"apply.run_wall_time_us":50941,"num_ops":2,"prepare.queue_time_us":483446,"prepare.run_cpu_time_us":30037,"prepare.run_wall_time_us":1192612,"raft.queue_time_us":200890,"raft.run_cpu_time_us":16224,"raft.run_wall_time_us":263905,"replication_time_us":981632,"spinlock_wait_cycles":39591680,"thread_start_us":1335133,"threads_started":4,"wal-append.queue_time_us":673722}]]}
I20260709 13:09:52.209105 30407 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:52.211419 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.212985 32070 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:52.201746 31785 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.213361 32070 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.213783 32070 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.214300 30551 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.214728 32091 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.214864 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38014 (request call id 1274) took 1255 ms. Trace:
I20260709 13:09:52.215554 32087 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.210589 32072 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:52.217175 32072 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.206606 32086 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:09:52.215299 30551 rpcz_store.cc:276] 0709 13:09:50.959326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.415564 (+456238us) service_pool.cc:224] Handling call
0709 13:09:52.213099 (+797535us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54001e50d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a0a3d 00007fa04a070cd0 00007fa0435f5254 00007fa0435f51e2 00007fa0435f5111 00007fa0435f508c 00007fa0435f4342 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:52.214765 (+  1666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737747840}
I20260709 13:09:52.229712 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:52.230675 31941 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:52.231114 31941 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.231451 31941 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.231714 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.233031 31789 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:52.237528 30524 leader_election.cc:400] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:09:52.237880 30524 leader_election.cc:403] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:52.226568 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.206104 32063 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:52.239141 31796 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.244635 31789 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:52.245034 31789 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.245857 31789 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:52.248217 30376 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.952s (SENT)
I20260709 13:09:52.248648 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.247131 31789 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:52.251353 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.251784 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.255316 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.256283 30554 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:52.262650 32087 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.263165 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.263886 30559 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.266757 31796 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:52.267205 31796 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:52.267568 31796 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.269423 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.269706 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.270879 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.272302 31146 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:52.272665 30411 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:52.273818 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:52.275166 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:52.275952 30409 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:52.276796 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.277381 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.278303 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.280109 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.280956 32043 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.281399 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.281682 32043 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.282290 32024 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.281778 32070 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.288951 31994 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.291181 32070 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.296036 31636 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.296490 31636 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.297448 31636 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:52.299109 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 66709.7us
I20260709 13:09:52.299785 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:52.300654 31153 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.300805 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.304065 30559 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:52.304970 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.305923 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.305179 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.307080 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.306684 30405 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:52.309952 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.310551 30411 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.311782 30406 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:52.290529 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:52.313201 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.320533 32083 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:52.321437 32083 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.324366 32083 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:52.326189 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49967us
I20260709 13:09:52.326359 31951 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:52.328493 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 88494.7us
I20260709 13:09:52.330092 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.343247 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.345052 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.346136 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.346473 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.346942 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.347239 30555 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.343348 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.351073 30408 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.357136 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.357918 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.358186 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.358065 30559 raft_consensus.cc:2368] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.358539 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.359159 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.359258 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.361145 30402 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.360209 30552 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:52.362816 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.363391 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.363737 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.364144 30555 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.366149 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.366961 30559 raft_consensus.cc:2368] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.367803 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.368242 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.368561 30559 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.368870 30483 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:52.369374 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.369522 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.369886 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.370257 30559 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.370357 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.370733 30483 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.372491 31636 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.373342 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.374097 30559 raft_consensus.cc:2368] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.373823 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.373291 30483 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:52.374778 30560 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.374996 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.375496 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.374985 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.376112 30560 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:52.376426 30483 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:52.376921 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.377072 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.377839 30557 raft_consensus.cc:2368] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.378399 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.378953 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.379683 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.379779 30557 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:52.380194 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.380362 30559 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.380867 30482 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:52.381192 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.331288 32091 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.387009 30411 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:52.369772 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.382921 30558 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:52.383324 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.387593 30404 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:52.405251 30404 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.405191 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.387996 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.407296 30552 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.369396 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.408999 30477 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.395282 31555 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.385530 32029 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:52.396046 31867 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:52.379812 30308 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 2, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.386292 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.336545 32043 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.385298 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.419588 30308 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.385980 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.423390 30484 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.341652 31987 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:52.411293 30559 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:09:52.386175 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.433427 30551 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:52.433683 30402 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:52.343992 31946 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:52.394192 30482 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:52.386345 32046 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:52.414849 30485 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:52.386683 32078 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.456523 30482 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:52.386636 32083 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.388779 31785 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:52.425081 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.351490 32024 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:52.412477 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.459107 30558 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.422421 30308 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.424453 30404 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.455996 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.464006 30559 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:52.387336 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.405819 32087 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
W20260709 13:09:52.468148 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 82044.8us
I20260709 13:09:52.382675 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.471544 30404 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.419672 32029 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:52.393179 32089 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.480502 30484 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.479637 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.423995 30552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:52.482873 30552 raft_consensus.cc:606] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.436151 31789 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.483291 30552 raft_consensus.cc:614] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:52.393344 32062 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:09:52.488737 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.493129 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.494771 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.472148 31744 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.495538 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.494259 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:52.496479 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.480244 31957 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.502182 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.502466 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.505632 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.506258 30559 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.506193 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.482653 32029 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.502734 30551 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:52.478041 32078 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.433068 31796 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.508803 30404 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:09:52.509259 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.510115 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.503396 30308 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 2, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.508524 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.512718 30551 raft_consensus.cc:2376] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3. Re-sending same reply.
I20260709 13:09:52.513895 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.514798 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.515671 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.458065 31946 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:52.517844 30376 leader_election.cc:336] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.997s (SENT)
I20260709 13:09:52.512707 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.525223 30482 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.525858 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.526311 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.520430 30558 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:52.527486 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.527504 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.520891 30551 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:52.479596 31951 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:52.477205 31987 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.523660 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.519335 30308 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.521092 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.520025 30557 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:52.532248 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.501369 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.538959 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.539830 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.540727 30553 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:52.541113 30559 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.531031 32087 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.541796 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:52.542553 30560 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:52.544548 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.520830 31789 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.545660 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.548295 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.548677 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:52.543603 30551 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:52.549898 30558 raft_consensus.cc:606] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.549988 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.550371 30558 raft_consensus.cc:614] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:52.549774 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.512056 31632 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:52.551529 31957 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:52.552065 31957 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.552026 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.551818 32024 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.552632 31957 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.541949 32089 consensus_queue.cc:1059] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:09:52.493747 32073 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:52.551623 31632 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:52.559759 30482 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:09:52.561789 30477 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:52.553647 30556 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:52.541354 32083 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.564230 30552 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:52.574790 30552 pending_rounds.cc:85] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:09:52.575129 30552 pending_rounds.cc:107] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:52.575512 30552 raft_consensus.cc:2889] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:52.525321 31744 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.565274 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.558269 32080 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.583073 30559 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:52.584528 31555 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.557778 31632 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.588310 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.563839 32087 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.590391 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.591404 30559 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:52.608464 30554 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.592463 31744 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:52.594905 32083 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.595006 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.608474 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:52.620620 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 94837.4us
I20260709 13:09:52.622606 30479 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 5. Ops: []
I20260709 13:09:52.625097 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.625696 30482 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:52.624614 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 129665us
I20260709 13:09:52.627416 30483 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:52.628203 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.626880 31744 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:52.631245 31744 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:52.632004 32097 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:52.632287 31744 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.594322 31941 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.635870 30482 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:52.647225 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.627525 30557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:52.653592 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:52.653926 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 137626us
I20260709 13:09:52.654735 32079 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.655822 31987 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.656142 31796 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:52.656694 32062 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.657126 31555 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.643154 31808 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.608095 32078 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.659224 30407 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:09:52.663251 30376 leader_election.cc:336] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.041s (SENT)
W20260709 13:09:52.664136 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 98943.4us
I20260709 13:09:52.666294 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:52.668323 30484 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.669068 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.671793 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.672389 30559 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:52.670820 31808 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:52.674817 31946 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.675017 31808 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.675727 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.676975 30558 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.677690 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.678349 30558 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.679116 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:52.679512 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.680016 30554 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:52.680737 32029 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.681156 30554 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:52.686599 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.687889 30558 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:52.689414 30558 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.692660 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:52.695063 30451 leader_election.cc:336] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.548s (SENT)
I20260709 13:09:52.696483 30554 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.661273 32079 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.667232 30557 raft_consensus.cc:606] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.700016 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.700659 30403 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:52.704785 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.705040 31149 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.705775 30410 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:52.707707 30408 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:52.691085 31951 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.720211 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:52.720623 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.707283 30557 raft_consensus.cc:614] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:52.722456 30408 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
W20260709 13:09:52.728926 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 48303.9us
I20260709 13:09:52.731638 30558 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:52.721161 31800 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:52.737748 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 90657.8us
I20260709 13:09:52.740471 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.713147 32043 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:52.724668 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:09:52.742782 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.746269 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.746881 30403 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:52.730899 31951 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.754832 32109 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:52.755299 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60311.2us
I20260709 13:09:52.748610 31146 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:52.756057 30451 leader_election.cc:336] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.589s (SENT)
I20260709 13:09:52.756453 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.757507 30551 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.767665 32114 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:52.768510 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.768747 32109 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.769586 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.770433 30410 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.774247 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.745827 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:52.780714 31800 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.780279 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:52.790444 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48194.3us
I20260709 13:09:52.793653 31789 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.799042 31800 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:52.799778 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.763311 32079 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.800992 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:52.801761 30404 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:52.808341 32033 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:09:52.832443 30404 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:52.776747 32073 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.770200 32114 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.840385 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:52.808426 32110 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.848047 32114 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.849066 32110 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.851805 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.829704 31941 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.858448 30480 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:52.865865 30410 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:52.833936 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:52.836484 31789 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.842044 31994 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:52.874271 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.876050 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:52.847152 31555 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.872493 32103 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.884176 32113 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 13:09:52.871905 32104 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.868876 32062 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:52.879155 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45337us
I20260709 13:09:52.883316 31596 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.881482 31941 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:52.891084 32104 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:52.894207 32091 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.900385 31789 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.908704 31789 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:52.908836 32104 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.909703 31789 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.910020 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.901010 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:52.907835 31941 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:52.911989 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.911921 31941 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:52.912966 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.914285 32078 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.914752 31559 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.895162 31951 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:52.915330 31559 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:52.913347 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.913563 31965 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.913995 32103 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:52.915349 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:52.880261 32109 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:09:52.929989 30410 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:52.919374 31596 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:52.932338 31951 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:52.916716 31957 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.942276 31559 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:52.934185 31808 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.934533 31965 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:52.948598 31951 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:52.978976 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.987697 32073 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.988538 30376 leader_election.cc:400] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.991093 30376 leader_election.cc:400] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:52.992151 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.993165 32080 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.993559 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:52.994268 32073 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.994870 31636 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.000200 32080 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.001961 31636 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:52.941706 31946 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:52.979254 31951 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:53.006914 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 226691us
I20260709 13:09:52.942759 32103 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:09:53.008718 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.015720 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.017419 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.020627 32114 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.019599 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.003679 32074 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:09:53.022370 32114 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.022842 32074 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.023255 32074 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.023432 31965 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.024183 32074 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.024981 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:53.025434 32074 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.048177 30404 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.049032 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.053051 32123 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.053450 31957 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.053879 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.006958 31987 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:53.055678 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.004140 31596 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.056775 30477 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.026875 32109 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:53.047888 32091 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.050918 32089 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.064960 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71478.1us
I20260709 13:09:53.068554 30376 leader_election.cc:400] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:53.072738 30376 leader_election.cc:403] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:53.066939 32091 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:53.080852 32129 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:09:53.086138 30404 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:53.096707 30477 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:53.109906 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:53.058732 32123 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:53.122082 31636 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.076301 32104 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:53.123862 32105 raft_consensus.cc:3055] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.124337 32105 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:09:53.124383 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58810.7us
I20260709 13:09:53.125211 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.125298 32105 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.067890 32089 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:53.130158 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76350.9us
I20260709 13:09:53.076059 31965 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:53.135985 32089 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:53.137296 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.137997 31965 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.140136 32104 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.139870 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:53.139645 32091 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.140972 31965 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.143157 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.144199 31965 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:53.139760 30376 leader_election.cc:400] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:53.147267 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:53.147541 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.148770 31965 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.149343 31957 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.150734 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.151150 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.152741 31965 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.153235 32104 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:53.154196 31994 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:53.154623 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.157001 32103 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.154682 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.157951 32104 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:53.158366 32104 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:53.158775 32104 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:53.160740 32132 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:09:53.161809 31965 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:53.162217 31965 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:53.162580 31965 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:53.165578 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.168661 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.161301 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:53.173770 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:53.178414 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:53.180557 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.126190 31951 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.187227 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.191329 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:53.214000 30553 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.131655 31636 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:53.154800 31994 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.181049 32103 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.112820 31796 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:09:53.190275 31946 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:53.211923 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.190908 32092 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:53.198119 32071 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:53.216583 32143 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:53.217204 31636 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.220942 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.223639 30402 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.136020 32105 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.215382 32078 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.226969 32086 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:53.227895 32090 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:53.228549 31987 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.229285 31965 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.230345 31632 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.232034 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.227936 32079 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:53.248294 30560 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:53.249131 30402 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:53.254467 30553 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:53.260666 31965 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.253207 32063 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.279302 31632 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.279620 31153 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 1 LEARNER]: Advancing to term 3
I20260709 13:09:53.251483 32123 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:09:53.281910 32107 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:53.265980 32072 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.283473 32072 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.285881 32072 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.286535 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:53.286983 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.287202 30485 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
W20260709 13:09:53.287441 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 62138.9us
I20260709 13:09:53.287619 30556 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:53.288439 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:53.289229 32072 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:53.289606 32072 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.289920 32072 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.289951 31867 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:53.291049 32079 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:53.290511 31867 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:53.291954 31867 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.292057 32079 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.287568 32029 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.297043 31559 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.297434 31559 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.298174 31559 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:53.303932 32126 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.383s	user 0.001s	sys 0.002s
I20260709 13:09:53.279547 32090 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:53.305322 32090 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.305934 32104 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.306138 32090 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.307368 32090 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.308234 32104 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.310248 32074 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.310636 32074 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.311512 32074 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.312181 31789 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.312667 32074 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.317211 31559 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.331107 31153 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 3 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:09:53.335495 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47189.3us
I20260709 13:09:53.337169 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.338900 32078 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.340342 32078 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.341169 32078 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.341604 32078 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:53.344725 32080 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.345453 32080 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.351965 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.353184 31957 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.354943 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.356092 31957 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:53.356577 31957 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:53.357041 31957 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.342649 32078 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.362823 32080 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:53.362846 32078 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.368227 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.371146 32104 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.299027 32072 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:53.378798 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 98427.3us
W20260709 13:09:53.382501 32131 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.361s	user 0.002s	sys 0.006s
I20260709 13:09:53.392072 30555 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:53.378680 32071 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.395510 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.392503 30555 pending_rounds.cc:85] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 2
I20260709 13:09:53.400164 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:53.400655 30555 pending_rounds.cc:107] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:53.400925 30555 raft_consensus.cc:2889] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.404318 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:53.405378 30553 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.407403 30477 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:53.392603 32121 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.474s	user 0.007s	sys 0.000s
I20260709 13:09:53.409327 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.413607 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.413805 30551 raft_consensus.cc:2368] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:09:53.409384 30477 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:53.410194 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.415000 30558 raft_consensus.cc:2376] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3. Re-sending same reply.
I20260709 13:09:53.416437 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.416365 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.380558 32063 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:53.384291 32143 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:09:53.423904 30552 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.427563 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.428002 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.428369 30552 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.428629 30555 raft_consensus.cc:2376] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3. Re-sending same reply.
I20260709 13:09:53.389731 32107 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:09:53.430648 30559 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.390748 32104 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:53.437397 30560 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:53.439597 30411 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.440124 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.440730 30559 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:53.419860 31632 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.418136 31951 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.450918 30411 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:53.452504 30411 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:53.454070 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.426261 32103 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.405200 32071 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.455607 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:53.427412 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.456229 30411 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:53.457015 30403 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:53.457492 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.458389 30405 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.462968 30552 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:53.468616 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.469231 30552 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.427156 32080 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:09:53.430349 32046 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:09:53.483062 32046 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:53.483433 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.484064 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.484604 31994 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:53.486632 32127 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.461s	user 0.002s	sys 0.000s
I20260709 13:09:53.483410 32046 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:53.488380 31149 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:53.489073 32046 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.490257 32046 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.492419 32043 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.492842 32043 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:53.492980 31994 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.495285 31146 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:53.478873 32025 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.496791 30551 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:53.498603 32071 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.500919 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:53.479982 31800 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.503144 31800 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.503476 31800 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.480293 32151 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:53.504238 30558 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:09:53.480976 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.505584 30558 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.506083 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.506855 32070 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:53.507457 30558 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.508877 32024 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.510056 31596 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.510495 30558 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.477514 31808 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:53.481067 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.512234 30560 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.465500 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:53.512887 31145 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:09:53.462965 32142 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 13:09:53.482079 32147 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:53.488476 31965 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:09:53.516885 31957 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.517401 31962 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:53.504256 31800 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.495381 30552 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:53.518213 30556 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:53.518782 31800 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.510442 31596 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.520345 30560 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:53.520826 31596 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.522024 31596 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.522974 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:53.507577 32070 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.524566 30403 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:53.524991 30403 pending_rounds.cc:85] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 4
I20260709 13:09:53.525262 30403 pending_rounds.cc:107] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:53.525517 30403 raft_consensus.cc:2889] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.527696 32072 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.530149 30409 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.531258 30559 raft_consensus.cc:2410] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:09:53.453253 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.532179 30557 raft_consensus.cc:2376] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
W20260709 13:09:53.534951 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 115320us
W20260709 13:09:53.535283 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.536382 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.537111 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:53.537709 30558 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:53.539603 30558 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.542759 30405 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:53.542759 30411 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:53.544066 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.544631 30552 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.493820 32043 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:53.551874 30405 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.554729 30552 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:53.554982 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.556545 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.561810 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:53.566162 30406 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:53.568435 30451 leader_election.cc:400] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:09:53.564009 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:53.547669 32123 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.589368 30554 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:53.562063 32029 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:53.588328 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.564407 32103 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:53.565304 32104 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:09:53.568480 31147 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:53.567239 31632 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.583779 31789 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:53.605628 31559 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:53.548946 31867 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:53.608778 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 100172us
I20260709 13:09:53.609586 30485 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.605206 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:53.616490 31150 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:53.618100 31559 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.618709 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:53.608608 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.569607 31951 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:09:53.619695 30477 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.562671 32080 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:09:53.596733 32073 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:53.620714 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:09:53.631879 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 69346.5us
I20260709 13:09:53.623697 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:53.627504 30480 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:53.605342 32043 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:53.690973 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55342.2us
I20260709 13:09:53.617766 31987 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:53.605369 32103 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:53.635843 30405 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:53.617415 31789 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.690361 30407 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:53.735216 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.597260 32123 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:53.738849 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 120786us
I20260709 13:09:53.743302 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:53.629287 31632 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:53.634053 31994 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:53.748690 30477 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
W20260709 13:09:53.750253 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51862.2us
W20260709 13:09:53.694870 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 104291us
I20260709 13:09:53.598662 32091 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:09:53.751503 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:53.633463 32073 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.694372 32143 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.759704 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.736299 32103 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.694223 32070 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:09:53.758922 31808 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:53.757192 31994 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.765983 32073 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.774271 32143 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.779758 31965 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:53.753916 32159 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:53.806354 30477 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.809953 30486 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.781605 31994 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.784492 32125 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:53.827246 32160 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:09:53.839958 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:53.788501 31808 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:53.798066 32079 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.822808 32166 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.794250 31957 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.844696 30477 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:53.812608 31965 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:53.820356 32125 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:53.862895 30486 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:53.871359 30486 pending_rounds.cc:85] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 2
I20260709 13:09:53.871693 30486 pending_rounds.cc:107] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:53.871973 30486 raft_consensus.cc:2889] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:53.875699 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 257058us
I20260709 13:09:53.876550 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:53.877493 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:53.907588 32134 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:53.908514 32134 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:53.855082 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 103641us
I20260709 13:09:53.788998 32090 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:09:53.918181 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 163675us
I20260709 13:09:53.869535 31965 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.949213 30402 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.953480 30405 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:53.818478 31632 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.914165 31987 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:53.913506 32159 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:53.963195 30410 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:53.914768 31867 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:53.863037 32079 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.924078 31957 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:09:53.949651 32074 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:53.978369 31789 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:53.861814 32166 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.841674 31785 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:54.000649 32089 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.980803 32080 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:54.017519 32180 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.995016 32104 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:53.949967 32143 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.977852 31808 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:53.958504 32125 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.016050 32123 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.020164 32029 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.043712 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.044198 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.037142 31596 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:09:54.024052 32089 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.043419 32125 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:54.040673 32134 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.048938 32156 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.049193 32187 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:54.043310 32029 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.086813 32182 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:09:54.087551 32172 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:09:54.087905 32186 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:09:54.088393 32178 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:09:54.088656 32169 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:54.073845 32181 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:09:54.076745 32123 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:54.090979 32079 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.086366 32177 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:54.130609 32189 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.109553 31596 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.052978 32183 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:09:54.146530 32173 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:54.130882 32177 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:54.151144 32171 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.102975 32156 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:54.182868 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 232923us
I20260709 13:09:54.129585 32123 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:54.202591 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 219640us
I20260709 13:09:54.144996 31994 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.141330 31596 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.113984 32187 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.221156 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:54.184684 32109 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.135437 32189 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:54.228597 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.204252 31800 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:54.213902 32134 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:54.219524 31789 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.245814 31149 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.228886 31946 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.234517 32166 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.236908 32079 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.179639 32171 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.215296 32193 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.194s
I20260709 13:09:54.250818 32182 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.232369 32114 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:54.235718 32109 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.245790 31800 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.180765 32173 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.250805 32134 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.250531 31789 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.273520 30405 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:54.260931 32025 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.274919 32185 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:09:54.276079 32173 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:54.277112 32043 consensus_meta.cc:287] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.001s
I20260709 13:09:54.279518 32123 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.280576 32203 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:54.281319 31965 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.281971 32073 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.269379 32182 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.283599 32187 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.283929 32079 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:54.266378 32089 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.267293 32152 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.269104 32029 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.256498 31946 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.311982 30404 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:54.252336 32177 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.270051 31596 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:54.319561 32184 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:09:54.291201 32025 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.321652 32025 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.309495 32203 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.315472 32181 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.323323 32181 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.324061 32203 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.322053 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:54.324831 30409 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:54.325852 32109 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.326998 31946 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.330377 30558 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:54.331537 30554 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:54.309021 32152 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.334281 30555 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:54.335989 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:54.336697 30407 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:54.314208 31800 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.340719 30551 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:54.324087 32073 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.332957 32109 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.346475 32103 consensus_meta.cc:287] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.006s
I20260709 13:09:54.357040 32152 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.354938 32125 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.361337 31994 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.362793 31596 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.361863 32171 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.375970 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:54.376663 32182 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:54.378968 32165 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.586s	user 0.004s	sys 0.002s
I20260709 13:09:54.369416 32152 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.380308 31965 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.386801 30404 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:54.362243 32109 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.390887 32134 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.393405 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:54.363490 32103 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:54.404821 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.405750 30402 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:54.411721 32103 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.406108 32098 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.412688 32098 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.412788 30404 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.413638 32098 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.414212 32025 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:54.415346 32025 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:54.415707 32025 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.390080 31965 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:54.416555 32025 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.416970 31965 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.419631 30560 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:54.422118 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:54.423059 30560 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:54.417964 32025 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.446592 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.449244 30555 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:54.449829 30559 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:54.455295 30560 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:54.455624 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:54.453301 32098 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.464272 32191 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:54.464408 32211 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:09:54.465225 32208 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:09:54.459657 30556 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.443989 31808 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:54.447670 32182 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:54.454823 31789 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.451524 32159 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:54.468154 32191 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.488281 32191 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:54.499574 32109 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.510193 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:54.554941 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.574975 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1139) took 1132 ms. Trace:
I20260709 13:09:54.575435 30406 rpcz_store.cc:276] 0709 13:09:53.442756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.447676 (+  4920us) service_pool.cc:224] Handling call
0709 13:09:53.447982 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.566532 (+118550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.574671 (+1008139us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400266954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:54.574898 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271463168}
W20260709 13:09:54.579355 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.578390 32192 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.582423 32109 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.618135 30406 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:54.613750 31785 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:09:54.592938 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 330) took 1037 ms. Trace:
I20260709 13:09:54.604911 32125 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.630172 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 149) took 1012 ms. Trace:
I20260709 13:09:54.622527 32109 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.647501 32109 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.620589 32192 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.635346 32134 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:54.641871 31867 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:54.659403 31987 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.662853 31867 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:54.665343 32156 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.665681 31867 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:54.662477 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.637143 31150 rpcz_store.cc:276] 0709 13:09:53.618061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.633993 (+ 15932us) service_pool.cc:224] Handling call
0709 13:09:53.772114 (+138121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.868262 (+ 96148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.869776 (+  1514us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.980638 (+110862us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.381553 (+400915us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18003bfc80. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:09:54.459535 (+ 77982us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:54.462289 (+  2754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.475619 (+ 13330us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.615463 (+139844us) raft_consensus.cc:1685] finished
0709 13:09:54.615488 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.630074 (+ 14586us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":215506,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12876,"spinlock_wait_cycles":3632896,"thread_start_us":135695,"threads_started":2,"wal-append.queue_time_us":499794}
I20260709 13:09:54.631283 31145 rpcz_store.cc:276] 0709 13:09:53.554191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.559397 (+  5206us) service_pool.cc:224] Handling call
0709 13:09:54.357750 (+798353us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:54.357963 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.358189 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:54.423807 (+ 65618us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.562620 (+138813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.563495 (+   875us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.564642 (+  1147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.578687 (+ 14045us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.591357 (+ 12670us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107674,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1447,"raft.queue_time_us":843,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":9082112,"thread_start_us":99070,"threads_started":2,"wal-append.queue_time_us":177529}
I20260709 13:09:54.668341 32167 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:54.668758 32167 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:54.669564 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:54.669914 30558 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:54.637530 32125 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.663028 31987 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.679035 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:54.684566 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.684929 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.685446 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.671379 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.687398 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.672441 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:54.688683 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.688957 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.689698 32192 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:54.689870 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:09:54.690739 30480 raft_consensus.cc:606] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:54.669538 32167 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.691929 32167 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:54.693960 32125 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:54.694486 31965 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.698068 30478 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:54.699363 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.690902 32086 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:54.702383 30485 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:54.690084 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.633569 32191 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.703243 30560 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:54.708201 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:54.708501 30553 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:54.709511 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.704561 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.710201 30553 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.704952 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.710248 30560 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:54.719453 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:54.727954 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.728979 30479 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:54.730559 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.731523 30479 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 2: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:54.739152 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:54.740643 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:54.742012 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:54.743285 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.744015 30479 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:54.745095 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.745793 30479 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:54.748142 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.749634 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.751770 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.749261 31957 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:54.707182 31951 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:54.702132 32225 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:54.749883 32171 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:54.716907 32196 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:09:54.781178 32171 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:54.775692 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52596.3us
I20260709 13:09:54.783895 30560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "19556a24b91d452d98668a3709fbc29d"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:09:54.775990 30480 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:54.784498 30560 raft_consensus.cc:606] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Received request to transfer leadership to TS 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:54.784888 30560 raft_consensus.cc:614] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:54.784688 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:54.785104 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.786118 30480 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:54.778662 30482 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:54.786825 30482 pending_rounds.cc:85] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 1
I20260709 13:09:54.787117 30482 pending_rounds.cc:107] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:54.775159 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.787372 32190 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.788115 32190 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:54.788185 30481 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:54.788695 32190 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.789578 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.784049 32171 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:54.786330 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:54.787456 30482 raft_consensus.cc:2889] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.777108 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:54.747773 30484 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:54.707604 32086 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.718760 32134 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.754292 31785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53476 (request call id 8) took 14210 ms. Trace:
I20260709 13:09:54.777109 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.750200 32090 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:54.816926 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:54.834807 32152 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.836216 32152 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:54.836665 32152 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:54.837747 32152 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:54.839504 32157 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.103s	user 0.000s	sys 0.005s
I20260709 13:09:54.802243 31867 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:54.859901 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:54.807667 32134 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:54.892656 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.908288 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.932255 30483 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:54.864884 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:54.883432 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:54.854291 32190 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:54.883021 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:54.877336 32074 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 13:09:54.919625 32086 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.856581 32107 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:55.192243 31146 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:55.188702 32191 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.188985 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.144953 31596 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.117178 32177 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.190517 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:55.248543 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58083.1us
I20260709 13:09:54.993644 32070 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:55.202224 32152 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:55.206758 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 346952us
I20260709 13:09:55.261322 31957 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.261693 32219 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.849s	user 0.006s	sys 0.007s
I20260709 13:09:55.261888 31957 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:54.893596 31150 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:55.010941 32091 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.942008 32104 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.243575 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:55.197866 32167 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:09:55.213930 31796 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.211436 31951 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.209203 32046 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.188534 32170 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.209369 32125 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.212019 31867 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:55.253564 32086 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.209686 32174 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.212119 32107 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.253151 32171 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:55.292109 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1152) took 1159 ms. Trace:
I20260709 13:09:55.254432 32166 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:09:55.267370 32070 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:09:55.309835 32233 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
I20260709 13:09:55.313874 31559 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:55.329883 31559 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.251786 31596 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.267120 32156 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.317088 30403 rpcz_store.cc:276] 0709 13:09:54.132510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.132657 (+   147us) service_pool.cc:224] Handling call
0709 13:09:54.147301 (+ 14644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.147701 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.147727 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.153523 (+  5796us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.272692 (+119169us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:54.272725 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.272768 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.290870 (+1018102us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b24001303e8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041e429c4 00007fa041e40acb 00007fa041ffbdc9 00007fa041ffba55 00007fa041ffafb0 00007fa044c71488 00007fa044c71be8 00007fa044c49398 00007fa044c4476a 00007fa044c43bb6
0709 13:09:55.291718 (+   848us) raft_consensus.cc:1685] finished
0709 13:09:55.291746 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.292027 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1148,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":30504,"spinlock_wait_cycles":13240576,"thread_start_us":118820,"threads_started":1,"wal-append.queue_time_us":192286}
I20260709 13:09:55.255640 32073 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:55.313526 31987 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.284757 32163 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:55.299060 32104 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.316784 32167 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.283942 31965 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:55.253775 32177 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.289158 32098 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:09:55.316867 32171 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.316642 32107 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:55.315774 30484 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.005s
I20260709 13:09:55.342438 31559 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.326982 32190 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.295718 32091 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.348345 31957 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.350253 32104 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.356747 32078 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.372991 32078 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.360670 32203 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.802570 31785 rpcz_store.cc:276] 0709 13:09:40.496873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.498884 (+  2011us) service_pool.cc:224] Handling call
0709 13:09:40.601011 (+102127us) log.cc:844] Serialized 499 byte log entry
0709 13:09:41.380737 (+779726us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b1800029e00. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa045002b0b 00007fa045087b63 00007fa0450af752 00007fa04a06fd29
0709 13:09:54.679684 (+13298947us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138466,"raft.queue_time_us":173101,"raft.run_cpu_time_us":1464,"raft.run_wall_time_us":30844,"spinlock_wait_cycles":2981760,"thread_start_us":613325,"threads_started":1,"wal-append.queue_time_us":755478,"wal-append.run_cpu_time_us":2180,"wal-append.run_wall_time_us":1054161}
I20260709 13:09:55.312629 31951 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.316740 32046 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:55.344334 32234 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:09:55.320744 32125 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.320546 32170 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.323056 32174 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.340864 32134 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.398280 30560 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:55.319850 31867 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:55.361611 31153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.058s
I20260709 13:09:55.383397 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:55.401901 31153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.058s
I20260709 13:09:55.387607 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.367197 32171 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.342103 32156 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.395877 32070 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.308344 31796 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.362334 32167 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.381100 32180 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.390552 32143 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.417078 32181 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.417510 31951 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.385413 32203 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.427410 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.430003 31149 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:55.404279 32134 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.423209 32196 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:55.447048 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:55.447736 30560 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:55.433140 31965 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.438972 32196 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:55.478041 32181 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.436832 32134 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.430871 32180 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:55.541353 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.551990 32171 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.555660 32171 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.492403 32078 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.485146 31951 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.535931 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 209999us
I20260709 13:09:55.435985 32143 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.500330 31596 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.596407 30560 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:55.500483 32073 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:55.617213 31957 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:55.542809 32181 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.623206 31951 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:55.624534 32237 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:09:55.625092 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.626147 32170 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.486958 31965 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.613382 32104 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.633641 31596 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.635917 32236 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:09:55.636085 31957 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.633582 32073 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.643678 32024 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.644469 31951 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.621822 32078 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.623224 32046 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.653000 32171 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:55.653554 32181 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.654206 32170 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:09:55.618808 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.665073 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:55.666687 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.632853 32091 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.640870 32177 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.676558 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:55.639747 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.639016 31867 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:55.696771 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.710213 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:55.711788 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:55.712378 30477 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.712815 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:55.715121 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50134.4us
I20260709 13:09:55.670145 32125 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.716217 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:55.689536 32174 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.669956 31596 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.746419 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.696738 32046 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.692001 31796 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.747264 32245 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.669763 32104 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.755743 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.715236 32156 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.717617 32203 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.718129 32091 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.722041 32064 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:55.685410 32024 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.723537 32177 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:55.809718 32177 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.810178 32177 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.715123 32170 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.812429 31596 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.767740 32046 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.692523 32078 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.813485 32170 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.814961 32046 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:55.815104 30308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 194) took 11270 ms (client timeout 15000 ms). Trace:
I20260709 13:09:55.815536 32078 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.816248 32073 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.817085 32247 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:55.817530 32247 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:55.817775 32189 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.796358 31559 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.818568 31559 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.819152 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:55.819674 30480 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:09:55.820077 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1464) took 1108 ms. Trace:
I20260709 13:09:55.820694 31559 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.817550 30305 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 3, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.821552 31957 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.745877 32125 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.775045 32242 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.822429 32242 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.822211 32125 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.822913 32242 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.824556 32125 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.698364 32171 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.825137 32125 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:55.826227 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.827142 32171 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.827493 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1150) took 1488 ms. Trace:
I20260709 13:09:55.827549 32257 raft_consensus.cc:476] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Not starting pre-election -- already a leader
W20260709 13:09:55.827842 32152 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 13:09:55.788622 30477 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:09:55.668172 32196 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.828393 31965 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.775205 31796 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.795256 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:55.748904 31785 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.829445 32143 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.829586 31796 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.829952 31785 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.768397 32241 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.745812 32167 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.831632 32241 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.831816 31796 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.832019 31785 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.832737 32091 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.774560 31636 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:55.833775 32171 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:55.834275 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1342) took 1166 ms. Trace:
I20260709 13:09:55.834049 31636 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.834823 32091 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.835856 30374 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:55.820444 30485 rpcz_store.cc:276] 0709 13:09:54.711581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.711731 (+   150us) service_pool.cc:224] Handling call
0709 13:09:54.775100 (+ 63369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.791643 (+ 16543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.791690 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.189058 (+397368us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.632380 (+443322us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:55.632414 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.632497 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.819876 (+187379us) raft_consensus.cc:1685] finished
0709 13:09:55.819896 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.820023 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16138,"raft.queue_time_us":16505,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":376287,"threads_started":1,"wal-append.queue_time_us":551504}
I20260709 13:09:55.837462 30374 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:55.800283 31147 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:09:55.773360 32245 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.722988 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:55.806982 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.839218 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:55.796140 32064 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.842777 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.809172 32024 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.817900 32247 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:55.829617 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.856799 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.858062 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.801556 32134 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:55.774297 32246 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.803634 32104 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.834637 30558 rpcz_store.cc:276] 0709 13:09:54.667932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.670688 (+  2756us) service_pool.cc:224] Handling call
0709 13:09:55.833612 (+1162924us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:55.833800 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.833966 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.833990 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.834028 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.834056 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.834113 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.834223 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3700096}
I20260709 13:09:55.822037 30305 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:55.836191 31636 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.874164 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 333) took 1086 ms. Trace:
I20260709 13:09:55.828068 30556 rpcz_store.cc:276] 0709 13:09:54.339608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.348534 (+  8926us) service_pool.cc:224] Handling call
0709 13:09:54.371054 (+ 22520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.476958 (+105904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.827212 (+1350254us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54003f2d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:55.827405 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118606720}
I20260709 13:09:55.849454 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1156) took 1653 ms. Trace:
I20260709 13:09:55.875435 30402 rpcz_store.cc:276] 0709 13:09:54.196491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.196854 (+   363us) service_pool.cc:224] Handling call
0709 13:09:54.197176 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.406541 (+209365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.849200 (+1442659us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002a67d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:55.849390 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479221632}
I20260709 13:09:55.850833 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.877269 30485 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:55.878538 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:55.879351 30485 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.870983 30305 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:55.874567 31149 rpcz_store.cc:276] 0709 13:09:54.783026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.783435 (+   409us) service_pool.cc:224] Handling call
0709 13:09:55.243329 (+459894us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:09:55.869557 (+626228us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54006d01d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:55.869702 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350289536}
I20260709 13:09:55.851977 32189 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:55.906368 30305 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 2 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.853716 32064 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.836180 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:55.872997 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.913937 30477 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:55.848271 32107 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:55.848814 32226 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.228s	user 0.004s	sys 0.013s
I20260709 13:09:55.841984 32171 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:55.861195 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:55.882201 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.915652 30553 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:55.853850 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:55.855743 32168 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:55.815481 30308 rpcz_store.cc:269] 0709 13:09:44.550310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.557907 (+  7597us) service_pool.cc:224] Handling call
0709 13:09:45.279634 (+721727us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:09:55.815001 (+10535367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:52.678980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:52.679657 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:52.679705 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:52.679726 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:52.680453 (+   727us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:52.680580 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:52.680617 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:09:52.681220 (+   603us) tablet.cc:701] Row locks acquired
0709 13:09:52.681270 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:09:52.681423 (+   153us) write_op.cc:270] Start()
0709 13:09:52.681573 (+   150us) write_op.cc:276] Timestamp: P: 1783602592681365 usec, L: 0
0709 13:09:52.681592 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:52.682220 (+   628us) log.cc:844] Serialized 2068 byte log entry
0709 13:09:53.020214 (+337994us) op_driver.cc:464] REPLICATION: finished
0709 13:09:53.232684 (+212470us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa041f9f0ac 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa048adfef0
0709 13:09:53.403955 (+171271us) write_op.cc:301] APPLY: starting
0709 13:09:53.404126 (+   171us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:53.411697 (+  7571us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:53.411719 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:53.427230 (+ 15511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:53.459006 (+ 31776us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:09:53.466441 (+  7435us) write_op.cc:312] APPLY: finished
0709 13:09:53.478241 (+ 11800us) log.cc:844] Serialized 46 byte log entry
0709 13:09:53.478435 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.478538 (+   103us) write_op.cc:454] Released schema lock
0709 13:09:53.478585 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:53.478975 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.479008 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":922249,"reported_tablets":12,"spinlock_wait_cycles":1314467200,"child_traces":[["op",{"apply.queue_time_us":373477,"apply.run_cpu_time_us":3166,"apply.run_wall_time_us":85002,"num_ops":5,"prepare.queue_time_us":89470,"prepare.run_cpu_time_us":3562,"prepare.run_wall_time_us":11898,"replication_time_us":338451,"spinlock_wait_cycles":14931712,"thread_start_us":383952,"threads_started":2}]]}
I20260709 13:09:55.864766 31785 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:09:55.909507 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:55.880558 32134 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.919912 32241 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.921939 32245 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:55.923172 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.911922 30305 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.923950 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.949000 30477 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:55.950222 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.950596 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:55.950873 30477 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:55.914618 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1453) took 1230 ms. Trace:
I20260709 13:09:55.952852 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:55.951756 30484 rpcz_store.cc:276] 0709 13:09:54.683817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.683918 (+   101us) service_pool.cc:224] Handling call
0709 13:09:54.747379 (+ 63461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.747632 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:55.365337 (+617705us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.881642 (+516305us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800360be0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:09:55.906864 (+ 25222us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.914300 (+  7436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.914356 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:55.914395 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.914454 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.914568 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39029,"prepare.queue_time_us":292234,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":267804,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":50233,"spinlock_wait_cycles":5399296,"thread_start_us":460838,"threads_started":2,"wal-append.queue_time_us":403067}
W20260709 13:09:55.929476 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 75699.3us
I20260709 13:09:55.955291 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:55.956308 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 326084us
I20260709 13:09:55.956373 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:55.927938 31144 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.933805 32167 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.934931 31636 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:55.935906 32191 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.962402 30305 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 4 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.939996 32134 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.941268 32107 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.941888 30481 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:55.976562 30305 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:55.944965 32247 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.946902 32170 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:55.911082 32125 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.908747 32257 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.990973 32064 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:55.924465 32171 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.994148 32171 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:55.995882 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:55.996542 30560 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:55.928186 32189 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:55.961730 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.998991 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.999207 30484 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:55.999718 30551 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:55.999372 32189 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.000160 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.000572 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.001271 30551 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:56.001581 30484 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:56.002003 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.957943 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.003055 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.003314 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.003672 30559 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:56.004640 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.004848 32241 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:56.005199 30559 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:55.987957 32073 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.007895 32073 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.009291 30484 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:56.010012 32073 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.012050 32242 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.961112 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:55.967031 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.028919 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:56.029227 30553 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:56.030427 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.031423 30553 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 2: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:56.024360 30551 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:56.033967 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.035933 30553 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:55.987679 31785 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.972013 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.973641 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.979875 30305 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:09:55.982956 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:09:55.980219 30524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.557s (SENT) [suppressed 43 similar messages]
I20260709 13:09:55.960593 32024 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.960649 31957 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:55.960503 32104 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:55.990300 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.070675 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.072405 30403 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:56.072732 30484 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:56.072909 30405 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5.
I20260709 13:09:55.990944 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:55.992496 32254 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:55.993243 32248 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.993149 32257 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:55.870599 32246 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:55.963236 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 234969us
W20260709 13:09:56.014642 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 56757.1us
I20260709 13:09:56.089032 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.015460 31149 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:56.022234 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:55.958307 30485 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:56.092747 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.093338 30477 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:56.094398 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.095014 30485 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:56.028434 32125 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:56.061241 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74349.2us
I20260709 13:09:56.064033 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:55.975236 32191 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.033023 31636 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.108755 31636 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.108871 32125 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:55.967010 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.109941 30554 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:56.071095 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:56.110556 30558 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:55.974797 32259 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:09:56.066967 30560 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:55.990717 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.081858 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.083318 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.045423 32263 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.028144 32064 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.062373 32175 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:56.188174 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 75928.9us
I20260709 13:09:56.064476 32073 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.033164 32177 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.090049 30559 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:56.101841 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.102821 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.103708 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.104028 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.079280 32254 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:56.105491 31957 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.105810 30403 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:56.105947 32104 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.106062 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.107259 31148 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:56.108119 32191 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.109201 31636 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.064505 32268 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.052835 32107 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.111882 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.111887 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:56.084149 32025 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:56.137157 30405 raft_consensus.cc:2410] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:56.069304 31146 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:56.144397 30558 raft_consensus.cc:2410] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:56.112355 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:56.110176 32074 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.065332 31785 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.189002 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.188975 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.514734 31153 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:56.421531 30553 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:56.521287 30560 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:56.222903 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 242708us
I20260709 13:09:56.522506 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.338831 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1370) took 1603 ms. Trace:
I20260709 13:09:56.523991 30485 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:09:56.189605 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.523561 30411 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:56.525424 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:56.525717 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 336829us
I20260709 13:09:56.524809 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.526371 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.526293 30485 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:56.526652 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 415507us
I20260709 13:09:56.527247 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.527678 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.528925 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.529134 30404 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:56.529186 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:56.525590 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 422868us
I20260709 13:09:56.530056 30411 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:56.530155 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.531215 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.532210 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.545812 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:56.547603 30558 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:56.550483 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:56.587738 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57642.5us
W20260709 13:09:56.578253 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.588600 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.524181 30486 rpcz_store.cc:276] 0709 13:09:54.735502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.829848 (+1094346us) service_pool.cc:224] Handling call
0709 13:09:55.830182 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.830520 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.830548 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.843315 (+ 12767us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.080286 (+236971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.080321 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.080392 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.338590 (+258198us) raft_consensus.cc:1685] finished
0709 13:09:56.338610 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.338770 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":77,"thread_start_us":236724,"threads_started":1,"wal-append.queue_time_us":400403}
I20260709 13:09:56.592034 30406 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 2: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:56.592242 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:56.383311 32271 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:09:56.594102 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:56.593991 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 405066us
I20260709 13:09:56.599808 30408 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:56.513186 32280 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:09:56.402853 31962 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:56.390785 32170 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.608421 32170 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.609210 32196 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:56.609634 32246 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.612016 32180 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.547616 32167 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.614883 32167 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.615307 32167 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.601964 30555 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:56.490872 31796 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.384011 32266 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:09:56.402721 32024 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.198920 32263 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.605016 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:56.605597 32279 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:09:56.335147 32156 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:56.605942 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1367) took 1871 ms. Trace:
I20260709 13:09:56.546545 32245 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:56.606441 32070 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:56.521350 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 522112us
I20260709 13:09:56.583168 32073 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.607710 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.595062 32103 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.601295 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.680922 30406 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
W20260709 13:09:56.681241 30305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.024s	sys 0.018s
W20260709 13:09:56.681552 30305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.024s	sys 0.018s
I20260709 13:09:56.625562 32024 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:56.717506 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:56.337225 31596 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:56.389643 32241 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:56.546742 32168 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:56.519167 32134 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.502944 32247 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.533371 31957 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.547678 32091 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.634043 30486 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:56.546938 32125 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:56.593955 32181 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:56.636109 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1373) took 1899 ms. Trace:
I20260709 13:09:56.523177 32074 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:56.614125 32254 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:56.673218 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65599.2us
I20260709 13:09:56.673094 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.554894 32104 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.495390 32171 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.782137 32104 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:56.761461 32181 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.783010 32181 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.782932 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:56.783653 30486 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.677340 32177 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.772081 31785 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:56.672094 30478 rpcz_store.cc:276] 0709 13:09:54.734507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.246095 (+511588us) service_pool.cc:224] Handling call
0709 13:09:55.284633 (+ 38538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.638631 (+353998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.671884 (+ 33253us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.763110 (+ 91226us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.045703 (+282593us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:56.051773 (+  6070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.062949 (+ 11176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.602451 (+539502us) raft_consensus.cc:1685] finished
0709 13:09:56.605718 (+  3267us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.605870 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23510,"raft.queue_time_us":25318,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18395,"thread_start_us":531162,"threads_started":2,"wal-append.queue_time_us":709506}
I20260709 13:09:56.787143 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:56.787828 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.788108 32073 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.639839 32245 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.788861 32245 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.583575 32268 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.791599 32263 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.791746 32268 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.610602 32170 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.578214 32107 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.641196 32267 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:09:56.634377 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 43915us
I20260709 13:09:56.794564 32074 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.795233 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:56.795907 32074 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.761260 32091 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.799327 32275 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:56.799046 32024 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.799959 32275 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:56.800211 32024 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.801085 32275 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.802991 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.803609 31153 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:56.804486 30485 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:56.745898 32168 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:56.745354 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 97) took 2008 ms. Trace:
I20260709 13:09:56.303253 32258 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:56.723826 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.607721 31962 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:56.734951 30405 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:56.337116 32257 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.217509 32175 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.739024 30408 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:56.821246 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.740134 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1365) took 2006 ms. Trace:
I20260709 13:09:56.822153 30482 rpcz_store.cc:276] 0709 13:09:54.733853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.810981 (+ 77128us) service_pool.cc:224] Handling call
0709 13:09:55.417758 (+606777us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800004b98. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:55.417976 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.720271 (+302295us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:09:55.720305 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.721281 (+   976us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.080282 (+359001us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:56.080321 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.080402 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.702781 (+622379us) raft_consensus.cc:1685] finished
0709 13:09:56.702808 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.740035 (+ 37227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":327230,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":21345,"spinlock_wait_cycles":39411072,"thread_start_us":659673,"threads_started":2,"wal-append.queue_time_us":477024}
I20260709 13:09:56.669448 32242 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:56.695019 31800 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:56.695596 32103 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.639125 31796 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.761623 30483 rpcz_store.cc:276] 0709 13:09:54.736479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.419508 (+683029us) service_pool.cc:224] Handling call
0709 13:09:55.419913 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.635470 (+215557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.635513 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.635570 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:55.635611 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.635759 (+1000148us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400343ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:56.635811 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.635995 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495244032}
I20260709 13:09:56.669715 32156 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.701218 32070 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:56.773463 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.762751 32125 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.780565 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.788158 31145 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:09:56.806046 31559 consensus_queue.cc:1175] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "027e191e31da4af2bc83c5ddc0c15d05" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:09:56.806483 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:56.700148 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.718756 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 102) took 1007 ms. Trace:
I20260709 13:09:56.810983 32203 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.760957 31957 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:56.818190 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:56.816824 32281 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:56.741755 31596 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.798271 31636 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:56.804502 32249 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:09:56.806576 32107 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:56.746101 32241 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:56.925714 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:56.812500 32073 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:09:56.919065 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1377) took 2181 ms. Trace:
I20260709 13:09:56.933481 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.811404 32168 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:56.929476 30480 rpcz_store.cc:276] 0709 13:09:55.711670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.712536 (+   866us) service_pool.cc:224] Handling call
0709 13:09:56.718524 (+1005988us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400020154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:56.718669 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243898112}
I20260709 13:09:56.814298 30478 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:56.937166 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.799074 32091 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:56.931347 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 124944us
I20260709 13:09:56.938194 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.812055 31785 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.808728 32177 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:56.931723 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.940080 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:56.925192 32283 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:09:56.991945 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:56.993664 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:57.007261 30552 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.996536 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.986833 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:56.999379 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:57.011413 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:57.012327 30411 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:56.933924 30479 rpcz_store.cc:276] 0709 13:09:54.737776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.247021 (+509245us) service_pool.cc:224] Handling call
0709 13:09:55.258938 (+ 11917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.360502 (+101564us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:55.615170 (+254668us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.914611 (+299441us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.933945 (+ 19334us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b48000b19d8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:09:55.946020 (+ 12075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.946074 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:55.946120 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.918783 (+972663us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540017c5d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:56.918851 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.918997 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40115,"prepare.queue_time_us":388825,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":43896,"raft.run_cpu_time_us":1916,"raft.run_wall_time_us":12027,"spinlock_wait_cycles":243038848,"thread_start_us":539103,"threads_started":2,"wal-append.queue_time_us":430421}
I20260709 13:09:57.013342 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.817513 32268 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.814673 32182 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.011781 30480 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.820653 32246 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.933682 32103 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.017583 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.001261 30554 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:09:56.939131 32090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.013s
I20260709 13:09:56.928928 31800 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.022187 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.024787 30484 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:56.929406 32125 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.889958 32171 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:56.937281 32263 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:57.023061 31144 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 1.040s	user 0.009s	sys 0.002s
I20260709 13:09:57.021915 32180 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.988828 32242 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.037352 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:56.825127 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 262) took 1094 ms. Trace:
I20260709 13:09:57.043659 30555 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:56.926980 32245 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.049450 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:56.991204 31148 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:57.014024 30483 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
W20260709 13:09:57.036078 32090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.008s	sys 0.013s
I20260709 13:09:56.883325 32258 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:09:57.062559 30552 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:09:56.811666 30481 rpcz_store.cc:276] 0709 13:09:54.732860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.800304 (+ 67444us) service_pool.cc:224] Handling call
0709 13:09:56.727635 (+1927331us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001c5554. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:56.741395 (+ 13760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724874624}
I20260709 13:09:57.102368 30486 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:09:57.034045 30402 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:57.119138 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.120720 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.039306 32073 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:57.108557 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.022s
I20260709 13:09:57.006019 32203 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.013072 31785 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.022969 32268 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.016916 32177 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.037899 32246 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.096145 32180 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.048080 31800 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.050454 32263 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:57.126466 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.008s	sys 0.022s
I20260709 13:09:57.017970 31962 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:57.144055 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.127375 32196 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.006s
I20260709 13:09:56.938588 32167 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.054960 31144 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:57.130980 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:57.133404 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.106920 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:57.025996 32182 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.127624 30408 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
W20260709 13:09:57.145900 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.159263 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.159262 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.147704 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.147810 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.161087 30558 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:57.148662 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.130858 30478 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:57.166934 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.167853 30559 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:57.161118 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.129281 32073 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:57.162142 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.169031 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.164031 30560 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:57.171497 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.172359 30402 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:57.145390 32180 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.112437 32242 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:57.175851 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 163889us
I20260709 13:09:57.177204 30551 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:57.132069 32257 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:57.151346 31145 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:57.152438 32263 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.089156 32070 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.182996 30560 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:57.154914 32170 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.185469 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.186115 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:57.158874 32301 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:57.171563 31146 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.194144 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:57.148356 32302 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:57.199050 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:57.181185 31144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 334) took 2375 ms (client timeout 1654 ms). Trace:
I20260709 13:09:57.205899 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:57.181294 31962 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.182531 32312 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.196837 32175 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.200474 32166 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.219231 32312 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:57.225498 32312 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.193181 32257 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:57.227293 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.211989 31636 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.195876 32078 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:57.242720 31785 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:57.244410 32307 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:57.245159 32310 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:57.245975 32300 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:57.246244 32310 consensus_queue.cc:1243] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:57.248345 32310 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.249917 32258 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.253806 32181 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.255523 32203 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.257611 32182 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.258728 32167 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.220556 31796 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.220366 32046 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.260191 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.199923 32170 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.275259 32268 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.275975 32242 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.209008 32301 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:57.265882 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 66919us
W20260709 13:09:57.245301 32305 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:57.095872 31147 rpcz_store.cc:276] 0709 13:09:55.722299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.745504 (+ 23205us) service_pool.cc:224] Handling call
0709 13:09:55.799677 (+ 54173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.800130 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:55.938798 (+138668us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.243522 (+304724us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.335405 (+ 91883us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.335572 (+   167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:56.738820 (+403248us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.763019 (+ 24199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.771127 (+  8108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.776016 (+  4889us) raft_consensus.cc:1685] finished
0709 13:09:56.806925 (+ 30909us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.815977 (+  9052us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":680258,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":49098,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":23128,"thread_start_us":555516,"threads_started":2,"wal-append.queue_time_us":496844}
I20260709 13:09:57.269937 32046 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:57.273806 32181 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.274312 32246 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.275002 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1474) took 1181 ms. Trace:
I20260709 13:09:57.220139 31596 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.293820 30477 rpcz_store.cc:276] 0709 13:09:56.093826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.532114 (+438288us) service_pool.cc:224] Handling call
0709 13:09:56.532386 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.547135 (+ 14749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.547164 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.547611 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.934159 (+386548us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:56.934195 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.934274 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.274790 (+340516us) raft_consensus.cc:1685] finished
0709 13:09:57.274813 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.274942 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14392,"raft.queue_time_us":14559,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7961,"thread_start_us":328033,"threads_started":1,"wal-append.queue_time_us":570693}
I20260709 13:09:57.267725 32078 consensus_queue.cc:1243] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:09:57.259155 32294 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:09:57.278424 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.264882 30480 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:57.296757 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.297425 30559 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:57.238098 32241 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.213238 32302 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.232753 32297 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:57.211531 31144 rpcz_store.cc:269] 0709 13:09:54.783446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.783791 (+   345us) service_pool.cc:224] Handling call
0709 13:09:55.836022 (+1052231us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:09:57.159291 (+1323269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28841344}
I20260709 13:09:57.298344 30555 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:57.291697 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:09:57.300453 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 94649.4us
I20260709 13:09:57.280131 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1360) took 1312 ms. Trace:
I20260709 13:09:57.306121 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:57.293898 32046 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.307463 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:57.299990 32257 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.326150 32181 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.332870 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:57.333235 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.334342 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.334923 30407 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:57.335201 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:57.339378 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.345263 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:09:57.332772 32024 consensus_meta.cc:287] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 13:09:57.347957 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.302919 32297 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.320533 32242 raft_consensus.cc:2764] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:09:57.338856 32303 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:09:57.354146 30404 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:57.304551 32241 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:57.340178 32257 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.355635 30407 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:57.308815 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:57.360743 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.364452 30404 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:57.350919 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:57.345997 31596 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:57.345742 31796 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:57.365610 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.368089 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.348588 32181 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.340171 31146 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:57.337961 32166 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.374338 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.358568 32297 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.345348 32249 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:09:57.374239 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.349247 32090 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:09:57.410868 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 696655us
I20260709 13:09:57.400667 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.365581 32257 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.410204 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:57.399176 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 44661.5us
W20260709 13:09:57.412012 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.371552 32024 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.420464 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.372288 31796 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.413630 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.423612 30558 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:57.407754 31800 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.418278 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.424558 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.375631 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:57.424823 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:57.427229 30404 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3.
I20260709 13:09:57.429361 30558 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:57.429862 32302 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.426589 32091 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.419737 32257 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.368010 31596 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:57.447093 32308 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:57.423647 31957 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.448697 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:57.449649 32297 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.424425 32024 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.425657 31796 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:57.463547 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 166618us
I20260709 13:09:57.490089 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:57.465345 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.305626 30556 rpcz_store.cc:276] 0709 13:09:55.968195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.975879 (+  7684us) service_pool.cc:224] Handling call
0709 13:09:56.062200 (+ 86321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.110551 (+ 48351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.133325 (+ 22774us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.388098 (+254773us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.915442 (+527344us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:56.923349 (+  7907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.928028 (+  4679us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.260632 (+332604us) raft_consensus.cc:1685] finished
0709 13:09:57.264772 (+  4140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.278998 (+ 14226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83,"raft.queue_time_us":11203,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":367795,"threads_started":1,"wal-append.queue_time_us":724729}
W20260709 13:09:57.447161 32321 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:57.458479 32182 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:57.496552 30404 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:57.426863 32103 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.459136 32320 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.499341 30407 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:57.498333 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.487541 31596 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.435091 32268 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:57.488111 32024 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.502086 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.452226 32168 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.506614 30406 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:57.505396 30404 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:57.496470 31800 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.498658 32241 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:57.507602 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.491544 32301 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.498883 32182 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.487659 32180 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.511161 32091 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.490904 31145 raft_consensus.cc:2376] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5. Re-sending same reply.
I20260709 13:09:57.511173 31957 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.509325 32241 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.526013 32241 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.503278 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:57.520977 32168 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.506439 32181 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:57.522332 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:09:57.523319 32316 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:09:57.515774 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:57.516149 32312 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.537585 32312 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.525857 32046 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.518781 32125 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.538887 32318 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:57.540441 32125 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.517851 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.532913 32181 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:57.543231 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43936 (request call id 263) took 1634 ms. Trace:
I20260709 13:09:57.543725 31149 rpcz_store.cc:276] 0709 13:09:55.909232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.909397 (+   165us) service_pool.cc:224] Handling call
0709 13:09:57.542966 (+1633569us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b540069ebd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:57.543155 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153139072}
W20260709 13:09:57.547115 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.515797 32182 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:57.551924 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:57.588070 32046 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.589543 32301 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:57.590112 32301 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.590838 32091 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:57.591363 32091 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.592371 32301 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:57.541821 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.596714 30556 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 2.
I20260709 13:09:57.597919 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:57.601518 32263 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.605383 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1457) took 1071 ms. Trace:
I20260709 13:09:57.605902 30405 rpcz_store.cc:276] 0709 13:09:56.534118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.550181 (+ 16063us) service_pool.cc:224] Handling call
0709 13:09:57.605092 (+1054911us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400208d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:57.605262 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337663744}
I20260709 13:09:57.619972 32297 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.623888 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:57.624292 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:57.625136 31149 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:09:57.628211 32180 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:57.593372 32091 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:57.543218 31147 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:57.594419 32181 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:57.502731 32320 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:57.637940 32181 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.874085 30553 raft_consensus.cc:2368] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
W20260709 13:09:57.989857 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.598591 30556 raft_consensus.cc:2376] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6. Re-sending same reply.
I20260709 13:09:57.886205 31785 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.874547 32297 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:57.885942 31796 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.181254 32091 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:57.931317 32167 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.229846 32326 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.035s	sys 0.034s
W20260709 13:09:58.247160 32070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.027s	sys 0.029s
I20260709 13:09:58.243009 32167 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.253347 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:09:58.248301 32326 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.035s	sys 0.035s
I20260709 13:09:58.232654 32297 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.244983 32320 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:58.247664 32263 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:58.258054 32070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.028s	sys 0.029s
I20260709 13:09:58.237303 32091 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:58.269002 30449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.023s	sys 0.030s
I20260709 13:09:58.231953 31785 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:58.269349 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.023s	sys 0.030s
W20260709 13:09:58.270157 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.274056 31559 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:58.274251 32091 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:58.274848 31559 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:58.290841 32263 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:09:58.295928 30551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1182) took 1148 ms (client timeout 1520 ms). Trace:
W20260709 13:09:58.298985 30551 rpcz_store.cc:269] 0709 13:09:57.147910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.160814 (+ 12904us) service_pool.cc:224] Handling call
0709 13:09:58.295670 (+1134856us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b54002459d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:58.295855 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18790656}
I20260709 13:09:58.290311 32103 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:58.285276 31596 consensus_meta.cc:287] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.000s
W20260709 13:09:58.282054 32257 consensus_meta.cc:287] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 13:09:58.301333 31559 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:58.297106 32182 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 13:09:58.263453 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:09:58.303218 32241 consensus_meta.cc:287] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.003s
I20260709 13:09:58.303556 32070 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.302861 32263 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:58.306653 31596 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.306857 32257 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.320557 32070 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.314975 32241 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:58.344970 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1461) took 1744 ms (client timeout 1715 ms). Trace:
W20260709 13:09:58.347846 30406 rpcz_store.cc:269] 0709 13:09:56.600407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.991666 (+391259us) service_pool.cc:224] Handling call
0709 13:09:58.344694 (+1353028us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540020a154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:58.344882 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148769024}
W20260709 13:09:58.336625 32024 consensus_meta.cc:287] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.828s	user 0.006s	sys 0.006s
I20260709 13:09:58.362010 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.315522 30556 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.367321 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.369021 30406 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:58.372671 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.385058 30406 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:58.311933 32182 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.371407 32297 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:58.384871 31147 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:58.365496 32024 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.393502 32167 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:58.374634 31796 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:58.405634 31785 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:58.403937 31596 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:58.416853 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.422009 30406 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 2. Current term is 3.
W20260709 13:09:58.426239 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 243723us
I20260709 13:09:58.421038 32257 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:58.420019 32263 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:09:58.426980 32330 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:58.428576 32070 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:58.431294 32024 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:58.432878 30560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.000s	sys 0.013s
W20260709 13:09:58.434399 30560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.000s	sys 0.014s
W20260709 13:09:58.434957 30451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.000s	sys 0.015s
I20260709 13:09:58.435253 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1188) took 1239 ms. Trace:
W20260709 13:09:58.435294 30451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.000s	sys 0.015s
W20260709 13:09:58.432915 30558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.007s	sys 0.007s
W20260709 13:09:58.435947 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 945499us
W20260709 13:09:58.432842 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 163404us
W20260709 13:09:58.437120 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.436021 30558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.007s	sys 0.008s
I20260709 13:09:58.438262 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1195) took 1206 ms. Trace:
I20260709 13:09:58.439568 30558 rpcz_store.cc:276] 0709 13:09:57.231396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.440877 (+209481us) service_pool.cc:224] Handling call
0709 13:09:57.441242 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.441512 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:57.465160 (+ 23648us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.437946 (+972786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.437998 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:58.438037 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.438100 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.438212 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46145,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":939,"thread_start_us":946029,"threads_started":1}
I20260709 13:09:58.441202 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:58.435667 30560 rpcz_store.cc:276] 0709 13:09:57.196124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.196509 (+   385us) service_pool.cc:224] Handling call
0709 13:09:57.215254 (+ 18745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.215448 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:57.501175 (+285727us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.434925 (+933750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.434982 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:58.435025 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.435091 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.435204 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92571,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2864,"raft.queue_time_us":2153,"thread_start_us":1218822,"threads_started":2}
I20260709 13:09:58.495886 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.496796 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:58.497356 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1470) took 1692 ms. Trace:
I20260709 13:09:58.497723 30406 rpcz_store.cc:276] 0709 13:09:56.804533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.437496 (+1632963us) service_pool.cc:224] Handling call
0709 13:09:58.497281 (+ 59785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.539085 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:58.541216 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:58.437143 32257 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:58.554401 32070 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.554919 32024 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.555050 31596 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:58.619724 31596 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:58.619529 32070 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.619961 32182 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:58.555773 32332 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:09:58.619553 32024 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:58.555258 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:58.622534 31146 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:58.556667 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1200) took 1275 ms. Trace:
I20260709 13:09:58.660108 30560 rpcz_store.cc:276] 0709 13:09:57.290974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.555874 (+1264900us) service_pool.cc:224] Handling call
0709 13:09:58.556202 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.556370 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.556393 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.556435 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:58.556463 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.556515 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.556618 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.550186 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1198) took 1281 ms. Trace:
I20260709 13:09:58.695331 30558 rpcz_store.cc:276] 0709 13:09:57.269257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.549093 (+1279836us) service_pool.cc:224] Handling call
0709 13:09:58.549504 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.549737 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.549775 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.549838 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:58.549896 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.549970 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.550113 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:58.600134 31117 leader_election.cc:336] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.712s (SENT)
I20260709 13:09:58.620112 31596 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:58.698022 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97942us
I20260709 13:09:58.565650 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:58.979336 30406 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:09:58.980718 31117 leader_election.cc:336] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.696s (SENT)
W20260709 13:09:58.985476 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 138) took 1348 ms (client timeout 1777 ms). Trace:
I20260709 13:09:58.554939 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.006228 30560 pending_rounds.cc:85] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:09:59.006704 30560 pending_rounds.cc:107] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:59.006986 30560 raft_consensus.cc:2889] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.977747 32257 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:58.986035 30406 rpcz_store.cc:269] 0709 13:09:57.637363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.498644 (+861281us) service_pool.cc:224] Handling call
0709 13:09:58.985385 (+486741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.031869 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.048856 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.052647 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1197) took 1791 ms. Trace:
I20260709 13:09:59.053188 30551 rpcz_store.cc:276] 0709 13:09:57.260797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.307634 (+1046837us) service_pool.cc:224] Handling call
0709 13:09:58.308104 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.308537 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.308577 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.310709 (+  2132us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.434395 (+123686us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:58.434436 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.434503 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.052403 (+617900us) raft_consensus.cc:1685] finished
0709 13:09:59.052430 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.052582 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1008,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5551,"thread_start_us":110216,"threads_started":1,"wal-append.queue_time_us":712192}
W20260709 13:09:59.058470 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 132) took 1609 ms (client timeout 1980 ms). Trace:
W20260709 13:09:59.059047 30406 rpcz_store.cc:269] 0709 13:09:57.449105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.038441 (+1589336us) service_pool.cc:224] Handling call
0709 13:09:59.058395 (+ 19954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.071792 32257 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.076221 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.078395 31146 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:59.079471 32070 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:59.081040 32181 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.443s	user 0.011s	sys 0.004s
I20260709 13:09:59.086898 32024 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.088131 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.089066 30551 raft_consensus.cc:2376] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6. Re-sending same reply.
I20260709 13:09:59.091117 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.091784 30406 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
W20260709 13:09:59.092289 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1467) took 2288 ms (client timeout 2733 ms). Trace:
W20260709 13:09:59.092712 30406 rpcz_store.cc:269] 0709 13:09:56.803763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.090826 (+2287063us) service_pool.cc:224] Handling call
0709 13:09:59.092237 (+  1411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.093659 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:59.094331 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 133) took 1645 ms (client timeout 2099 ms). Trace:
W20260709 13:09:59.097394 30408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1191) took 2321 ms (client timeout 1520 ms). Trace:
I20260709 13:09:59.086611 31596 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:59.115132 30408 rpcz_store.cc:269] 0709 13:09:56.775834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.820991 (+ 45157us) service_pool.cc:224] Handling call
0709 13:09:59.097192 (+2276201us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540036db54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.097299 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702832896}
I20260709 13:09:59.116371 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.116556 31596 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.116935 30408 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
W20260709 13:09:59.115031 30406 rpcz_store.cc:269] 0709 13:09:57.449399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.093428 (+1644029us) service_pool.cc:224] Handling call
0709 13:09:59.094273 (+   845us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.118074 30407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1464) took 2444 ms (client timeout 2288 ms). Trace:
W20260709 13:09:59.118539 30408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 126) took 1670 ms (client timeout 2218 ms). Trace:
W20260709 13:09:59.118597 30407 rpcz_store.cc:269] 0709 13:09:56.673337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.415880 (+742543us) service_pool.cc:224] Handling call
0709 13:09:59.117880 (+1702000us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b540012a7d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.118002 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179429248}
I20260709 13:09:59.118573 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:59.123914 30408 rpcz_store.cc:269] 0709 13:09:57.447189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.116116 (+1668927us) service_pool.cc:224] Handling call
0709 13:09:59.117371 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.124866 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.125340 30408 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:59.125694 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 119) took 1909 ms. Trace:
I20260709 13:09:59.125789 30405 raft_consensus.cc:2410] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:59.125943 30408 rpcz_store.cc:276] 0709 13:09:57.215984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.124698 (+1908714us) service_pool.cc:224] Handling call
0709 13:09:59.125657 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.123765 30406 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:59.126863 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:59.127305 30406 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1468) took 2323 ms (client timeout 3025 ms). Trace:
W20260709 13:09:59.127372 30405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 130) took 1678 ms (client timeout 1696 ms). Trace:
W20260709 13:09:59.097560 30556 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.003s
I20260709 13:09:58.436923 32241 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:59.101898 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 483513us
I20260709 13:09:59.113848 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:59.123731 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:59.127689 30406 rpcz_store.cc:269] 0709 13:09:56.804032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.118198 (+2314166us) service_pool.cc:224] Handling call
0709 13:09:59.127253 (+  9055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.127573 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1469) took 2323 ms. Trace:
I20260709 13:09:59.128504 30404 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.129005 30407 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:59.129238 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.129621 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1463) took 2503 ms. Trace:
I20260709 13:09:59.129851 30406 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:59.130008 30407 rpcz_store.cc:276] 0709 13:09:56.625822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.123494 (+2497672us) service_pool.cc:224] Handling call
0709 13:09:59.129571 (+  6077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.130333 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 135) took 1680 ms. Trace:
W20260709 13:09:59.127835 30405 rpcz_store.cc:269] 0709 13:09:57.448519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.623555 (+175036us) service_pool.cc:224] Handling call
0709 13:09:59.127168 (+1503613us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400209c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.127320 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3451359616}
I20260709 13:09:59.130710 30406 rpcz_store.cc:276] 0709 13:09:57.450078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.129028 (+1678950us) service_pool.cc:224] Handling call
0709 13:09:59.130288 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.128106 30556 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
W20260709 13:09:59.132731 30556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 143) took 1505 ms (client timeout 1924 ms). Trace:
I20260709 13:09:59.131950 30405 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:09:59.133095 30556 rpcz_store.cc:269] 0709 13:09:57.627845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.238956 (+611111us) service_pool.cc:224] Handling call
0709 13:09:59.132674 (+893718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.136193 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
W20260709 13:09:59.136852 30404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 140) took 1499 ms (client timeout 1924 ms). Trace:
W20260709 13:09:59.140956 30410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.532s	user 0.026s	sys 0.041s
I20260709 13:09:59.141227 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 141) took 1644 ms. Trace:
W20260709 13:09:59.142925 31117 leader_election.cc:336] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.577s (SENT)
W20260709 13:09:59.141417 30410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.026s	sys 0.041s
I20260709 13:09:59.141697 30560 rpcz_store.cc:276] 0709 13:09:57.496683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.983064 (+1486381us) service_pool.cc:224] Handling call
0709 13:09:58.997182 (+ 14118us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.097785 (+100603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.097831 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.098544 (+   713us) log.cc:844] Serialized 52 byte log entry
0709 13:09:59.106673 (+  8129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:59.106749 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.106844 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.141043 (+ 34199us) raft_consensus.cc:1685] finished
0709 13:09:59.141061 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.141176 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90004,"raft.queue_time_us":91456,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":7665,"threads_started":1,"wal-append.queue_time_us":7510}
I20260709 13:09:59.128943 30408 rpcz_store.cc:276] 0709 13:09:56.804271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.126605 (+2322334us) service_pool.cc:224] Handling call
0709 13:09:59.127526 (+   921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.146109 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:59.147523 31149 raft_consensus.cc:2368] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:09:59.147583 30408 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:09:59.137276 30404 rpcz_store.cc:269] 0709 13:09:57.637878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.113487 (+1475609us) service_pool.cc:224] Handling call
0709 13:09:59.136783 (+ 23296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.148444 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1182) took 2529 ms. Trace:
I20260709 13:09:59.149109 30408 rpcz_store.cc:276] 0709 13:09:56.619044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.145459 (+2526415us) service_pool.cc:224] Handling call
0709 13:09:59.147295 (+  1836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.148212 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.148386 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.159097 31117 leader_election.cc:336] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.783s (SENT)
I20260709 13:09:59.159659 31117 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.161142 32241 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:59.162936 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1183) took 2535 ms. Trace:
I20260709 13:09:59.163479 30451 leader_election.cc:400] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:09:59.164124 30451 leader_election.cc:403] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.164918 32196 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.163980 30404 rpcz_store.cc:276] 0709 13:09:56.636942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.149007 (+2512065us) service_pool.cc:224] Handling call
0709 13:09:59.149298 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.149643 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.149673 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.150124 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.159654 (+  9530us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:59.159694 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.159758 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.162752 (+  2994us) raft_consensus.cc:1685] finished
0709 13:09:59.162769 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.162888 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1105,"thread_start_us":9251,"threads_started":1,"wal-append.queue_time_us":9920}
I20260709 13:09:59.165400 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.166178 31145 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:59.166976 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 142) took 1670 ms. Trace:
I20260709 13:09:59.170130 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1186) took 2496 ms. Trace:
I20260709 13:09:59.170555 30408 rpcz_store.cc:276] 0709 13:09:56.673927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.149957 (+2476030us) service_pool.cc:224] Handling call
0709 13:09:59.150171 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.150336 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:59.151709 (+  1373us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.169746 (+ 18037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.169796 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.169855 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.169945 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.170080 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11868,"raft.queue_time_us":111,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":17402,"threads_started":1,"wal-append.queue_time_us":17724}
I20260709 13:09:59.167467 30558 rpcz_store.cc:276] 0709 13:09:57.496884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.696670 (+1199786us) service_pool.cc:224] Handling call
0709 13:09:58.697178 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.095190 (+398012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.095217 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.095742 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.148277 (+ 52535us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.148310 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.148366 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.166720 (+ 18354us) raft_consensus.cc:1685] finished
0709 13:09:59.166746 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.166908 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397571,"raft.queue_time_us":397692,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":52196,"threads_started":1,"wal-append.queue_time_us":68084}
I20260709 13:09:59.172606 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1181) took 2572 ms. Trace:
I20260709 13:09:59.173481 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1179) took 2582 ms. Trace:
I20260709 13:09:59.174074 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1459) took 2581 ms. Trace:
W20260709 13:09:59.177055 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.178663 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.180493 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.182050 32196 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:09:59.180830 30408 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.183063 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.183312 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1188) took 2438 ms. Trace:
I20260709 13:09:59.183804 30408 rpcz_store.cc:276] 0709 13:09:56.744723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.172388 (+2427665us) service_pool.cc:224] Handling call
0709 13:09:59.180664 (+  8276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.183111 (+  2447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.183265 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.174270 30407 rpcz_store.cc:276] 0709 13:09:56.592623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.138741 (+2546118us) service_pool.cc:224] Handling call
0709 13:09:59.139041 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.139224 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:59.152856 (+ 13632us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.173170 (+ 20314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.173221 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:59.173262 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.173326 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.173428 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":661,"prepare.queue_time_us":10710,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1489,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":32463,"threads_started":2}
I20260709 13:09:59.183655 30560 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.175083 30405 rpcz_store.cc:276] 0709 13:09:56.591456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.131376 (+2539920us) service_pool.cc:224] Handling call
0709 13:09:59.131635 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.131828 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:59.143136 (+ 11308us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.170772 (+ 27636us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.172653 (+  1881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.172696 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.172733 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.172791 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.172908 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10194,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":200,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":182,"thread_start_us":26869,"threads_started":2,"wal-append.queue_time_us":10355}
I20260709 13:09:59.190616 30405 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.191207 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1194) took 2263 ms. Trace:
I20260709 13:09:59.193189 32245 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.200014 30560 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:09:59.191637 30405 rpcz_store.cc:276] 0709 13:09:56.928145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.189782 (+2261637us) service_pool.cc:224] Handling call
0709 13:09:59.190382 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.191020 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.191163 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.202780 30405 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.203540 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1195) took 2271 ms. Trace:
I20260709 13:09:59.201612 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.205180 30560 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.204366 30405 rpcz_store.cc:276] 0709 13:09:56.932263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.202219 (+2269956us) service_pool.cc:224] Handling call
0709 13:09:59.202558 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.203265 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.203466 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.204792 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.212567 32134 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.213001 32196 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:59.213109 32134 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.216950 32134 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.213584 32196 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.217247 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.218323 31147 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.218000 32196 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.228619 30405 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:59.229470 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1197) took 2283 ms. Trace:
I20260709 13:09:59.229861 30405 rpcz_store.cc:276] 0709 13:09:56.946623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.206859 (+2260236us) service_pool.cc:224] Handling call
0709 13:09:59.207174 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.229152 (+ 21978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.229402 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.234412 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.237455 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.245607 30560 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:59.246241 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.247289 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.247555 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.242941 32295 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.248373 30554 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.250311 31596 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.250941 31596 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.253676 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.253942 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.254464 30560 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.244868 32181 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:59.254464 30554 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:59.252835 32295 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.256676 31596 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:59.263276 32287 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 2.587s	user 0.014s	sys 0.019s
I20260709 13:09:59.264899 32295 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.268221 30560 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:59.270870 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.271651 30551 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.271623 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.272630 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.273368 30551 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.269968 32156 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.258107 32181 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.280701 32156 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.281634 32181 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.281721 32156 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:59.286476 30553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1181) took 2138 ms (client timeout 2088 ms). Trace:
W20260709 13:09:59.286968 30553 rpcz_store.cc:269] 0709 13:09:57.147641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.148449 (+   808us) service_pool.cc:224] Handling call
0709 13:09:59.286235 (+2137786us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54003098d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.286376 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638170880}
I20260709 13:09:59.288672 32156 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.292593 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.293478 30552 raft_consensus.cc:2410] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:59.294647 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.304451 32156 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.305306 32156 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.305933 32156 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.310915 30552 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:59.311420 30552 pending_rounds.cc:85] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 1
I20260709 13:09:59.303249 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.311707 30552 pending_rounds.cc:107] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:59.311987 30551 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:09:59.312055 30552 raft_consensus.cc:2889] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.316659 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1171) took 2785 ms. Trace:
I20260709 13:09:59.317195 30410 rpcz_store.cc:276] 0709 13:09:56.527988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.528100 (+   112us) service_pool.cc:224] Handling call
0709 13:09:57.606974 (+1078874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.607468 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.607512 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.608113 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.144226 (+1536113us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:59.144282 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.144380 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.144444 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:59.144462 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.308614 (+164152us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400208d50. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.313345 (+  4731us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11332,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":2325717248,"thread_start_us":1535652,"threads_started":1,"wal-append.queue_time_us":799758}
W20260709 13:09:59.320858 31117 leader_election.cc:336] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.777s (SENT)
I20260709 13:09:59.321316 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.323273 30410 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.323393 32189 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.323809 32196 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:59.324012 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1200) took 2297 ms. Trace:
I20260709 13:09:59.324329 30410 rpcz_store.cc:276] 0709 13:09:57.026453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.319292 (+2292839us) service_pool.cc:224] Handling call
0709 13:09:59.323060 (+  3768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.323767 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.323960 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.324349 32196 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.325692 30410 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:59.326203 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 115) took 2245 ms. Trace:
I20260709 13:09:59.326472 30410 rpcz_store.cc:276] 0709 13:09:57.080550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.325143 (+2244593us) service_pool.cc:224] Handling call
0709 13:09:59.325415 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.326001 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.326160 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.343196 30525 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.345517 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1187) took 2630 ms. Trace:
I20260709 13:09:59.330396 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.346217 30404 rpcz_store.cc:276] 0709 13:09:56.715684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.165610 (+2449926us) service_pool.cc:224] Handling call
0709 13:09:59.165880 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.166063 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:59.166341 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.345082 (+178741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.345155 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:59.345213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.345304 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.345456 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":881,"prepare.queue_time_us":6208,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"thread_start_us":177784,"threads_started":1}
I20260709 13:09:59.390276 30404 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.391175 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 121) took 2102 ms. Trace:
I20260709 13:09:59.391574 30404 rpcz_store.cc:276] 0709 13:09:57.289277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.389302 (+2100025us) service_pool.cc:224] Handling call
0709 13:09:59.390052 (+   750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.390821 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.391103 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.393687 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 123) took 2037 ms. Trace:
I20260709 13:09:59.394084 30404 rpcz_store.cc:276] 0709 13:09:57.356661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.392544 (+2035883us) service_pool.cc:224] Handling call
0709 13:09:59.393041 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.393264 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.393300 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.393357 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.393400 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.393472 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.393612 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.396553 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1198) took 2449 ms. Trace:
I20260709 13:09:59.397692 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1471) took 2592 ms. Trace:
I20260709 13:09:59.326517 32196 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.397786 30410 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.404397 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 116) took 2269 ms. Trace:
I20260709 13:09:59.404760 30410 rpcz_store.cc:276] 0709 13:09:57.134579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.344156 (+2209577us) service_pool.cc:224] Handling call
0709 13:09:59.397596 (+ 53440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.404155 (+  6559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.404343 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.332414 32177 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.398461 30408 rpcz_store.cc:276] 0709 13:09:56.804779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.184575 (+2379796us) service_pool.cc:224] Handling call
0709 13:09:59.184803 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.184980 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:59.190392 (+  5412us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.396825 (+206433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.397312 (+   487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.397373 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.397467 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.397620 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3861,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":39,"raft.queue_time_us":20691,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":15635,"thread_start_us":206062,"threads_started":2,"wal-append.queue_time_us":70278}
I20260709 13:09:59.337411 31785 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:09:59.411938 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 102070us
I20260709 13:09:59.409293 31145 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:59.407436 30525 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d180da17ba548e0ab1ebdfa7dfc1f0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.412716 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.389053 32247 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.401115 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1472) took 2596 ms. Trace:
I20260709 13:09:59.414898 32247 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.416813 32247 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.414170 30407 rpcz_store.cc:276] 0709 13:09:56.805087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.188790 (+2383703us) service_pool.cc:224] Handling call
0709 13:09:59.189812 (+  1022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.190786 (+   974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.190817 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.191207 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.237761 (+ 46554us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.250913 (+ 13152us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.400805 (+149892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.400887 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.400933 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:59.400947 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.401059 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6502,"prepare.queue_time_us":14872,"raft.queue_time_us":17422,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3798,"spinlock_wait_cycles":2601344,"thread_start_us":195605,"threads_started":2,"wal-append.queue_time_us":57607}
I20260709 13:09:59.420200 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.421280 32177 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:59.429406 30376 leader_election.cc:336] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Timed out: RequestConsensusVote RPC to 127.28.152.4:39627 timed out after 1.654s (SENT)
I20260709 13:09:59.430075 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.432802 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 161) took 1932 ms. Trace:
I20260709 13:09:59.433255 31150 rpcz_store.cc:276] 0709 13:09:57.500774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.500965 (+   191us) service_pool.cc:224] Handling call
0709 13:09:59.431963 (+1930998us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84e9c 00007fa041f84a5b 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:59.432159 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.432393 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.432431 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.432477 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.432511 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.432592 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.432739 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5988864}
I20260709 13:09:59.419265 32170 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.435940 32177 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:59.436070 32367 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:59.437214 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:59.437177 32177 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.415623 31785 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.456434 32073 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.457571 32073 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.466616 32156 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.469156 32156 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.471719 32247 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.472642 30404 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:59.473224 32312 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.473676 32312 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.474016 32247 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.449394 32275 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.443203 32367 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:59.485090 32367 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:59.533934 30374 connection.cc:256] RPC call timeout handler was delayed by -1.38561890699998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:09:59.534435 30374 connection.cc:256] RPC call timeout handler was delayed by -1.3622189070000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:09:59.534765 30374 connection.cc:256] RPC call timeout handler was delayed by -1.2110189070000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:09:59.535079 30374 connection.cc:256] RPC call timeout handler was delayed by -1.195718907000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:09:59.535367 30374 connection.cc:256] RPC call timeout handler was delayed by -1.099418906999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:09:59.535643 30374 connection.cc:256] RPC call timeout handler was delayed by -1.0769189070000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:09:59.535892 30374 connection.cc:256] RPC call timeout handler was delayed by -1.074218907000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:09:59.535979 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1178) took 3004 ms. Trace:
W20260709 13:09:59.536931 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.537490 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.536355 30403 rpcz_store.cc:276] 0709 13:09:56.531216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.533853 (+  2637us) service_pool.cc:224] Handling call
0709 13:09:56.599397 (+ 65544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.893394 (+293997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.893438 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.893494 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:56.893549 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.535733 (+2642184us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400267354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:59.535781 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.535922 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675512064}
W20260709 13:09:59.542207 30555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1176) took 2396 ms (client timeout 1809 ms). Trace:
W20260709 13:09:59.542606 30555 rpcz_store.cc:269] 0709 13:09:57.146041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.146184 (+   143us) service_pool.cc:224] Handling call
0709 13:09:59.542037 (+2395853us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003f3c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.542138 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296759680}
I20260709 13:09:59.547247 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.548659 32371 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.548745 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:59.549664 32370 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.550083 32370 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.550423 32370 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.559067 32370 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.561929 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.563426 30374 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.565461 32372 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.565845 32372 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.566126 32372 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.562428 32371 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.567025 32371 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:09:59.568459 30411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1177) took 3037 ms (client timeout 2024 ms). Trace:
W20260709 13:09:59.568807 30411 rpcz_store.cc:269] 0709 13:09:56.530825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.530964 (+   139us) service_pool.cc:224] Handling call
0709 13:09:59.568306 (+3037342us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54002a58d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.568406 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079106304}
I20260709 13:09:59.569844 32371 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.570387 32371 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:59.570827 32371 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:09:59.571349 32369 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:09:59.571739 32371 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.562556 32370 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.575547 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.576280 30478 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:09:59.577227 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.577298 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:59.578302 30410 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.578931 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.581470 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.582662 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:59.583016 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:09:59.583798 30408 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.584147 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.585134 30407 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.586066 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.576301 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.588310 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.588791 30403 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:09:59.589074 32379 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.589520 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.590248 30403 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 2.
I20260709 13:09:59.591353 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.592376 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:09:59.594537 30450 connection.cc:256] RPC call timeout handler was delayed by -2.5488795849998951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:09:59.594769 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:09:59.595027 30450 connection.cc:256] RPC call timeout handler was delayed by -2.5056795849999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:09:59.595419 30410 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:09:59.595517 30450 connection.cc:256] RPC call timeout handler was delayed by -2.4388701459998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:09:59.595876 30450 connection.cc:256] RPC call timeout handler was delayed by -2.3840541809998967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:09:59.586771 30407 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:59.574810 32372 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:09:59.596235 30450 connection.cc:256] RPC call timeout handler was delayed by -2.3319795849998854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:09:59.599851 30450 connection.cc:256] RPC call timeout handler was delayed by -2.2473795849998623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:09:59.600219 30450 connection.cc:256] RPC call timeout handler was delayed by -2.1764420259999042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260709 13:09:59.600538 30450 connection.cc:256] RPC call timeout handler was delayed by -2.1384795849999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:09:59.600839 30450 connection.cc:256] RPC call timeout handler was delayed by -2.1168589719999318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:09:59.601164 30450 connection.cc:256] RPC call timeout handler was delayed by -2.1077541809999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:09:59.602099 30411 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.589524 32379 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.605823 32372 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:59.602252 30450 connection.cc:256] RPC call timeout handler was delayed by -2.057743094999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:09:59.606359 30450 connection.cc:256] RPC call timeout handler was delayed by -2.0294541809998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:09:59.606755 30450 connection.cc:256] RPC call timeout handler was delayed by -1.9739420259999179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:09:59.607080 30450 connection.cc:256] RPC call timeout handler was delayed by -1.3032592710000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 13:09:59.607555 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.607730 30478 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:59.607968 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:59.608229 30483 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.608614 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.609311 30478 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.609570 32379 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.610020 32379 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.610491 32379 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.609123 30450 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.613606 32379 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.615621 30483 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:59.615716 32379 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.616403 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.616307 32379 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.616956 30483 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:09:59.617651 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.618053 30483 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.618333 32379 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.610030 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.619524 30478 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.619354 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.620332 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.620587 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.620945 30478 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:59.622653 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.623641 30483 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:59.624186 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:59.624393 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.625075 32379 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.625366 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.625661 32381 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.626116 30483 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:59.626237 32381 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:59.626641 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:59.626789 32381 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.627060 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.627790 30483 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.628535 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.629489 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.630154 30483 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.630877 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:59.615751 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.631505 30483 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.632345 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.632681 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.632946 30555 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:59.633425 30559 raft_consensus.cc:2368] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:09:59.634234 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.634622 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.635067 30483 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:59.636538 32191 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.636969 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.636572 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.638818 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.638985 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.637954 30551 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.639317 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:59.631203 30485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1480) took 3097 ms (client timeout 1905 ms). Trace:
I20260709 13:09:59.640019 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:09:59.640525 30485 rpcz_store.cc:269] 0709 13:09:56.534223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.592001 (+ 57778us) service_pool.cc:224] Handling call
0709 13:09:59.631023 (+3039022us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400360454. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:09:59.631120 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485288320}
I20260709 13:09:59.640028 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.640097 32381 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.642917 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.644022 30559 raft_consensus.cc:2368] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4.
I20260709 13:09:59.644979 32381 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.645701 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.646359 30551 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:59.638563 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.646924 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.647176 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.647789 30551 raft_consensus.cc:2368] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:59.647934 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.648559 30559 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.645627 32381 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.649210 32381 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.649523 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.650882 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:59.601406 30408 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:09:59.653496 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.653936 32159 raft_consensus.cc:2764] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:59.654280 32371 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.654791 32371 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:09:59.655009 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.655566 30551 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.655776 32371 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.656219 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.662181 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.662928 30559 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.663632 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.665153 32372 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:59.665669 32372 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:09:59.666132 32372 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.667244 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.668026 30559 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.669946 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1361) took 3700 ms. Trace:
I20260709 13:09:59.671660 32275 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.672065 32275 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:59.670383 30557 rpcz_store.cc:276] 0709 13:09:55.969348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.975630 (+  6282us) service_pool.cc:224] Handling call
0709 13:09:56.616413 (+640783us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:09:56.616649 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.056433 (+439784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.077121 (+ 20688us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.158335 (+ 81214us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.296283 (+137948us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:57.300467 (+  4184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.669601 (+2369134us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003093d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:59.669652 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.669698 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:59.669713 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.669864 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23536,"raft.queue_time_us":3340,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":23389,"spinlock_wait_cycles":958021376,"thread_start_us":76149,"threads_started":1,"wal-append.queue_time_us":174561,"wal-append.run_cpu_time_us":2635,"wal-append.run_wall_time_us":1177838}
I20260709 13:09:59.672423 32275 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.673115 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.639343 30555 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.676381 30551 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:59.676648 32024 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.677207 32024 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.678021 32024 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.679136 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.637202 32191 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:59.685367 30555 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.686851 30558 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.682889 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.688190 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.688649 30483 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:59.688920 30558 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 1.
I20260709 13:09:59.689934 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.689960 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.691435 30483 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.691622 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.692571 30558 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 2.
I20260709 13:09:59.693574 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.679766 30559 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:09:59.681267 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.695828 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.696390 30559 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.695209 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.697477 30558 raft_consensus.cc:2368] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:59.697999 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.700986 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.701691 30552 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.703749 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.703868 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.704440 30558 raft_consensus.cc:2368] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4.
I20260709 13:09:59.704900 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.705176 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.705590 30552 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.701167 32371 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.706328 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.707404 30552 raft_consensus.cc:2376] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5. Re-sending same reply.
I20260709 13:09:59.707752 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:09:59.707512 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 80946.8us
I20260709 13:09:59.708396 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.706637 32371 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.707186 30558 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.709061 30552 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.709059 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.712006 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.712998 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.713917 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.714169 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.714665 30558 raft_consensus.cc:2368] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:09:59.715586 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.715806 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:59.716747 32381 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.717005 32259 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.707813 32372 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.717263 32381 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.717533 32382 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.717856 32381 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.718379 32382 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:59.722277 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.721340 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.721769 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.724566 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.725399 32384 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:59.726363 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.726819 32384 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:59.727011 30483 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:09:59.727557 32384 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.714665 32371 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.728479 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.730523 30483 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.728338 32275 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.737200 32380 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:59.739045 32275 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.739835 32275 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.741420 32275 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.722491 32372 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.722569 32382 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.745951 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:59.747630 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.747850 30482 raft_consensus.cc:2376] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6. Re-sending same reply.
I20260709 13:09:59.748749 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:59.750739 32301 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.751230 32301 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.754130 30523 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.755571 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.757084 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.757893 32384 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.759570 30483 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:09:59.760617 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.760705 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.761400 32301 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.762148 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.763975 32381 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.764599 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 139) took 2127 ms. Trace:
I20260709 13:09:59.770243 30404 rpcz_store.cc:276] 0709 13:09:57.637632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.399255 (+1761623us) service_pool.cc:224] Handling call
0709 13:09:59.399642 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.473049 (+ 73407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.764382 (+291333us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54001207d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:59.764544 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167152000}
I20260709 13:09:59.760825 32371 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.765051 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:09:59.765201 30524 connection.cc:256] RPC call timeout handler was delayed by -2.8609189459999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2606s for a response
I20260709 13:09:59.771955 32301 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.773882 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:09:59.774078 30524 connection.cc:256] RPC call timeout handler was delayed by -2.831287145000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33330000000000004s for a response
I20260709 13:09:59.775409 30483 raft_consensus.cc:2368] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:59.775913 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.774649 32301 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:59.777271 32301 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.779342 30482 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:09:59.780287 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.780474 30450 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.781111 32259 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.787576 32301 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.781807 32379 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.779228 32384 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.795107 32394 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.795881 32394 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.796077 32392 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.796375 32394 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:09:59.796550 32392 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.797017 32392 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.797335 32394 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.799213 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.799649 32301 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.799969 30557 raft_consensus.cc:2368] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:09:59.800230 32301 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.800663 32301 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:09:59.801127 32301 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.781576 32383 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:59.785422 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 63715.3us
I20260709 13:09:59.786293 32381 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.787058 32371 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.789068 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.808909 30485 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.809628 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.810269 30485 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:59.782028 32107 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.803781 30450 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.806028 32372 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.820731 32372 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.822901 32372 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:09:59.807765 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.823180 32379 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.808094 32393 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.824246 32393 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.826511 32393 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.830506 32392 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.833810 32392 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:59.835779 32392 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.837105 32392 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.819903 30482 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.823541 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.840131 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:09:59.840620 32392 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:09:59.841378 32269 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:59.823648 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.841794 32269 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.842142 32269 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:59.808254 30524 connection.cc:256] RPC call timeout handler was delayed by -2.4145773829999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:09:59.841248 30450 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:09:59.842515 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:09:59.842839 30524 connection.cc:256] RPC call timeout handler was delayed by -1.9924773829999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:09:59.843170 32384 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:59.843355 30524 connection.cc:256] RPC call timeout handler was delayed by -1.8223773829998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2288s for a response
W20260709 13:09:59.843735 30524 connection.cc:256] RPC call timeout handler was delayed by -1.7747303029999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:09:59.844010 30524 connection.cc:256] RPC call timeout handler was delayed by -1.757577382999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.236s for a response
I20260709 13:09:59.844159 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:09:59.844475 30524 connection.cc:256] RPC call timeout handler was delayed by -1.7090303029999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:09:59.843920 32384 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:59.844761 30524 connection.cc:256] RPC call timeout handler was delayed by -1.6577303029999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:09:59.844972 32384 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:59.845175 30524 connection.cc:256] RPC call timeout handler was delayed by -1.6050323399999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24860000000000004s for a response
I20260709 13:09:59.845404 32384 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:59.845515 30524 connection.cc:256] RPC call timeout handler was delayed by -1.4615303029999041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:09:59.819386 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.844777 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:09:59.846520 30485 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.847152 32371 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.847697 32371 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.848042 32371 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.848129 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.848626 32107 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.849036 32107 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.849380 32107 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:59.854206 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 416790us
I20260709 13:09:59.856398 32107 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.857312 32384 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.846607 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.847098 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.849335 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:59.845927 30524 connection.cc:256] RPC call timeout handler was delayed by -1.4218773829999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27330000000000004s for a response
I20260709 13:09:59.859292 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.859511 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:09:59.859768 30524 connection.cc:256] RPC call timeout handler was delayed by -1.2041303029999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 13:09:59.859956 30485 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:59.860129 30524 connection.cc:256] RPC call timeout handler was delayed by -1.1199323399999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3025s for a response
I20260709 13:09:59.861302 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.861912 32125 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.862177 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.856429 32104 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:59.862953 32177 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.867812 32177 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:09:59.867839 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.868335 32177 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.868925 30552 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.870090 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.871280 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.874928 32394 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.876957 30556 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.880110 32156 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.875607 32371 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.860111 30482 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.868957 32384 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.883735 32177 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.885532 32370 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:59.886977 32371 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.173046 30406 rpcz_store.cc:276] 0709 13:09:56.600122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.131496 (+2531374us) service_pool.cc:224] Handling call
0709 13:09:59.131767 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.131939 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:59.149406 (+ 17467us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.172303 (+ 22897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.172353 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.172397 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.172455 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.172555 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6682,"prepare.queue_time_us":17500,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":807,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":666,"spinlock_wait_cycles":1760256,"thread_start_us":38717,"threads_started":2,"wal-append.queue_time_us":21496}
I20260709 13:09:59.887895 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:09:59.888099 32384 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:59.888607 32384 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.888975 32384 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.892463 30555 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.894657 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.895058 30555 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.895314 31146 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:09:59.897008 32156 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.898921 31147 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:59.901983 32189 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:59.886861 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.903390 32373 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.866968 30485 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:09:59.904134 32374 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:59.904609 32374 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:09:59.905553 32374 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.907292 32373 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:59.907619 32181 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:59.888013 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.908160 32181 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.908586 32181 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.908744 32170 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:59.909286 32170 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:09:59.910087 32170 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.912546 32134 raft_consensus.cc:1064] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:09:59.913086 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.908073 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.914062 30485 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.914577 32134 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.915320 30376 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.916078 32267 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.917230 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.917968 32267 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:59.397540 30405 rpcz_store.cc:276] 0709 13:09:56.946993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.230767 (+2283774us) service_pool.cc:224] Handling call
0709 13:09:59.231131 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.231357 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:59.243945 (+ 12588us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.396186 (+152241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.396237 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:59.396280 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.396353 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.396499 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19334,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1142,"thread_start_us":151855,"threads_started":1}
I20260709 13:09:59.918325 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:59.919222 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.919333 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.864276 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.920195 32257 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:59.907886 32373 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:09:59.920507 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.920559 32257 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:09:59.914196 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.921093 32257 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.921557 30480 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.922518 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.923370 30480 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 3: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:09:59.923731 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:09:59.924172 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.924481 30481 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:09:59.925364 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.925514 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.926043 30482 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:59.926474 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.927521 30481 raft_consensus.cc:2376] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5. Re-sending same reply.
I20260709 13:09:59.928280 32257 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.928833 30481 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.930121 30481 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.930401 32257 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:59.985186 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 66016.9us
I20260709 13:09:59.933545 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.934305 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:59.935083 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:09:59.935429 32374 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.936450 32373 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.928802 30482 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.994417 32373 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:59.938555 30480 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:59.938671 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:09:59.997423 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:09:59.997722 31149 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:09:59.936870 32269 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:09:59.941475 32181 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.941669 32382 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.002767 32269 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:00.003275 32382 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.005945 32159 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.883773 32107 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:00.006491 32159 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:09:59.943526 32398 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:59.946233 32241 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:00.007248 32241 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:00.008113 32241 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.009086 30480 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:00.009315 32241 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.010289 30480 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:59.952805 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:00.011269 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 58602.8us
I20260709 13:10:00.012101 32181 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:00.012611 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:09:59.956308 32073 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:00.015192 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:09:59.958572 32370 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.961328 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1176) took 3430 ms. Trace:
I20260709 13:09:59.963863 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:00.114281 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 150531us
I20260709 13:09:59.964939 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.116231 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.117224 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.117846 30405 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:09:59.967455 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:09:59.973749 32301 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:00.118654 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 151298us
I20260709 13:09:59.975968 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.118710 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.121912 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:09:59.976958 32254 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:59.978487 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.979485 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.123641 30408 raft_consensus.cc:2410] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:59.979583 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.979825 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.124050 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.124250 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:00.124097 30483 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:00.125336 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.125875 30483 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:59.980577 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.981905 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:00.126678 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 150812us
I20260709 13:09:59.981539 32384 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:09:59.983609 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.986124 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:09:59.986259 32177 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:09:59.931835 30481 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.987257 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:00.130653 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.986215 30485 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:00.131244 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.998868 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.001271 31147 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:09:59.992569 31785 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:09:59.942915 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78738.5us
I20260709 13:09:59.957940 32312 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:09:59.980540 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:09:59.981200 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.138415 30404 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.124356 30407 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:00.113250 32047 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.119293 32073 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:00.178746 32073 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.131418 30405 raft_consensus.cc:2368] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:00.001362 32104 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.132248 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.191790 30411 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:00.130744 32295 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.131445 30555 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:00.133104 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.118289 32394 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:00.135118 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:00.135866 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 137301us
I20260709 13:10:00.259614 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.129914 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.259934 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.261217 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.112994 32247 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:00.140401 30558 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.130189 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.118443 32263 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:10:00.141796 32261 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:00.260022 30376 leader_election.cc:400] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:10:00.271543 30376 leader_election.cc:403] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.140559 32367 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:00.272475 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.273655 30376 leader_election.cc:400] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4.
I20260709 13:10:00.273586 32367 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:00.135082 32371 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.177642 32384 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:00.146127 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.275002 32312 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:00.275682 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.275822 30407 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:00.169579 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.129837 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:00.277235 32312 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:00.277899 32312 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:00.278107 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.277603 32371 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:00.278810 32312 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.279259 32371 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.122673 32156 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:00.246392 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 262356us
W20260709 13:10:00.277149 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 147365us
I20260709 13:10:00.284946 31596 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.285313 30374 leader_election.cc:400] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:10:00.285398 31596 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.287420 31596 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:00.288228 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:00.288275 32372 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:00.289075 31147 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:00.290907 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:00.291644 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.294550 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:00.291728 32372 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:00.295886 32390 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.296298 32390 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.296662 32390 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.296722 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:00.297523 30555 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:00.296299 32372 consensus_queue.cc:1243] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:00.304247 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.169157 32403 ts_tablet_manager.cc:933] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:00.314183 30406 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:00.316206 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.141628 32370 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.329205 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.320011 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1402) took 3456 ms. Trace:
I20260709 13:10:00.340490 30484 rpcz_store.cc:276] 0709 13:09:56.814269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.045071 (+230802us) service_pool.cc:224] Handling call
0709 13:09:59.844662 (+2799591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.845013 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.845043 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.845508 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.866868 (+ 21360us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:59.866907 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.866980 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.007818 (+140838us) raft_consensus.cc:1685] finished
0709 13:10:00.007841 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.189533 (+181692us) spinlock_profiling.cc:243] Waited 2.8 s on lock 0x7b5400360450. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:00.270955 (+ 81422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":972,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":6437800832,"thread_start_us":21013,"threads_started":1,"wal-append.queue_time_us":14416}
I20260709 13:10:00.337517 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.134204 31951 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:00.187659 32315 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:00.351912 30404 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:00.353381 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.170783 32047 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:00.357002 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:00.122504 32181 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.371652 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:00.373196 30555 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:00.264601 32104 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:00.378100 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 248539us
W20260709 13:10:00.379472 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 244452us
I20260709 13:10:00.391098 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:00.305405 32261 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.382534 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.391734 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.392261 30406 raft_consensus.cc:2376] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6. Re-sending same reply.
I20260709 13:10:00.392441 30559 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:00.387820 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91260.7us
I20260709 13:10:00.339905 32125 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:00.393612 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:00.397569 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:00.400022 30559 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:00.357914 32315 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.402582 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:00.405417 30408 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:00.374230 32295 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.410745 31149 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:00.407621 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:00.420276 30559 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:00.390377 32245 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3.
I20260709 13:10:00.394613 32392 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:00.396699 32104 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.414007 30556 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:00.396413 32261 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.113911 30409 rpcz_store.cc:276] 0709 13:09:56.530421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.532749 (+  2328us) service_pool.cc:224] Handling call
0709 13:09:56.606870 (+ 74121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.798922 (+192052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.798956 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.799013 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:56.799051 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.960992 (+3161941us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002f58d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:09:59.961061 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.961227 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441152896}
I20260709 13:10:00.399331 32125 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:00.397991 32247 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:00.406173 32370 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:00.435154 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.403031 32181 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:00.424799 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.411266 32315 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.434283 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:00.458825 30552 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:00.441562 32405 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:00.442013 30553 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:00.433477 32372 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:10:00.399379 31785 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:00.462990 31149 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 3 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:00.455814 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:00.493384 30559 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:00.427884 32392 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:00.499275 32247 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.500422 32392 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.501708 32392 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.501804 32267 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:00.502195 32267 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:00.495780 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08001c76a0 after lost signal to thread 29283
W20260709 13:10:00.505436 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.497184 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:00.489162 32394 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.507061 32181 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.507792 32394 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:00.509768 32267 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.511016 32267 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.492213 31144 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:00.490432 31785 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.513033 31785 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:00.488948 32370 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:00.517319 32370 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.424136 32295 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.524868 30553 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:00.468274 31146 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:00.532938 30552 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:00.524598 32295 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:00.522349 32390 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:00.549903 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 158230us
I20260709 13:10:00.488255 32047 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.540227 32301 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:00.551700 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:00.555176 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 426781us
I20260709 13:10:00.555299 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.555477 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.557037 30411 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:10:00.558844 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 156963us
I20260709 13:10:00.561630 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.563153 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.564332 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.563812 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:00.565158 30406 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:00.566161 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:00.568011 30404 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:00.569113 30411 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:00.572711 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.575282 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.537881 32125 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.583089 30406 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:00.595063 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:00.570240 32301 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.575886 32394 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:00.595991 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:00.625905 32104 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:00.627230 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.627848 30409 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:00.635968 32405 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:00.578147 32025 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.636982 32025 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:00.567744 32374 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:00.638512 30486 raft_consensus.cc:2410] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:00.570070 32406 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:00.726118 30405 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:00.742084 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.952108 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.776131 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:00.776984 30403 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:00.816598 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.896579 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.903635 32104 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.010105 31116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.673s (SENT) [suppressed 53 similar messages]
I20260709 13:10:00.905016 32337 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:01.153818 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.182763 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 606643us
I20260709 13:10:01.183466 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.184296 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:01.185973 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.159133 32403 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.001s	sys 0.012s
W20260709 13:10:01.192318 32403 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.001s	sys 0.012s
I20260709 13:10:01.156932 30403 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:01.193154 32403 tablet_copy_client.cc:323] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
W20260709 13:10:01.196524 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 630425us
W20260709 13:10:01.197187 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 187079us
I20260709 13:10:01.197495 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:00.827529 31785 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:01.242908 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 602223us
W20260709 13:10:01.245117 30483 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.000s	sys 0.026s
W20260709 13:10:01.245560 30483 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.000s	sys 0.027s
W20260709 13:10:01.270253 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.239285 32125 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.194469 32156 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:01.232832 32134 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:01.277304 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 93981.8us
I20260709 13:10:01.256491 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.185320 32390 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:01.240435 32104 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.281893 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:01.273447 32267 consensus_meta.cc:287] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.001s
W20260709 13:10:01.308889 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52546.2us
I20260709 13:10:01.310276 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.195199 32337 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.254051 31785 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:01.312779 30403 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:01.273253 32411 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:01.346728 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 64885.2us
W20260709 13:10:01.279420 32370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.008s	sys 0.021s
I20260709 13:10:01.281021 32134 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.281618 32367 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.310580 30481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.011s	sys 0.019s
W20260709 13:10:01.331662 32241 consensus_meta.cc:287] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 1.322s	user 0.015s	sys 0.000s
W20260709 13:10:01.343636 32261 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.899s	user 0.010s	sys 0.003s
I20260709 13:10:01.281545 32189 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.309053 32156 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:01.331390 32073 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.311117 32104 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.362011 32412 raft_consensus.cc:2764] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:01.373210 32104 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.363597 32134 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.368382 32261 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.366549 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.375458 32261 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:01.311358 32295 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:01.376080 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.359815 32254 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.370924 32073 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:01.376745 32402 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.874s	user 0.005s	sys 0.008s
W20260709 13:10:01.375556 32407 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.879s	user 0.014s	sys 0.000s
I20260709 13:10:01.361593 31785 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.384284 32415 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.376727 32189 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.383682 32254 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.382964 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:01.399334 31149 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.396833 32384 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.397866 32414 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.493s	user 0.007s	sys 0.012s
I20260709 13:10:01.376433 32295 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:10:01.363041 32370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.012s	sys 0.038s
I20260709 13:10:01.366046 32367 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:01.396759 32392 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.895s	user 0.015s	sys 0.000s
I20260709 13:10:01.424263 32295 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.414750 32384 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.433507 32384 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.437976 32315 consensus_meta.cc:287] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.002s
I20260709 13:10:01.426175 32337 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:01.425304 32424 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:01.445696 32254 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.445370 32159 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.440428 32189 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:01.441982 32315 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:01.447611 32420 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:01.449736 32367 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.485504 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 125575us
I20260709 13:10:01.446985 32159 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.528882 32437 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.531003 32437 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.534252 32437 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.367324 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa1e0 after lost signal to thread 30343
W20260709 13:10:01.560467 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa1a0 after lost signal to thread 30357
W20260709 13:10:01.540529 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.542037 31144 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:01.543444 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 107) took 4920 ms. Trace:
I20260709 13:10:01.534415 32181 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:10:01.545092 32254 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:01.547288 32073 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.547094 32267 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.547887 32337 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:01.552886 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 242495us
W20260709 13:10:01.364213 30481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.011s	sys 0.020s
W20260709 13:10:01.562678 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08003640e0 after lost signal to thread 30435
I20260709 13:10:01.564380 30479 rpcz_store.cc:276] 0709 13:09:56.622897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.013811 (+390914us) service_pool.cc:224] Handling call
0709 13:09:57.036230 (+ 22419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.036553 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.036583 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.523916 (+3487333us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b2c00010828. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:00.524265 (+   349us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.840735 (+316470us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.840779 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.840908 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.542535 (+701627us) raft_consensus.cc:1685] finished
0709 13:10:01.542586 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.543191 (+   605us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5607,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3279,"spinlock_wait_cycles":4775808,"thread_start_us":316078,"threads_started":1,"wal-append.queue_time_us":755134}
I20260709 13:10:01.590307 32254 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:10:01.591084 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 393495us
I20260709 13:10:01.593636 32254 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.594985 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 120) took 1091 ms. Trace:
I20260709 13:10:01.595566 30481 rpcz_store.cc:276] 0709 13:10:00.503060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.503222 (+   162us) service_pool.cc:224] Handling call
0709 13:10:00.503591 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.503959 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.503990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.504468 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.594164 (+1089696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:01.594290 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.594446 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.594535 (+    89us) raft_consensus.cc:1685] finished
0709 13:10:01.594545 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.594760 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2206,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":75,"thread_start_us":1068514,"threads_started":1,"wal-append.queue_time_us":882023}
I20260709 13:10:01.599140 30305 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 100) took 10075 ms. Trace:
I20260709 13:10:01.599222 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:01.599506 32337 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.600428 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43936 (request call id 286) took 1062 ms. Trace:
I20260709 13:10:01.600950 31150 rpcz_store.cc:276] 0709 13:10:00.538515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.538711 (+   196us) service_pool.cc:224] Handling call
0709 13:10:01.598755 (+1060044us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:01.600297 (+  1542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8368512}
I20260709 13:10:01.602324 32337 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.634409 30486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 117) took 2094 ms (client timeout 2126 ms). Trace:
W20260709 13:10:01.634969 30486 rpcz_store.cc:269] 0709 13:09:59.540125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.919116 (+378991us) service_pool.cc:224] Handling call
0709 13:10:01.633843 (+1714727us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54003449d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.634153 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651882752}
I20260709 13:10:01.618551 32025 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:01.602854 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1217) took 1047 ms. Trace:
I20260709 13:10:01.603449 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:01.603880 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:01.607818 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.610028 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1230) took 1033 ms. Trace:
I20260709 13:10:01.553315 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.611608 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1499) took 1450 ms. Trace:
I20260709 13:10:01.612591 30407 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:01.613209 32315 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:01.613960 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1229) took 1054 ms. Trace:
W20260709 13:10:01.615934 30432 debug-util.cc:398] Leaking SignalData structure 0x7b0800329b80 after lost signal to thread 30510
I20260709 13:10:01.619750 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 119) took 1718 ms. Trace:
W20260709 13:10:01.618412 31117 connection.cc:256] RPC call timeout handler was delayed by -1.094844106000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 13:10:01.599767 30305 rpcz_store.cc:276] 0709 13:09:51.523494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.523797 (+   303us) service_pool.cc:224] Handling call
0709 13:10:01.598823 (+10075026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:57.001858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:57.180489 (+178631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:57.182100 (+  1611us) write_op.cc:435] Acquired schema lock
0709 13:09:57.185571 (+  3471us) tablet.cc:662] Decoding operations
0709 13:09:57.276180 (+ 90609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:57.276262 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:57.276298 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:57.276977 (+   679us) tablet.cc:701] Row locks acquired
0709 13:09:57.277009 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:09:57.277159 (+   150us) write_op.cc:270] Start()
0709 13:09:57.277271 (+   112us) write_op.cc:276] Timestamp: P: 1783602597277114 usec, L: 0
0709 13:09:57.277296 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:57.307727 (+ 30431us) log.cc:844] Serialized 3193 byte log entry
0709 13:09:57.486228 (+178501us) op_driver.cc:464] REPLICATION: finished
0709 13:09:58.312442 (+826214us) write_op.cc:301] APPLY: starting
0709 13:09:58.312549 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:58.312804 (+   255us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:58.312982 (+   178us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:58.339497 (+ 26515us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:58.373670 (+ 34173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:09:58.383236 (+  9566us) write_op.cc:312] APPLY: finished
0709 13:09:58.400965 (+ 17729us) log.cc:844] Serialized 64 byte log entry
0709 13:09:58.405124 (+  4159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.412045 (+  6921us) write_op.cc:454] Released schema lock
0709 13:09:58.414581 (+  2536us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:58.424555 (+  9974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.425298 (+   743us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":985380,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":823796,"apply.run_cpu_time_us":4424,"apply.run_wall_time_us":108876,"num_ops":8,"prepare.queue_time_us":772948,"prepare.run_cpu_time_us":13188,"prepare.run_wall_time_us":434218,"raft.queue_time_us":59043,"raft.run_cpu_time_us":71477,"raft.run_wall_time_us":803761,"replication_time_us":186108,"thread_start_us":1392611,"threads_started":4,"wal-append.queue_time_us":58874,"wal-append.run_cpu_time_us":30332,"wal-append.run_wall_time_us":2059843}]]}
I20260709 13:10:01.629164 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:01.631623 32429 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:01.631767 31152 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:01.618374 32073 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:01.632830 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:01.676578 32074 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.676759 32177 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.677738 32074 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.680672 32074 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.680932 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1224) took 1122 ms. Trace:
I20260709 13:10:01.647464 32267 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.645460 30483 rpcz_store.cc:276] 0709 13:09:59.900753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.126655 (+225902us) service_pool.cc:224] Handling call
0709 13:10:00.126931 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.127212 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:00.512057 (+384845us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b18000361c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa048aa13c7 00007fa0450b39a7 00007fa0450c30bf 00007fa0450c3038
0709 13:10:01.246109 (+734052us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.429652 (+183543us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b18000361c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:01.609877 (+180225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.610889 (+  1012us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.611097 (+   208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:01.611146 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.611232 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.619349 (+  8117us) raft_consensus.cc:1685] finished
0709 13:10:01.619368 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.619545 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43183,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":14088,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":20170,"spinlock_wait_cycles":290605184,"thread_start_us":1096633,"threads_started":2,"wal-append.queue_time_us":341797}
I20260709 13:10:01.649343 32382 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.649518 31153 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:01.650015 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1225) took 1091 ms. Trace:
I20260709 13:10:01.651337 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 169) took 1329 ms. Trace:
W20260709 13:10:01.652244 30477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 113) took 2113 ms (client timeout 1673 ms). Trace:
I20260709 13:10:01.652904 31149 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:01.652577 32134 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.654111 30480 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
W20260709 13:10:01.683606 30477 rpcz_store.cc:269] 0709 13:09:59.538486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.827172 (+288686us) service_pool.cc:224] Handling call
0709 13:10:01.603657 (+1776485us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5c00117c8c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa048a13161 00007fa048bb4a79 00007fa04a06e9b6 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.652165 (+ 48508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237103360}
I20260709 13:10:01.681342 30406 rpcz_store.cc:276] 0709 13:10:00.558123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.599861 (+ 41738us) service_pool.cc:224] Handling call
0709 13:10:00.600777 (+   916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.307933 (+707156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.308053 (+   120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.343275 (+ 35222us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.640401 (+297126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.644414 (+  4013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.646896 (+  2482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.680573 (+ 33677us) raft_consensus.cc:1685] finished
0709 13:10:01.680588 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.680740 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66951,"raft.queue_time_us":644822,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":23154,"thread_start_us":194453,"threads_started":2,"wal-append.queue_time_us":217377}
I20260709 13:10:01.676707 32073 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:01.684607 32047 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.685683 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:01.685392 32047 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.656001 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.686077 32073 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.686868 32247 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.686897 32367 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.687443 30486 raft_consensus.cc:2410] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:01.687863 32073 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.687552 32247 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.656010 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:01.689177 31145 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.686571 30406 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:01.689695 31147 rpcz_store.cc:276] 0709 13:10:00.322316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.346054 (+ 23738us) service_pool.cc:224] Handling call
0709 13:10:01.628695 (+1282641us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84eee 0000000000375939 00007fa049ff81e0 00007fa04a0c10c4 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:01.651247 (+ 22552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30369536}
I20260709 13:10:01.691002 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:01.691916 30406 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:01.691496 32382 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:01.693190 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.641515 30405 rpcz_store.cc:276] 0709 13:10:00.161579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.259697 (+ 98118us) service_pool.cc:224] Handling call
0709 13:10:01.611157 (+1351460us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54002869d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.611414 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068478848}
I20260709 13:10:01.683367 30402 rpcz_store.cc:276] 0709 13:10:00.558404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.595064 (+ 36660us) service_pool.cc:224] Handling call
0709 13:10:01.495255 (+900191us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:01.495882 (+   627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.496575 (+   693us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:01.575178 (+ 78603us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.649423 (+ 74245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.649489 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.649541 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.649616 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.649787 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91048,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":2249,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"spinlock_wait_cycles":19075840,"thread_start_us":93265,"threads_started":2}
I20260709 13:10:01.694073 32025 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.694334 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:01.694860 32025 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.695331 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1233) took 1098 ms. Trace:
I20260709 13:10:01.637641 30404 rpcz_store.cc:276] 0709 13:10:00.555153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.555259 (+   106us) service_pool.cc:224] Handling call
0709 13:10:01.602300 (+1047041us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54001207d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.602564 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25697536}
I20260709 13:10:01.696376 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:10:01.697211 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-3d180da17ba548e0ab1ebdfa7dfc1f0a
I20260709 13:10:01.697423 32025 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.697916 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1234) took 1100 ms. Trace:
I20260709 13:10:01.698990 31596 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:01.687641 32367 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.699492 32267 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.657606 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 174) took 1134 ms. Trace:
I20260709 13:10:01.658617 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:01.663255 30551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1225) took 1343 ms (client timeout 1770 ms). Trace:
W20260709 13:10:01.664112 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59452.2us
I20260709 13:10:01.644416 30403 rpcz_store.cc:276] 0709 13:10:00.559672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.193794 (+634122us) service_pool.cc:224] Handling call
0709 13:10:01.194177 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.334811 (+140634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.562848 (+228037us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001298d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:01.613739 (+ 50891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271770368}
I20260709 13:10:01.667438 32189 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.704006 32337 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:01.704461 32267 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:01.704249 32189 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:01.702379 30551 rpcz_store.cc:269] 0709 13:10:00.294215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.294340 (+   125us) service_pool.cc:224] Handling call
0709 13:10:01.637135 (+1342795us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540039f654. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.637333 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2838167424}
I20260709 13:10:01.704690 32337 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.669757 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1221) took 1112 ms. Trace:
I20260709 13:10:01.671965 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.706398 30402 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.707809 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:01.708192 32047 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:01.675369 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08003a29c0 after lost signal to thread 30584
I20260709 13:10:01.708861 32189 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.709035 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:01.709643 32315 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:01.678144 32177 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:01.641007 30408 rpcz_store.cc:276] 0709 13:10:00.576935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.608153 (+1031218us) service_pool.cc:224] Handling call
0709 13:10:01.608926 (+   773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.609357 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.609407 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.609485 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:01.609529 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.609616 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.609765 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:01.698376 30404 rpcz_store.cc:276] 0709 13:10:00.597038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.696792 (+1099754us) service_pool.cc:224] Handling call
0709 13:10:01.697262 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.697550 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.697585 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.697643 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.697671 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.697738 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.697864 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:01.695780 30405 rpcz_store.cc:276] 0709 13:10:00.596794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.694221 (+1097427us) service_pool.cc:224] Handling call
0709 13:10:01.694625 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.695003 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.695031 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.695088 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:01.695120 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.695174 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.695278 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:01.699813 31596 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.703102 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:01.702953 31144 rpcz_store.cc:276] 0709 13:10:00.523243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.527232 (+  3989us) service_pool.cc:224] Handling call
0709 13:10:00.544765 (+ 17533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.582906 (+1038141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.657242 (+ 74336us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54006301d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:01.657495 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259420416}
I20260709 13:10:01.703605 32254 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.710291 32315 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:01.712040 32177 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:01.720333 30404 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:01.720079 32177 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.721711 32177 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.706056 30407 rpcz_store.cc:276] 0709 13:10:00.557150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.557267 (+   117us) service_pool.cc:224] Handling call
0709 13:10:01.612081 (+1054814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.653390 (+ 41309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.669477 (+ 16087us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002869d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:01.669674 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410170112}
I20260709 13:10:01.722680 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1223) took 1144 ms. Trace:
I20260709 13:10:01.709642 32189 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:01.723062 32415 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:01.723469 32189 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.723395 32254 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:01.709089 30432 debug-util.cc:398] Leaking SignalData structure 0x7b08003412a0 after lost signal to thread 30585
I20260709 13:10:01.713991 32434 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:01.724822 32434 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:01.717581 32181 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.726814 32181 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.726217 32047 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.727928 32315 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.729341 32181 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.726082 30432 debug-util.cc:398] Leaking SignalData structure 0x7b0800325020 after lost signal to thread 31180
I20260709 13:10:01.729882 32107 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:01.726161 32434 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.730762 32107 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.713805 32159 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.724094 32189 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.738094 31596 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.729924 32382 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.738777 32337 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.739904 30409 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.111s	user 0.016s	sys 0.004s
I20260709 13:10:01.740419 30409 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:01.741024 32247 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:01.735880 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.742707 30481 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 2.
I20260709 13:10:01.724150 32415 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.736307 30408 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:01.726142 32254 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:01.743649 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49012.4us
I20260709 13:10:01.752844 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1235) took 1155 ms. Trace:
I20260709 13:10:01.753980 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:01.757814 30406 rpcz_store.cc:276] 0709 13:10:00.597292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.700604 (+1103312us) service_pool.cc:224] Handling call
0709 13:10:01.733872 (+ 33268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.752426 (+ 18554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.752467 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.752535 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.752569 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.752634 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.752758 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:01.759181 32247 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.760839 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.762001 32134 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:01.765056 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.765147 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.750931 32181 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:01.748040 32367 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.766503 32181 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.750653 32374 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:10:01.769271 32181 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.751159 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:01.769641 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:01.770526 30551 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:01.761730 32159 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.748431 32415 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:01.772531 32415 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.773191 32159 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.772945 30560 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:01.772928 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:01.774076 32415 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.774636 30558 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:01.762663 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.776139 30477 raft_consensus.cc:2368] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:01.776486 30551 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:01.733435 30411 rpcz_store.cc:276] 0709 13:10:00.557841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.581296 (+ 23455us) service_pool.cc:224] Handling call
0709 13:10:01.599801 (+1018505us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:01.600213 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.600659 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:01.601012 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.701317 (+100305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.701365 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:01.701391 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.701433 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.702134 (+   701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10755,"prepare.queue_time_us":22466,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":34442,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":50578304,"thread_start_us":66248,"threads_started":1,"wal-append.queue_time_us":125780}
I20260709 13:10:01.777539 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:01.751974 31145 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:01.778363 30558 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:01.778502 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 172) took 1419 ms. Trace:
I20260709 13:10:01.779031 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.779803 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1437) took 1206 ms. Trace:
I20260709 13:10:01.779861 30481 raft_consensus.cc:2376] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3. Re-sending same reply.
I20260709 13:10:01.780370 30482 rpcz_store.cc:276] 0709 13:10:00.572934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.607127 (+ 34193us) service_pool.cc:224] Handling call
0709 13:10:00.607557 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.195367 (+587810us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:01.250589 (+ 55222us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.558571 (+307982us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180012a3c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:10:01.728743 (+170172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.729364 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.729572 (+   208us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.729608 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.733292 (+  3684us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.748676 (+ 15384us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b180012a3c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:01.764095 (+ 15419us) raft_consensus.cc:1685] finished
0709 13:10:01.764130 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.779579 (+ 15449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593056,"prepare.queue_time_us":53718,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":638571,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":30511,"spinlock_wait_cycles":67994880,"thread_start_us":85432,"threads_started":1,"wal-append.queue_time_us":433389}
I20260709 13:10:01.783263 32374 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:01.765355 32107 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.785950 32437 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.786590 32437 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:01.789323 30402 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:01.741025 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1232) took 1144 ms. Trace:
I20260709 13:10:01.800486 32159 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.802230 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.800740 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.802452 30307 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.803750 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:01.803798 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.804760 32134 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.805567 32156 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:01.805733 32367 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.805927 30307 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.806087 32156 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.805748 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:01.811738 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.812512 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51851.6us
I20260709 13:10:01.813726 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:01.778885 31145 rpcz_store.cc:276] 0709 13:10:00.359598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.369631 (+ 10033us) service_pool.cc:224] Handling call
0709 13:10:01.655628 (+1285997us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:01.778426 (+122798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16923008}
I20260709 13:10:01.820349 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.816622 32156 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.821704 32367 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:01.822712 32367 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.823215 32367 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.826713 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.827653 32134 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.828306 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:01.829758 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:01.832353 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:01.833302 32267 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.833877 32159 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.833902 32267 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.835755 30570 tablet_copy_source_session.cc:215] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:01.836549 32267 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.836666 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:01.837541 32374 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:01.837626 32159 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:01.838675 32374 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:01.839428 32189 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.840473 32437 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.842231 32437 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.842285 32189 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:01.850060 30482 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:01.851068 32134 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.851508 32134 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.852145 32134 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.856626 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.856988 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.857390 30477 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:01.857707 30481 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.858068 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.858449 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.859385 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.859805 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.863667 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.864949 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:01.851375 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:01.869947 30481 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:01.872601 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:01.873131 30402 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.800216 30409 rpcz_store.cc:276] 0709 13:10:00.596516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.626946 (+ 30430us) service_pool.cc:224] Handling call
0709 13:10:01.740954 (+1114008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:01.882522 32107 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:01.882609 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:01.882874 32177 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:01.885330 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.839851 32374 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.883299 32107 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:01.886940 32406 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:01.887879 32107 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:01.883325 32177 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:01.889755 30524 leader_election.cc:400] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:01.890898 30524 leader_election.cc:403] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.891407 31153 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:01.893137 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.895252 30486 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:01.895375 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.894829 32177 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.896919 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.898303 30482 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:01.898473 30484 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:01.900257 30307 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 2, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.902817 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1220) took 1321 ms. Trace:
W20260709 13:10:01.910784 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 43900us
I20260709 13:10:01.903273 30410 rpcz_store.cc:276] 0709 13:10:00.556817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.556941 (+   124us) service_pool.cc:224] Handling call
0709 13:10:01.542026 (+985085us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:01.542505 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.543141 (+   636us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:01.623203 (+ 80062us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.871078 (+247875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.871123 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:01.871158 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.871230 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.878202 (+  6972us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44986,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":22478,"spinlock_wait_cycles":39110528,"thread_start_us":208171,"threads_started":2}
I20260709 13:10:01.913439 32070 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.907603 30481 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.913982 32070 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:01.915222 30483 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:01.915508 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.916494 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.917742 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.919319 30484 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:01.923216 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:01.923863 30560 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.914999 31785 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:10:01.925308 30376 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.503s (SENT)
I20260709 13:10:01.927096 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.928388 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:01.902557 30307 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:01.942970 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:01.943521 30477 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:01.943996 30376 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.527s (SENT)
I20260709 13:10:01.950412 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.951084 30480 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:01.952683 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:01.941637 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.956416 30482 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:01.955472 30485 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:01.967072 32411 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.954999 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.970863 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:01.986969 30484 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:01.954075 30307 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:02.010394 30402 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:01.955251 32073 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:01.977690 32403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.998198 30560 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:02.014900 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.013168 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.019805 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.970715 32125 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:02.020318 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 115538us
I20260709 13:10:02.021011 30484 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:02.021574 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86373.8us
I20260709 13:10:02.026909 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:01.976868 32047 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.029232 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:02.030766 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.031433 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.032965 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:01.976431 32367 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.035984 32374 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:02.036495 32367 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.036887 32374 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:02.035944 32177 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.037940 32374 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:02.047612 30376 leader_election.cc:336] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.796s (SENT)
I20260709 13:10:02.048568 30523 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.042114 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.042951 32181 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:02.043324 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67214.2us
I20260709 13:10:01.982374 32156 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:02.043896 32447 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:10:02.047595 32434 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.049758 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:02.026696 32247 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:02.054564 32247 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:02.055092 32247 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.055035 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.056605 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.057082 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:02.057832 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.058429 32392 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:02.057245 30558 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.059176 32181 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.059124 32392 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:02.060325 32436 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:02.062038 31144 raft_consensus.cc:2368] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:02.061914 31785 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:02.050748 32070 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.063076 32156 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.059700 32181 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:02.043769 32437 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:10:02.066205 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.069980 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.070279 32125 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.070657 30556 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.022485 32073 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.084173 30558 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:02.089838 30481 raft_consensus.cc:2410] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:02.080585 30478 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:02.100298 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.101310 30402 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:02.074469 32247 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.105202 30556 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:02.106956 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:02.111619 32434 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.116493 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 71699.3us
I20260709 13:10:02.117293 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.118211 32125 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.118899 32371 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:02.119308 32371 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:02.119693 32371 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.118616 30523 leader_election.cc:400] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:02.124743 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:02.136860 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:02.137344 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 78387us
I20260709 13:10:02.138813 32406 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:02.139004 32437 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.139562 32406 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:02.140784 32406 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.144755 30482 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.147140 32437 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.147748 32437 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:02.148424 30484 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:02.148890 32437 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.147303 30483 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:02.157401 32436 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.157346 32411 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:02.158067 32436 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:02.150365 32437 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.160344 32156 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:02.162536 32434 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.163820 32181 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.123207 32070 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:10:02.091989 32392 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:02.197595 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.202153 30409 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:02.068813 32047 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.216830 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:02.218369 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 99878us
I20260709 13:10:02.220758 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.197594 32156 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:02.219421 32177 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.233789 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:02.231051 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 171177us
I20260709 13:10:02.234239 30478 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:02.222652 31785 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:02.243340 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:02.244848 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 87677.6us
I20260709 13:10:02.250422 32367 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:02.232252 32159 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.225677 32134 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:02.256983 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 199989us
I20260709 13:10:02.244773 32181 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.252748 32436 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.274855 32107 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.269563 32267 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:02.285604 32436 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.286311 30486 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:02.288189 32196 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:10:02.289278 32196 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.289426 30409 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:02.289669 32196 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:02.286337 32267 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:02.291282 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:02.292917 30376 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.953s (SENT)
W20260709 13:10:02.299860 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 66138us
I20260709 13:10:02.300848 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.278137 32392 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.297044 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:02.266304 32159 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.265359 31785 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.299443 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.296159 32189 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:10:02.310732 32134 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.307816 32156 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.322312 32247 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.312126 32125 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.324201 32073 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.299069 32177 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:10:02.316033 31785 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:02.327229 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 54703.3us
I20260709 13:10:02.327858 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:02.328552 30486 raft_consensus.cc:606] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:02.327329 32107 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:02.329677 32107 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:02.329990 32107 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:02.322347 32461 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.330796 32107 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.332150 32107 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:02.336258 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.328474 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:02.337723 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.338068 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.291455 32196 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.339983 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.340240 32196 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.340921 32247 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:02.341651 32247 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.342346 32247 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.311973 32047 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.343164 32247 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.343235 32047 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.343464 32434 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.326646 32371 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:02.349087 32371 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.315353 32411 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:02.376221 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63584.7us
I20260709 13:10:02.371791 30477 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:02.370561 32267 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.377626 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:02.382006 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.386324 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:02.387679 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.376343 32411 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.391222 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.399305 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.379405 32247 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:02.403229 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:02.404743 30483 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.393239 32433 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:02.407395 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.408739 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.409560 30408 raft_consensus.cc:2368] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:10:02.412830 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.418289 30403 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:02.401221 32411 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.423153 30408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
W20260709 13:10:02.427603 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.406291 32463 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.429033 32463 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.431442 32463 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.431985 32247 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:02.434664 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 163915us
W20260709 13:10:02.439102 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.432403 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:02.446923 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50761.8us
I20260709 13:10:02.421224 32471 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.406656 32134 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:02.402122 32392 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:02.473639 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.456166 30408 raft_consensus.cc:606] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:02.475908 30408 raft_consensus.cc:614] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.420187 32433 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:10:02.490000 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 82750.1us
I20260709 13:10:02.496672 30560 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:02.496464 32471 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.496641 32434 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:02.496994 32181 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.498558 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.503353 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.503085 30451 leader_election.cc:400] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:02.478281 32392 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.504495 30451 leader_election.cc:403] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.506541 32470 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.495182 31785 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:02.500236 32181 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.508224 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.508479 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.509348 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.512280 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.513963 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:02.514868 32433 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.515126 31785 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:02.517850 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.524289 30558 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:02.521492 30484 raft_consensus.cc:606] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:02.525171 30560 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.525640 30484 raft_consensus.cc:614] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.526757 32159 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:02.528697 32434 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.535219 30556 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:02.535447 32471 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.537489 31785 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:02.538069 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.538750 30477 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:02.498267 32371 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:02.545560 32181 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.509709 32470 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:02.550362 30560 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:10:02.551403 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 49922.8us
I20260709 13:10:02.553574 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.556818 30551 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:02.557932 32074 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.558195 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:02.558624 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 53321us
I20260709 13:10:02.566929 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.567730 30406 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:02.567929 30376 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:02.568293 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.565660 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.564782 30555 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:10:02.560685 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55417.8us
I20260709 13:10:02.566450 30411 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:02.563369 30478 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:02.559197 30486 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:02.570809 30478 pending_rounds.cc:85] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 5
I20260709 13:10:02.561499 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.563786 30554 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:02.565191 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.560889 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.570755 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.563803 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.575870 30552 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:02.577982 30402 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:02.573231 32436 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.530584 32403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43936 (request call id 280) took 2599 ms. Trace:
W20260709 13:10:02.593281 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.593876 30403 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:02.571130 30478 pending_rounds.cc:107] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:02.600037 30478 raft_consensus.cc:2889] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.594870 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.562867 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:02.600869 30553 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.598656 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.603921 30560 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:02.604557 30406 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.606666 30558 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:02.608402 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.609609 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.613255 30554 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:02.613670 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.614612 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.615458 30552 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:02.626269 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:02.639273 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47801.4us
I20260709 13:10:02.565433 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.649044 30411 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.650029 30555 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
W20260709 13:10:02.655150 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44215us
I20260709 13:10:02.546824 32470 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.593492 32437 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:02.660470 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.667936 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.668566 30406 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:02.658578 30483 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:02.659973 30560 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:02.601706 31785 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.667392 30523 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.660223 30554 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:02.672957 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.661002 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.591383 32471 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:10:02.681952 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 80455.9us
I20260709 13:10:02.683028 30524 leader_election.cc:400] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:10:02.683382 30524 leader_election.cc:403] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:02.686265 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44357us
I20260709 13:10:02.687777 30404 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:02.694929 30552 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.669350 32437 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.696298 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:02.697328 30477 raft_consensus.cc:606] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:02.697337 30406 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:02.697952 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.697999 30477 raft_consensus.cc:614] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.698764 30407 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:02.704250 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.704257 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.703208 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.712421 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.715878 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.695458 31785 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:02.701608 32437 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.720711 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:02.720635 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.670624 32434 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:10:02.707876 32134 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.709101 32047 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:02.727069 32476 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:02.712147 32470 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.738852 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.739650 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.715176 32371 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.742903 30402 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:02.746961 30406 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.747140 30407 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:02.748204 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.751278 30557 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:02.753077 31785 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.737828 32189 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:02.760524 30553 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:02.754529 32074 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:02.706027 32411 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.764302 30408 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:10:02.763526 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54267.7us
I20260709 13:10:02.767751 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.766063 30411 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:10:02.768838 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85990.4us
I20260709 13:10:02.719004 32392 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:10:02.768013 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.770279 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.771231 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:02.771661 32480 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:02.772887 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.773422 30408 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:02.774081 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.774624 30411 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:02.719125 32461 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:10:02.777318 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.777197 30484 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:02.763499 32125 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 2. Current term is 3.
I20260709 13:10:02.780055 30410 raft_consensus.cc:2368] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:02.762846 32371 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:02.778035 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.783140 30551 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:02.766757 32374 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.789520 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.787989 32181 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:02.791081 32437 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.598834 32403 rpcz_store.cc:276] 0709 13:09:59.931977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.932094 (+   117us) service_pool.cc:224] Handling call
0709 13:10:00.338670 (+406576us) ts_tablet_manager.cc:934] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:10:01.941743 (+1603073us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:02.309464 (+367721us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:02.330545 (+ 21081us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:02.482771 (+152226us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:02.504613 (+ 21842us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:02.519260 (+ 14647us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:02.530481 (+ 11221us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":389,"tablet-copy.queue_time_us":236428,"thread_start_us":827259,"threads_started":2}
I20260709 13:10:02.795346 30403 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:02.795657 32403 tablet_copy_client.cc:806] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:02.796387 32403 tablet_copy_client.cc:670] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:02.765107 32070 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:02.799422 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:02.800033 30405 raft_consensus.cc:2376] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:02.805621 30559 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:10:02.809103 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.780964 32134 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:02.814049 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.817179 30411 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:02.817751 32437 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.819645 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:02.821581 30402 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:02.820871 30406 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:02.822394 30408 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:02.824297 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54182.7us
I20260709 13:10:02.825896 31153 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:02.837841 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.821770 31785 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:02.822261 32461 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:02.840202 30406 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:02.842980 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:02.845834 32478 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:10:02.850483 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.854694 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.856566 30559 raft_consensus.cc:2368] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:02.856590 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.842296 31785 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.865301 31785 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:02.866024 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.841672 32461 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:02.890445 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.836406 32374 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:02.895747 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56234.4us
I20260709 13:10:02.898367 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.903538 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.858960 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.859266 32107 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:02.894497 32461 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.889029 32371 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:02.921511 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.927083 30553 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:10:02.902951 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44382.1us
W20260709 13:10:02.905795 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.909353 32488 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:10:02.915743 32482 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.006s
I20260709 13:10:02.916749 30411 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:02.935756 30411 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:02.936005 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.918781 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.918895 32374 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.856125 32134 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:02.903699 32177 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:10:02.921476 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.947894 30481 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:02.895798 32411 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:02.917447 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:02.953706 30479 raft_consensus.cc:606] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:02.942736 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:02.945314 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 104291us
I20260709 13:10:02.945937 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.954672 30405 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:02.954912 30553 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:02.957424 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.957439 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.974220 30481 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:02.976248 30376 leader_election.cc:400] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:02.976613 30376 leader_election.cc:403] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.976255 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.976837 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:02.977049 30553 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:02.978219 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.979095 30481 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:02.979756 32411 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:02.980613 32473 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:02.983299 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 54445.1us
I20260709 13:10:02.976460 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.984750 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.956483 32189 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:02.984751 30558 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:02.975286 30411 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:02.987484 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:02.972183 32374 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:02.990108 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:02.992836 30486 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:10:02.994733 30411 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.992784 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:03.002571 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 233019us
I20260709 13:10:03.004420 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.008827 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.010555 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:02.988731 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.016778 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:02.990852 32189 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.018570 30482 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:03.019083 32392 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:02.988943 32470 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.990856 32374 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.988631 32484 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.024520 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:03.037235 32484 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.026927 32374 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:02.995911 32254 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:10:03.024685 30478 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:02.992159 32107 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:10:02.991145 31785 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.025678 32181 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:03.049753 32403 tablet_copy_client.cc:538] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.059252 30411 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:10:03.060719 30411 pending_rounds.cc:85] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:10:03.060997 30411 pending_rounds.cc:107] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:03.061697 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.062183 32498 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.063078 30411 raft_consensus.cc:2889] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.062776 32498 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.064647 30559 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:03.065027 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.065164 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.052532 32134 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:03.068737 30557 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:03.066109 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.065872 32475 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:03.068367 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.076663 30552 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:03.066092 32430 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:03.078861 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86161us
I20260709 13:10:03.047674 32470 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.082574 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.069057 32134 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:03.099291 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.106968 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.110131 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:03.119581 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 69088.5us
I20260709 13:10:03.121332 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.122608 30552 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:10:03.122854 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 98402.6us
I20260709 13:10:03.094535 32500 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.108494 32134 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.124572 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:03.086998 32499 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.108740 32254 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:03.129973 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 119471us
W20260709 13:10:03.132846 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 93149.5us
I20260709 13:10:03.136042 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:03.138266 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.108361 32181 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.131362 32254 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.139140 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:03.143682 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50223us
I20260709 13:10:03.131729 32461 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.149927 32461 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:03.150012 32107 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:03.132637 32500 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.151289 30551 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:03.164564 32471 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:03.165213 32374 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.166100 32471 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:03.167400 32504 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:10:03.167506 32073 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.168081 32374 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.162014 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:03.141120 32315 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.169226 31153 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 3: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:03.142777 32254 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.182279 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.182937 30483 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.168394 32073 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:03.186442 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 169731us
I20260709 13:10:03.142082 32181 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.166612 32471 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:03.260097 32484 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.259943 32047 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:03.180224 31785 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:03.265202 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 134892us
I20260709 13:10:03.183692 31144 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:03.267167 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.276901 30483 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:03.180722 32434 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.278131 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.263546 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.284878 30483 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:03.291373 32484 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.292078 32411 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:03.292999 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 113100us
I20260709 13:10:03.256574 32073 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:03.295799 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.373208 32073 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.374437 32073 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.376794 30551 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:03.316689 32471 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.378830 32514 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.298388 30484 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:03.180552 32315 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.295528 32507 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:10:03.300519 32367 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.302774 32512 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:10:03.303493 32181 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.294301 32511 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:10:03.307238 32506 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:10:03.307469 30556 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:03.180408 32501 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 13:10:03.309175 32047 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.268406 32513 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:10:03.326736 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46272us
I20260709 13:10:03.333860 32497 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:03.337280 32371 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.349864 32473 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.316303 32470 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.356030 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.356168 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.430043 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.358305 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.362557 31153 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:03.367571 30408 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:03.379359 32514 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.385577 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.393622 32437 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.397644 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.399601 32254 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.401522 32189 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.403196 32512 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:03.378180 32134 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.411022 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.413944 30484 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:03.371073 32411 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.450239 32411 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.451118 32315 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.434144 32371 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.455701 32371 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:03.458086 32411 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.460338 32411 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.419994 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.463160 30552 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:03.413131 32367 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.465090 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.465602 32367 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.467655 32521 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:03.447463 32247 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:03.424485 32047 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:03.470746 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48466us
I20260709 13:10:03.430928 30478 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:03.433636 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48187.5us
I20260709 13:10:03.472440 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.406766 32070 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.435189 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.475279 30482 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.444173 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:03.446979 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1502) took 1056 ms. Trace:
I20260709 13:10:03.409585 32500 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:03.386296 32484 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.480275 32315 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.470466 32254 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.481045 32047 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.480866 32315 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.483924 32484 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.485698 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.476629 30410 rpcz_store.cc:276] 0709 13:10:02.390836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.390992 (+   156us) service_pool.cc:224] Handling call
0709 13:10:03.446755 (+1055763us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540020a154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:03.446907 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880232832}
I20260709 13:10:03.479341 32156 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.479533 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.486531 30407 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:03.492554 30404 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:03.488186 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.440101 32125 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.489850 32315 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.494458 32513 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.494580 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.496677 32134 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:03.500023 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68271.9us
W20260709 13:10:03.500559 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.506304 30481 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:03.508886 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.511322 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:03.514523 32484 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.515327 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:03.516677 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.515118 32484 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.476191 32415 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:03.518916 32411 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:03.519311 32411 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.519658 32411 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.484683 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:03.522526 32514 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.523074 32511 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.499220 32254 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:03.523934 32254 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:03.524322 32254 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:03.524613 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.524791 32511 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:03.525285 32134 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:03.525905 32484 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.516932 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.502823 32125 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.536863 32125 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.537901 32498 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.538633 32477 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.539980 32477 raft_consensus.cc:993] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:10:03.540288 32461 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:03.540896 32461 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:03.537573 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.443667 32437 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.529312 32247 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:03.527042 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.530683 32403 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
W20260709 13:10:03.532776 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 93529.1us
I20260709 13:10:03.546775 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.532585 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:03.531073 32511 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:03.526382 32371 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:03.540397 32477 raft_consensus.cc:1081] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:10:03.530555 32525 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:03.544175 30451 leader_election.cc:400] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:03.547389 30552 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:03.555097 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.557483 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.533341 32488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53476 (request call id 9) took 6512 ms. Trace:
I20260709 13:10:03.544742 32247 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.563325 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.565681 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.553321 32525 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.503574 32156 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.541863 32461 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.554740 32134 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:03.574018 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.590878 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.565730 32247 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.593339 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.594480 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:03.595211 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.592655 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:03.596916 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.598513 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.598605 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.600091 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.565172 32484 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:03.609761 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.604211 30478 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:03.614832 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.615586 32125 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.616575 32521 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.617074 32521 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.618371 32437 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.622793 32073 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:03.565169 32514 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.625284 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.626300 30482 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:03.569517 32315 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:03.567265 32525 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.632402 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.598248 32507 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.597751 32196 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.637614 32434 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:03.638334 32517 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.638496 32463 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.639284 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.640025 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.658675 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.599565 32159 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.641209 32521 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.613508 32484 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.597775 32181 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:10:03.634160 32477 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.627305 32073 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.691082 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.680619 30524 leader_election.cc:400] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4.
I20260709 13:10:03.680011 30552 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:03.628321 32125 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.637677 32518 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:03.688490 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48552us
W20260709 13:10:03.688779 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 88750.7us
I20260709 13:10:03.694638 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:03.695784 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.634944 32315 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.635636 32134 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:03.642360 32392 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:03.702883 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.703001 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.691602 32484 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:03.708050 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50284.3us
I20260709 13:10:03.690199 32434 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:03.633980 32514 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.715947 30408 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:03.716759 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:03.707165 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:03.694532 32159 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.694401 32073 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.712334 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.722801 30552 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:03.722710 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:03.723877 30406 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:03.714416 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.714951 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.702116 32406 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.694795 32477 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:03.737008 32477 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.731510 32415 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.739305 32415 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.706938 32499 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.742933 32499 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.743302 32499 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.744920 30479 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:10:03.721258 32526 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:10:03.742308 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.707836 32196 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:03.704700 32411 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.713658 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.759059 30560 raft_consensus.cc:2376] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:03.725485 30554 raft_consensus.cc:2368] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:03.761073 30406 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:03.701725 32315 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.730345 32156 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.766598 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:03.714223 32254 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.731594 32470 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:03.736519 32406 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.743199 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.564183 32488 rpcz_store.cc:276] 0709 13:09:56.992907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.993055 (+   148us) service_pool.cc:224] Handling call
0709 13:09:59.195062 (+2202007us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4c00069700. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa043375a20 00007fa043386a29 00007fa04334c644 00007fa043373f2d 00007fa043373b93 00007fa0450021af 00007fa045001f3e 00007fa045087888 00007fa0450a475c 00007fa0450a576a 00007fa0450a491b
0709 13:09:59.195724 (+   662us) log.cc:844] Serialized 499 byte log entry
0709 13:10:03.489528 (+4293804us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166,"raft.run_cpu_time_us":1141,"raft.run_wall_time_us":3365,"spinlock_wait_cycles":66110720,"thread_start_us":39063,"threads_started":1,"wal-append.queue_time_us":45561,"wal-append.run_cpu_time_us":2076,"wal-append.run_wall_time_us":1049723}
I20260709 13:10:03.723774 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.719221 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:03.783601 31147 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:03.747330 30482 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:03.669013 32525 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.787458 32525 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.789673 32484 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.758528 32196 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:03.790983 32196 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.792557 32070 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:03.793079 32070 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.751081 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.756961 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:03.702888 32463 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:03.769294 32514 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.750015 32415 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.722507 32181 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:03.773180 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:03.805384 30479 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:10:03.773968 30408 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:03.775705 30555 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:03.775610 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1238) took 1173 ms. Trace:
I20260709 13:10:03.807652 30560 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:03.780452 30552 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:03.774989 32500 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.657615 32511 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.781306 32471 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.779520 32107 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.778355 32125 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.757526 32486 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:03.795612 30409 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:03.806138 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.807252 30403 rpcz_store.cc:276] 0709 13:10:02.601974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.602109 (+   135us) service_pool.cc:224] Handling call
0709 13:10:02.789225 (+187116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.795867 (+  6642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.957372 (+161505us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b5400285ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:03.775363 (+817991us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400285ad0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:03.775525 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359863424}
I20260709 13:10:03.814862 32500 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.815591 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:03.809405 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:03.816061 32247 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.795547 32406 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.851163 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:03.853485 32500 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.818470 32507 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:03.854158 32507 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:03.841655 30560 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.856034 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:03.843425 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.857272 30479 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.820818 32107 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.856727 30404 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:03.861198 30404 pending_rounds.cc:85] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 2
I20260709 13:10:03.861459 30404 pending_rounds.cc:107] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:10:03.861716 30404 raft_consensus.cc:2889] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.820444 32254 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:03.869805 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:03.870162 30555 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:03.873145 32047 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.873315 32507 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:03.840044 32486 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:03.874586 32507 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.874887 32486 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.877894 30403 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:03.882849 32247 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.883634 30410 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:03.885250 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.886682 30410 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:03.888024 30557 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:10:03.890985 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.809877 32134 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.903306 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:03.904883 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:03.863087 32107 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.907768 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:03.911348 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:03.842104 32125 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.897114 32463 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.933630 32463 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:03.841840 32434 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.934499 32463 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.933648 32125 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:03.917246 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:03.939325 30557 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:03.923261 32411 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.923975 32517 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:03.925438 32070 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.925774 31785 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:03.927174 32529 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
I20260709 13:10:03.882897 32073 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.917057 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:03.964360 30404 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:03.942369 30479 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:03.964769 30451 leader_election.cc:400] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
W20260709 13:10:03.978001 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.981986 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:03.987097 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 230252us
I20260709 13:10:03.989634 30479 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:03.990427 30560 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:03.914074 32516 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.938280 32488 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:03.986302 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:03.918044 32500 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:04.001768 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.004443 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:04.006201 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:04.006817 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.905642 32247 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:10:04.012458 30408 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:04.012475 30410 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:04.009007 32488 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:03.896670 32477 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.013638 32488 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.013900 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:04.013839 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.013585 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.015316 30408 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:04.015518 32477 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:03.991830 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:04.016332 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:03.901866 32513 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:10:04.017650 30410 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.017086 30408 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:03.911171 32392 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:10:03.985519 30556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:10:04.023589 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.024081 30556 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.024433 30556 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:04.019476 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 54840.8us
I20260709 13:10:04.026633 30559 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.027318 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:04.027956 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.029561 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:04.019981 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.020534 30486 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:04.040102 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:03.915197 32499 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:03.960397 32125 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:10:03.958560 32196 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:04.047169 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.048777 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:04.048794 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.049628 30560 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.051920 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.052538 30482 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:04.020545 32516 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:04.054193 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:04.055704 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.056572 30482 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:04.058631 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.042874 32415 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:04.068320 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:04.069615 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.069788 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.061646 30556 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:04.072785 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44894.7us
I20260709 13:10:04.073863 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.046643 32511 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:04.079087 30560 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:04.047446 32484 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.063283 32392 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.085009 30486 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:04.096225 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56213.8us
I20260709 13:10:04.093858 30404 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:04.097100 30482 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:04.058924 32517 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:04.062631 32525 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.098466 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.106516 30556 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:04.071530 32500 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:04.109066 30486 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:04.110077 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:04.086122 32533 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:04.113266 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.071940 32530 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:04.087194 32411 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:04.117956 30482 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:04.125401 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.099046 32392 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:04.132524 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.108950 32525 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.108734 32518 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:04.109107 32500 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.139464 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:04.086488 32493 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.186s
I20260709 13:10:04.150589 32500 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.154320 32493 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.147887 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.156790 32521 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.148247 32196 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.161746 32107 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.142549 32525 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.120481 32484 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.114969 32073 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.148435 32528 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:04.118835 32530 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.165606 32315 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:04.175140 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 61978.1us
I20260709 13:10:04.123193 32159 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.121497 32544 raft_consensus.cc:2764] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:04.137691 32516 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.188139 30409 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:04.187805 32392 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.129408 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:04.111482 32254 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:10:04.090523 32406 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.093968 32486 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.200465 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.138118 32411 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:04.138927 32125 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:04.204052 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.205276 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.206807 30482 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:04.209050 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 108388us
I20260709 13:10:04.302847 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:04.269601 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.270282 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.183380 32267 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.267231 31785 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:04.296023 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 155554us
I20260709 13:10:04.203043 32530 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.299996 30478 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:04.189210 32374 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:10:04.273749 32415 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:04.299350 31145 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:04.340095 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 136117us
W20260709 13:10:04.306399 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 101212us
I20260709 13:10:04.362300 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.362435 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.356194 30407 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:04.304183 32529 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:10:04.325790 32074 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.361129 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.358736 32463 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:04.374867 32073 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:04.375810 32547 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:10:04.375288 32463 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.305001 32499 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.379138 30410 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
W20260709 13:10:04.364532 32532 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:04.295199 32510 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:10:04.331432 32528 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:04.185082 32518 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:04.375290 32557 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:10:04.421366 32555 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:10:04.425824 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 61910.9us
I20260709 13:10:04.339028 31785 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.340181 32125 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.360311 32517 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:10:04.477113 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.481353 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:04.483182 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 120351us
W20260709 13:10:04.483608 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 156606us
I20260709 13:10:04.465305 32556 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.490317 30402 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:04.481745 31145 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:04.491498 30406 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:04.461681 32073 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:04.490638 30410 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:04.497891 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:04.503032 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.509737 30555 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:04.511284 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.512001 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.511417 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.513113 30410 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.504158 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:04.514626 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 153612us
I20260709 13:10:04.518836 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.519181 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.519621 30559 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:04.519861 30557 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:04.522679 30406 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:04.526525 30410 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:04.526618 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.494372 32484 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:04.491601 32560 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.492903 32471 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:04.528229 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.494179 32544 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.532068 30560 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:04.534288 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:04.532048 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.486755 32500 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.533434 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.510991 32556 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.535740 30406 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.533200 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.536101 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.536728 30551 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:04.538239 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.509006 32107 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.540494 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:04.541898 32550 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:10:04.542191 32564 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.502524 32073 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.542390 32125 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:04.542879 32558 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:04.543972 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.497946 32477 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:10:04.570093 30557 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:04.551067 32315 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.537456 32484 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:04.583734 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.539276 32471 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.587106 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.553932 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:04.496781 32415 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.490074 32411 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.512566 32528 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.553301 32486 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.552057 32134 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.589457 32463 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:04.591605 32552 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:04.591859 32500 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:04.593195 32535 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.635s	user 0.003s	sys 0.000s
W20260709 13:10:04.596702 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 84329.4us
I20260709 13:10:04.600486 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.605322 30407 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:04.620352 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.552325 32556 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.615942 32471 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:04.628724 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.635519 32568 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.636229 32568 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:04.637552 32568 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.636353 32073 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.601392 32562 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:10:04.642305 32159 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:04.643621 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 152961us
I20260709 13:10:04.643699 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.645645 30557 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.618752 31785 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:04.644330 30556 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:04.606789 32125 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:04.649389 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:04.606509 32564 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:10:04.643091 32513 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.655428 30559 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:04.659987 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:04.666371 32570 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:10:04.669533 30405 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:04.670539 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:04.670770 32551 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:10:04.671082 32477 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.671773 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.672297 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 295) took 1192 ms. Trace:
I20260709 13:10:04.672389 30406 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.668411 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:04.658131 32568 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.652599 32518 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:04.658233 32125 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:04.684602 32574 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:10:04.688546 31145 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:04.672688 31153 rpcz_store.cc:276] 0709 13:10:03.480030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.482721 (+  2691us) service_pool.cc:224] Handling call
0709 13:10:03.782975 (+300254us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:03.973808 (+190833us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84e9c 00007fa041f84a5b 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:03.974057 (+   249us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:04.000185 (+ 26128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.000233 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:04.020957 (+ 20724us) log.cc:844] Serialized 52 byte log entry
0709 13:10:04.112237 (+ 91280us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:04.112297 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.117788 (+  5491us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.672090 (+554302us) raft_consensus.cc:1685] finished
0709 13:10:04.672112 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.672239 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8940,"raft.queue_time_us":9067,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18488,"spinlock_wait_cycles":35005952,"thread_start_us":58586,"threads_started":1,"wal-append.queue_time_us":143075}
I20260709 13:10:04.704478 32517 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:04.704939 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48226.3us
W20260709 13:10:04.709928 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 223503us
I20260709 13:10:04.711856 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:04.714936 30406 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:04.718529 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.719094 30478 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.717505 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:04.704928 32517 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:04.710299 32074 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.727782 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:04.732344 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:04.725790 32073 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:10:04.733187 31144 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
W20260709 13:10:04.733639 32488 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.001s
I20260709 13:10:04.723748 32159 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:04.734061 32488 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.735555 31149 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:04.739971 32525 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.541s	user 0.015s	sys 0.005s
I20260709 13:10:04.740500 32525 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.727126 32486 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:10:04.739779 32125 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.724596 32374 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.743641 32486 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:04.751660 32486 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:04.751530 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:04.751952 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.752596 32074 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:04.752480 32486 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.753203 32074 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:04.753731 32486 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.743853 32247 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.755002 32247 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:04.744280 32477 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:04.746064 32159 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:04.748431 32047 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:04.750505 30478 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:04.775940 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 196) took 1195 ms. Trace:
I20260709 13:10:04.725797 32518 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:10:04.779601 30481 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:04.776324 30558 rpcz_store.cc:276] 0709 13:10:03.567647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.567770 (+   123us) service_pool.cc:224] Handling call
0709 13:10:03.568154 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.568496 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:03.783688 (+215192us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180003d5a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa048aa13c7 00007fa0450b39a7 00007fa0450c30bf 00007fa0450c3038
0709 13:10:03.807024 (+ 23336us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.935505 (+128481us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b180003d5a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:04.647648 (+712143us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b180003d5a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a
0709 13:10:04.647811 (+   163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.648243 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.648394 (+   151us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:04.648426 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.648490 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.763239 (+114749us) raft_consensus.cc:1685] finished
0709 13:10:04.763259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.763396 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4460,"prepare.queue_time_us":274451,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":1780,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":25453,"spinlock_wait_cycles":121433472,"thread_start_us":35086,"threads_started":2,"wal-append.queue_time_us":31248}
I20260709 13:10:04.780910 30483 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:04.781785 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.758684 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.759740 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.746579 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1261) took 1029 ms. Trace:
I20260709 13:10:04.729535 32566 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:04.769236 32107 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:04.770344 32159 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:04.739791 32403 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:04.783802 30551 rpcz_store.cc:276] 0709 13:10:03.717649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.787686 (+ 70037us) service_pool.cc:224] Handling call
0709 13:10:03.787978 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.545770 (+757792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.746283 (+200513us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400071cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:04.746485 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721385344}
I20260709 13:10:04.742406 32461 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.711158 32574 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:04.794064 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.785363 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.711309 32562 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:10:04.731534 32484 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:04.754134 32074 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.789685 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:04.755992 32525 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:04.763339 32477 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:04.801420 30406 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:04.802361 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.801983 32477 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.803560 32477 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.728273 32463 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:10:04.809751 30406 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:04.812980 32406 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:04.814807 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.815960 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.816033 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.816687 30551 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:04.816597 30478 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:04.818559 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.819259 30558 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.818671 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.788637 32159 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:04.824980 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.825678 30481 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.768358 32247 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.817389 32556 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:04.826644 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:04.849462 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:04.873692 30481 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:04.848356 32566 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:04.865028 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:04.876837 30558 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:04.879503 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:04.883176 30558 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:04.888932 32159 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:04.878944 32566 consensus_queue.cc:1243] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:04.892125 32159 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.895308 32196 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.895740 32196 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:04.882773 32530 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.004s
I20260709 13:10:04.875487 31148 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.876544 32247 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.898180 30557 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:04.907793 30557 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:04.913300 32565 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.913805 32565 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:04.914652 32565 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.896543 32196 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:04.918915 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.918344 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:04.928148 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:04.919744 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.966017 30554 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.967998 30480 raft_consensus.cc:2368] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:04.968250 30557 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.970871 30551 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:04.981659 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:04.995400 30557 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.001457 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:04.970788 32507 consensus_meta.cc:287] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.093s	user 0.010s	sys 0.008s
I20260709 13:10:04.902109 32530 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:05.006745 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 279004us
I20260709 13:10:05.003669 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:05.002887 32582 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.176s	user 0.002s	sys 0.008s
W20260709 13:10:05.007277 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 217584us
W20260709 13:10:04.980326 32587 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:04.980819 32196 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.036820 30478 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:05.029708 30558 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:05.043105 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.044207 32463 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.045785 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.046644 32463 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:05.048414 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.048148 30374 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.049803 32463 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.051330 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.052291 32411 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:05.052846 32411 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:05.053906 32411 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.056619 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:05.073789 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.058219 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.077618 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:05.078191 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51170.9us
I20260709 13:10:05.079150 30486 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:05.080081 32471 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:05.083508 32436 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.085709 32392 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.089052 32125 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.089618 32125 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.092061 32125 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.080574 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.093436 32530 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.011775 32518 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:10:05.098017 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:05.103528 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:05.106657 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.114005 32574 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:05.114845 32574 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.115456 32540 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:05.116480 32540 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:05.116868 32540 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:05.117795 32574 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.114041 32572 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.120291 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:05.120913 30404 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.117726 32540 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.123286 32572 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.125464 32596 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:10:05.127645 32539 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.255s	user 0.013s	sys 0.002s
I20260709 13:10:05.127947 32254 raft_consensus.cc:993] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:10:05.128612 32254 raft_consensus.cc:1081] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:10:05.128777 32471 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.129276 32181 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:05.132025 32518 consensus_queue.cc:1243] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:10:05.133610 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.125115 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.135910 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1265) took 1413 ms. Trace:
I20260709 13:10:05.136018 32592 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:05.100730 31144 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:05.079756 32463 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:05.139449 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:05.141038 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.128254 32572 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.144459 31148 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:10:05.144845 32267 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.155335 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:05.165786 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1531) took 1308 ms. Trace:
I20260709 13:10:05.166224 30407 rpcz_store.cc:276] 0709 13:10:03.857397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.863156 (+  5759us) service_pool.cc:224] Handling call
0709 13:10:05.165604 (+1302448us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54003edd54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:05.165721 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113012608}
I20260709 13:10:05.145694 32540 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:05.146463 30485 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:05.147950 32573 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:05.149024 30480 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:05.118608 32574 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:05.150892 32592 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.152340 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.152251 32477 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.136400 30552 rpcz_store.cc:276] 0709 13:10:03.722549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.809948 (+ 87399us) service_pool.cc:224] Handling call
0709 13:10:03.810226 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.815062 (+  4836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.815092 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.815536 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.868615 (+ 53079us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:03.868671 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.868766 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.126437 (+1257671us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:05.128567 (+  2130us) raft_consensus.cc:1685] finished
0709 13:10:05.128590 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.135816 (+  7226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1110,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":114,"spinlock_wait_cycles":39838976,"thread_start_us":52589,"threads_started":1,"wal-append.queue_time_us":56002}
I20260709 13:10:05.153028 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:05.193948 30478 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:05.153518 32590 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:05.134855 32436 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:05.154029 30481 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:05.124773 32530 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:05.122145 32486 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:05.156512 30404 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:05.142273 32471 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:05.150919 32591 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.004s
I20260709 13:10:05.155735 31148 pending_rounds.cc:85] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Aborting all ops after (but not including) 3
I20260709 13:10:05.235670 31148 pending_rounds.cc:107] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:10:05.236048 31148 raft_consensus.cc:2917] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:10:05.197954 32590 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.236598 31148 raft_consensus.cc:2889] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.237164 32590 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.238324 32590 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.238890 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:05.207286 32592 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.208217 32070 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:05.211697 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56496.9us
I20260709 13:10:05.240856 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:05.241758 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:05.242409 32511 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:05.242725 30553 raft_consensus.cc:2410] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:05.218111 32488 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.258579 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:05.221282 32517 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.222246 32403 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:10:05.227964 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 75690.5us
I20260709 13:10:05.234683 32499 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:05.277935 32565 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.278458 32461 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.278995 32461 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.281637 32461 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:05.211855 32598 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:05.255932 32436 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:05.282874 32436 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:05.283110 32544 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:05.242883 32511 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.285655 32511 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.194887 32573 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.269251 32070 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.276110 32073 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:05.276291 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet 3e3cb6475718492e846dc8fdd3f4e538: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:05.276790 32434 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.272975 32493 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:05.243450 32486 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.273622 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:05.323233 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 49715.5us
I20260709 13:10:05.156929 32463 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:05.171062 32196 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 13:10:05.301956 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.270277 32471 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:05.367550 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.198133 32574 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.413981 32196 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:05.414660 32196 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.415755 32196 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.417255 32196 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.305331 32499 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.283809 32436 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:05.429744 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.444062 30409 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:05.434841 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:05.441939 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 200278us
I20260709 13:10:05.435240 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:05.350209 32486 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.434098 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:05.467140 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:05.468241 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 145) took 1460 ms. Trace:
I20260709 13:10:05.468843 30479 rpcz_store.cc:276] 0709 13:10:04.008028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.008157 (+   129us) service_pool.cc:224] Handling call
0709 13:10:04.026967 (+ 18810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.027308 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:04.047379 (+ 20071us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.929024 (+881645us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18002abaa0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:10:05.009603 (+ 80579us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.014425 (+  4822us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.014736 (+   311us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:05.014819 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.014899 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.145695 (+130796us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b48000b19d8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:10:05.209778 (+ 64083us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:05.467951 (+258173us) raft_consensus.cc:1685] finished
0709 13:10:05.467986 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.468162 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29178,"prepare.queue_time_us":20055,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":13576,"raft.run_cpu_time_us":2422,"raft.run_wall_time_us":139941,"spinlock_wait_cycles":81129216,"thread_start_us":80106,"threads_started":1,"wal-append.queue_time_us":1102204}
I20260709 13:10:05.361817 32488 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:05.361383 32564 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:05.482417 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:05.479208 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.428113 32517 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:05.487406 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.434430 32511 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:05.314445 32573 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.322983 32598 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260709 13:10:05.429328 32247 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.447546 32125 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.430179 32471 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:05.476147 32047 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.447840 32507 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:05.361467 32434 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.447425 32572 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.447626 32530 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:05.527750 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.476723 32596 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:05.516997 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 72875.5us
W20260709 13:10:05.517096 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 72752us
I20260709 13:10:05.403688 32493 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.504992 32564 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.496169 32500 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.425477 32074 consensus_queue.cc:1175] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0472fa7187444a91b443058ef89fceb9" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:10:05.519062 32403 tablet_bootstrap.cc:492] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:10:05.508246 32576 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:10:05.526971 32573 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.536926 32156 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:05.523357 32247 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.524998 32125 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.525151 32047 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.542219 32528 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:05.526911 32507 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.542938 32598 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:05.612965 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 186540us
I20260709 13:10:05.530365 32572 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.531150 32499 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.550134 32500 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.531445 32463 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.607040 32156 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:05.629078 32562 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.654528 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:05.640594 32403 ts_tablet_manager.cc:1403] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 2.110s	user 0.045s	sys 0.015s
I20260709 13:10:05.656829 30559 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:05.703884 32507 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.704537 32507 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.705025 32507 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.707688 32247 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.708374 32247 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:05.708907 32247 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.709808 32107 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:05.710199 32107 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:05.710985 32107 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.711894 32107 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:05.713337 32540 consensus_meta.cc:287] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
I20260709 13:10:05.715519 32434 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.716038 32500 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:05.716684 32500 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.688238 32562 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:05.718343 32606 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 13:10:05.719897 32562 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.664235 32530 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:05.697602 32607 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:10:05.642532 32598 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.686235 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:05.726917 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 185659us
I20260709 13:10:05.734180 30555 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:05.664415 30553 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 3: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:05.688784 32493 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:05.639137 32471 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:05.761054 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 179663us
I20260709 13:10:05.764350 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:05.733511 32434 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:05.735296 32574 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:05.772308 30449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.030s
I20260709 13:10:05.771232 32434 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:05.772998 32267 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:05.778769 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:05.780757 32247 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:05.780970 32047 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:05.787179 32610 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:10:05.787611 32609 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:05.790321 30484 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:05.735140 32562 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:10:05.793664 32507 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:05.755153 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 327635us
W20260709 13:10:05.825203 32565 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.006s
W20260709 13:10:05.806628 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.015s	sys 0.030s
I20260709 13:10:05.758069 32558 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:10:05.834929 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.822054 32403 raft_consensus.cc:359] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:05.835474 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 71198.3us
W20260709 13:10:05.858711 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.862713 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:05.863260 30411 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:05.875329 30409 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.875599 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:05.876248 31153 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:05.829041 32564 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:05.835808 32605 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:10:05.881368 30410 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:05.878404 30409 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:05.884786 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.885176 30410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53716
I20260709 13:10:05.885879 30410 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.886324 30410 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:05.823252 32267 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.796017 32156 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.897935 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.905208 30411 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:05.929103 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:05.881475 32488 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:05.858625 32073 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.835492 32544 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.895679 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.858875 32560 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:05.858980 32070 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:05.972535 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.912806 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:05.914139 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:05.975605 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61542.7us
I20260709 13:10:05.878353 32572 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.893113 32528 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:05.922880 30410 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.959518 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.983803 30411 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:05.985072 30411 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:05.964376 30374 leader_election.cc:400] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:05.987146 30374 leader_election.cc:403] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:10:05.987123 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 74402.9us
I20260709 13:10:05.898797 32621 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:05.912240 32564 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:05.918107 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:05.918956 32403 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:10:05.861634 32434 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:05.967983 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 310492us
I20260709 13:10:05.859400 32540 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:05.959061 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.004972 30410 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.965644 32486 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:05.979700 30450 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:05.956899 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:05.919487 32620 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:05.989948 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:06.023732 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:05.990795 32598 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:05.978134 32074 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:10:06.027242 30553 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:10:06.029403 32622 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:06.028970 32488 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.979732 30409 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:06.007334 32528 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.008386 32247 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.009955 32181 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:06.020893 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:05.990001 32572 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.031499 32403 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:06.032274 32572 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.033591 32403 ts_tablet_manager.cc:1434] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.308s	user 0.006s	sys 0.003s
I20260709 13:10:06.005837 32560 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:05.984000 32612 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:05.977697 32070 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:06.034545 32572 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:05.977043 32073 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.004865 32047 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:06.046408 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.050945 30552 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:06.046888 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:06.047199 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.047772 30404 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:06.059686 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.073745 30406 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:06.022451 32574 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:06.077515 30555 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
W20260709 13:10:06.079609 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.080750 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:06.082356 30555 pending_rounds.cc:85] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 3
I20260709 13:10:06.082799 30551 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.082793 30555 pending_rounds.cc:107] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
W20260709 13:10:06.084256 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91036.8us
I20260709 13:10:06.090269 30555 raft_consensus.cc:2917] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:10:05.977362 32544 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:06.103720 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 140017us
I20260709 13:10:06.117271 30403 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:10:06.035279 32560 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.042045 32500 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:05.995774 32564 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.037772 32612 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:06.041708 32617 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:06.120127 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.013677 32540 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.139861 30555 raft_consensus.cc:2889] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.141021 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.059996 32047 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:06.073305 32598 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:06.148144 30411 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:06.151389 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.127857 32436 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.117620 32471 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.073561 30557 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:06.152779 30407 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:06.153285 31153 raft_consensus.cc:1217] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:10:06.142720 32500 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.080747 32107 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:10:05.993777 32621 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:06.142277 32623 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.183364 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.145190 32411 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:06.142123 32181 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:10:06.156559 32598 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.187155 31153 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:06.157517 32047 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.156530 32247 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.206844 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.206984 30551 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:06.190516 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.157089 32617 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:06.186270 32500 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.193295 32074 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:06.237084 32626 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
W20260709 13:10:06.238531 32630 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:06.248855 30402 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:06.223701 32598 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.251502 32636 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:06.251796 32650 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:06.194160 32629 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:06.255918 32646 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:06.261564 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.262042 32247 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.265573 32073 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.266870 32125 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.267923 32617 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.269421 32477 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:06.192382 32267 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.216029 32411 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.250548 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.223407 32615 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:06.193009 32471 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.272413 32181 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.207819 32623 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.294833 32074 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.293327 32565 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:06.261618 32612 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.421147 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:06.485713 30555 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:06.451258 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 453026us
I20260709 13:10:06.487578 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.439669 30409 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:10:06.480854 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 329523us
I20260709 13:10:06.488818 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:06.366844 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.327781 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.436218 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:06.500284 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.501824 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.504899 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:06.507393 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:06.326839 32629 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.515271 32629 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.516276 32047 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.516877 32623 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.517529 30551 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:06.518404 32623 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:06.333406 32486 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.524648 32074 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.325508 32650 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.525414 32486 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.525800 32486 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.526152 32486 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.434456 32576 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:06.428061 32247 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.424604 32544 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.519990 32047 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.521023 32564 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.332213 32107 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:06.540271 32107 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:06.521096 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.543188 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:06.520025 30404 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:06.521781 31118 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.972s (SENT) [suppressed 13 similar messages]
I20260709 13:10:06.327528 32646 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.348728 32159 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.522843 32621 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.523123 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 371) took 1237 ms. Trace:
I20260709 13:10:06.523506 32644 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:06.420825 32649 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:06.496577 32574 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.423749 32635 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:10:06.321053 32488 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.537019 30559 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:06.534966 32576 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:06.538280 32650 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.538206 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.503687 32181 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.490927 32573 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.547236 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.421900 32636 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:06.521337 32073 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:06.320029 32392 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:06.564989 32649 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:06.511756 32493 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:06.551108 30553 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:10:06.560190 30555 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:06.532982 32125 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.566277 31149 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:06.559478 32507 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:06.503376 32565 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.508965 32477 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.566288 32646 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.548008 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:06.591050 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-3d180da17ba548e0ab1ebdfa7dfc1f0a received from {username='slave'} at 127.0.0.1:53492
W20260709 13:10:06.650314 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 102391us
W20260709 13:10:06.599123 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 327982us
I20260709 13:10:06.560667 32159 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.633040 30553 pending_rounds.cc:85] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:06.638384 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:06.593963 32463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.027s
I20260709 13:10:06.583935 32650 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.585949 32107 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.583885 32540 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.585841 32644 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.558881 32629 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:10:06.572978 32574 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.579677 32488 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.635829 32074 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.636644 32518 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:06.632120 32047 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.631912 32562 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.641655 32507 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.748615 32507 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.749017 32488 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.592018 32573 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.726962 32650 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.752175 32573 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.682416 30553 pending_rounds.cc:107] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:10:06.752547 32650 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.752938 30553 raft_consensus.cc:2889] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.595124 32636 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:06.711615 30524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.015s
W20260709 13:10:06.712630 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 207802us
W20260709 13:10:06.794816 30524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.000s	sys 0.016s
I20260709 13:10:06.633000 32392 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:06.713726 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 75430.5us
W20260709 13:10:06.687914 32463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.028s
W20260709 13:10:06.731139 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 43678.7us
I20260709 13:10:06.681457 32645 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:06.742017 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.686751 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-3d180da17ba548e0ab1ebdfa7dfc1f0a on tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:06.736622 30523 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:06.559254 31148 rpcz_store.cc:276] 0709 13:10:05.285465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.313862 (+ 28397us) service_pool.cc:224] Handling call
0709 13:10:05.314282 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.499107 (+184825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.506673 (+  7566us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.542739 (+ 36066us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.959751 (+417012us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:05.969047 (+  9296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.972095 (+  3048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.236419 (+264324us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:06.522815 (+286396us) raft_consensus.cc:1685] finished
0709 13:10:06.522839 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.523063 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162144,"raft.queue_time_us":173245,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7190,"spinlock_wait_cycles":6488320,"thread_start_us":300789,"threads_started":1,"wal-append.queue_time_us":429766}
I20260709 13:10:06.745361 32047 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.746170 32562 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:06.810077 32436 consensus_meta.cc:287] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 13:10:06.748160 32574 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.874033 32565 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.877344 32181 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:06.682956 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 161199us
I20260709 13:10:06.781186 30404 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:06.878539 32493 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.788472 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:06.879618 30407 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:06.879264 32493 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.737494 32644 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.800364 32159 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.833391 32573 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:10:06.881794 32644 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.801514 32664 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.882032 32493 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.882532 32664 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:06.802287 32652 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:06.885260 32507 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.885263 32664 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:06.805100 32500 consensus_meta.cc:287] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.000s
I20260709 13:10:06.889369 32500 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.806375 32486 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:06.891670 32640 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.586s	user 0.002s	sys 0.000s
I20260709 13:10:06.892526 32486 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.781515 32657 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.894049 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:06.894658 30555 raft_consensus.cc:2376] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5. Re-sending same reply.
I20260709 13:10:06.753608 32655 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:06.809381 32392 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.807564 32477 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.814528 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:06.901113 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 86652.9us
I20260709 13:10:06.731695 32518 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:06.798228 32511 consensus_meta.cc:287] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.278s	user 0.014s	sys 0.000s
I20260709 13:10:06.726514 32125 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.907534 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.908068 32125 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:06.908815 32477 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.850069 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 113540us
I20260709 13:10:06.913425 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:06.729648 32107 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:10:06.846359 32596 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.860992 32670 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.861100 32434 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.867606 32613 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:06.909847 32573 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:06.869624 32598 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.000s
I20260709 13:10:06.869757 32471 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.815080 32645 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.870467 32463 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:06.872143 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.855836 32624 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:06.852361 32073 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:10:06.737679 32074 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.893385 32657 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.812726 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:06.896646 30553 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:06.958496 32573 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:06.895666 32655 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.908985 32125 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:06.651451 32576 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.989637 32627 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:06.990207 32576 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.851863 30376 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:06.991633 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 139852us
I20260709 13:10:06.992360 32655 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:06.992925 32655 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:06.868129 32562 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.993943 32636 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.995666 32500 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.985280 32573 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.906636 32486 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.916085 32181 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.965621 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:06.965693 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:06.967669 30556 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:06.924306 32650 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:06.969805 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.930200 32107 consensus_queue.cc:1243] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:06.956543 32644 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.732151 32649 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.979758 30555 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:06.959584 32461 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.929355 32613 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:06.966717 32598 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.050875 32613 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.051862 32613 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:07.051921 32564 raft_consensus.cc:1064] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:10:07.052111 32598 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:06.899605 32664 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.054939 32664 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.033263 32650 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:07.056293 32650 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.057030 32664 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.057946 32107 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.065021 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:07.066097 30405 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:07.067956 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.069041 30405 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:07.070840 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.073092 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.073863 30410 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:06.925139 32659 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:06.961282 32156 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.969544 32047 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:06.963824 32392 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.963706 32645 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:07.035529 32540 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.982535 32614 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:06.988754 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1287) took 1109 ms. Trace:
I20260709 13:10:06.989251 32616 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.923810 32477 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:07.028244 32669 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:10:07.035720 32181 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:06.929767 32670 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.035873 30450 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:07.112699 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 76907.6us
I20260709 13:10:07.038368 32644 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.039857 32074 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.114604 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:07.041675 32657 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.035214 32486 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.044885 32590 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:07.108579 31145 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:06.986366 32507 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.049410 32461 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.127398 30407 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:07.030439 32562 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.080677 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1561) took 1016 ms. Trace:
I20260709 13:10:07.081645 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.081928 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.084616 30405 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:07.098825 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.926304 32596 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.104521 30408 rpcz_store.cc:276] 0709 13:10:05.879043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.880126 (+  1083us) service_pool.cc:224] Handling call
0709 13:10:05.880458 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.192088 (+311630us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:06.211525 (+ 19437us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.434247 (+222722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.434300 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:06.434356 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.988547 (+554191us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54002a58d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:06.988591 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.988698 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30237,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":83993,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"spinlock_wait_cycles":716002560,"thread_start_us":222386,"threads_started":1,"wal-append.queue_time_us":424944}
I20260709 13:10:07.105402 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.104095 32392 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.088610 32664 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.977898 32512 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:10:07.100134 32156 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.154920 32664 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.029978 32655 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:07.156806 32156 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.156534 32655 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.156963 32486 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.117655 32499 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:07.157462 32664 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.157629 32499 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:07.158052 32499 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:07.158258 31147 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:07.159502 32392 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.160034 32461 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.160563 32562 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.161295 32573 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.109015 32614 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.165398 32614 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.121963 32590 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:07.166656 32590 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.168133 32590 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:07.162608 32562 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.149276 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.174991 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.176355 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.151292 32623 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:07.177614 30410 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:07.177299 32623 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.179068 30409 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:07.148941 30404 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:07.180140 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.180812 30404 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:07.181195 32596 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.181710 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.183511 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:07.184334 32644 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:07.178058 32499 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:07.108541 32616 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.117937 32073 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.121042 32672 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:07.153875 32181 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.120787 32621 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:07.107916 32540 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.096280 32659 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:05.096686 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.185617 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:07.796471 32477 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:07.352243 30307 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 188) took 14124 ms (client timeout 15000 ms). Trace:
W20260709 13:10:07.547853 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.132701 30406 rpcz_store.cc:276] 0709 13:10:06.064698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.250714 (+186016us) service_pool.cc:224] Handling call
0709 13:10:06.250977 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.534236 (+283259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:06.559903 (+ 25667us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.656198 (+ 96295us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18001ade80. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:10:06.846800 (+190602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.846851 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:06.846895 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.080469 (+233574us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540012a2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:07.080523 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.080624 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64534,"prepare.queue_time_us":24768,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":56411,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3667,"spinlock_wait_cycles":685917696,"thread_start_us":137746,"threads_started":1,"wal-append.queue_time_us":313217}
I20260709 13:10:07.785334 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1554) took 1740 ms. Trace:
I20260709 13:10:07.189548 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:07.853989 30409 pending_rounds.cc:85] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 2
I20260709 13:10:07.854525 30409 pending_rounds.cc:107] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:07.854266 30411 rpcz_store.cc:276] 0709 13:10:06.044779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.059439 (+ 14660us) service_pool.cc:224] Handling call
0709 13:10:07.785127 (+1725688us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b54003ef154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:07.785265 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201839360}
W20260709 13:10:07.454829 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 609242us
I20260709 13:10:07.856949 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:07.196691 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:07.858713 30410 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:07.862026 32499 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.862134 32073 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.862962 32499 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.863519 32499 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.865432 32616 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.865778 32499 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.866160 32670 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:07.854992 30409 raft_consensus.cc:2889] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:07.904862 30403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.034s	sys 0.094s
W20260709 13:10:07.905987 30403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.035s	sys 0.094s
W20260709 13:10:07.790423 32656 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.009s	user 0.006s	sys 0.002s
W20260709 13:10:07.791795 32660 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.915s	user 0.001s	sys 0.000s
W20260709 13:10:07.793079 32668 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.919s	user 0.000s	sys 0.002s
W20260709 13:10:07.918685 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61809us
I20260709 13:10:07.327636 32596 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.920161 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.920351 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 52291.4us
I20260709 13:10:07.118988 32598 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.775s
I20260709 13:10:07.747862 32471 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:07.731454 32638 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:07.549027 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:07.427058 32486 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:07.852384 32672 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.852340 30307 rpcz_store.cc:269] 0709 13:09:53.228339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.228563 (+   224us) service_pool.cc:224] Handling call
0709 13:09:53.499772 (+271209us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:10:07.352165 (+13852393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:02.406191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:02.451353 (+ 45162us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:02.451431 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:10:02.451458 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:02.479699 (+ 28241us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:02.498178 (+ 18479us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:02.500086 (+  1908us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:02.510089 (+ 10003us) tablet.cc:701] Row locks acquired
0709 13:10:02.527057 (+ 16968us) write_op.cc:260] PREPARE: finished
0709 13:10:02.531026 (+  3969us) write_op.cc:270] Start()
0709 13:10:02.531181 (+   155us) write_op.cc:276] Timestamp: P: 1783602602530955 usec, L: 0
0709 13:10:02.531218 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:10:02.531981 (+   763us) log.cc:844] Serialized 2325 byte log entry
0709 13:10:02.797786 (+265805us) op_driver.cc:464] REPLICATION: finished
0709 13:10:02.952241 (+154455us) write_op.cc:301] APPLY: starting
0709 13:10:02.952400 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:02.952651 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:02.952845 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:02.974753 (+ 21908us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:02.978334 (+  3581us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:10:02.978399 (+    65us) write_op.cc:312] APPLY: finished
0709 13:10:02.978778 (+   379us) log.cc:844] Serialized 46 byte log entry
0709 13:10:02.978972 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.980712 (+  1740us) write_op.cc:454] Released schema lock
0709 13:10:02.980777 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:02.981204 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.981238 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2461,"reported_tablets":28,"spinlock_wait_cycles":229250944,"child_traces":[["op",{"apply.queue_time_us":110439,"apply.run_cpu_time_us":4095,"apply.run_wall_time_us":45649,"num_ops":5,"prepare.queue_time_us":94547,"prepare.run_cpu_time_us":12526,"prepare.run_wall_time_us":189732,"raft.queue_time_us":162114,"raft.run_cpu_time_us":10805,"raft.run_wall_time_us":65388,"replication_time_us":247172,"thread_start_us":271491,"threads_started":4,"wal-append.queue_time_us":63743,"wal-append.run_cpu_time_us":57381,"wal-append.run_wall_time_us":1390541}]]}
I20260709 13:10:07.911909 32461 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.866672 32621 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:07.908447 32613 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.001s
W20260709 13:10:07.797094 32671 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.927s	user 0.001s	sys 0.000s
I20260709 13:10:07.579097 32074 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.803679 32655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.034s	sys 0.070s
I20260709 13:10:07.407752 32664 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:07.889283 32125 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.887629 32181 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.887899 32625 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:07.397197 32623 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.433368 32576 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.514210 32267 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:07.977840 32664 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.926671 32616 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.960065 32461 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.997879 32664 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:07.997529 32616 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.999040 32461 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.996698 32267 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:07.954409 32392 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:10:07.999682 32659 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.001142 32267 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.004055 32616 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:07.996618 32576 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.006623 31153 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:08.008126 32576 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.961196 32672 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:08.011860 32621 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.012158 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 205) took 1701 ms. Trace:
I20260709 13:10:08.012537 30551 rpcz_store.cc:276] 0709 13:10:06.311094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.311199 (+   105us) service_pool.cc:224] Handling call
0709 13:10:06.311414 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.517919 (+206505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.011949 (+1494030us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54003f2354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:08.012102 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473613696}
I20260709 13:10:07.960752 32486 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.016714 32486 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:07.974486 32613 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:07.970206 32074 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.936189 32644 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:08.018785 32616 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:08.019219 32616 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:07.956018 32471 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.019965 32074 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.804388 32573 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.129211 32564 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:07.972541 32655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.035s	sys 0.079s
I20260709 13:10:07.946354 32434 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:07.995537 32411 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:07.926577 32596 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:07.956993 32638 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.031342 32644 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:08.020051 32616 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:08.045367 30377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.028s
I20260709 13:10:08.040486 32540 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:08.048228 30377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.028s
I20260709 13:10:07.992975 32181 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:08.046075 32645 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.938s	user 0.007s	sys 0.003s
W20260709 13:10:07.973313 32436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.029s	sys 0.031s
I20260709 13:10:08.072718 32181 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.073549 32573 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:07.988059 32125 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.082530 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:08.089939 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:08.020893 32625 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.083765 32572 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.117079 32572 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.119736 32572 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.120460 32572 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:08.120884 32572 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.121270 32572 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:08.083452 32576 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:08.123277 32576 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.125792 32576 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.085516 32499 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.079887 32074 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.096655 32573 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:08.098798 32682 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.099398 32590 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.931s	user 0.011s	sys 0.000s
I20260709 13:10:08.087576 32670 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.086620 32518 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.087786 32598 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.084467 32645 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.105989 32596 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.110523 32638 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.111346 32471 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.113448 32125 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:08.079875 32436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.030s	sys 0.031s
I20260709 13:10:08.139003 32518 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.134658 32499 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:08.150600 32634 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.933s	user 0.008s	sys 0.000s
I20260709 13:10:08.151338 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1562) took 2073 ms. Trace:
I20260709 13:10:08.132216 32576 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:08.167357 30450 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:08.151737 30402 rpcz_store.cc:276] 0709 13:10:06.078916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.309189 (+230273us) service_pool.cc:224] Handling call
0709 13:10:06.309586 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.525527 (+215941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.525559 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.526016 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.685033 (+159017us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:06.685070 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.150937 (+1465867us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002f58d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:08.150982 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.151033 (+    51us) raft_consensus.cc:1685] finished
0709 13:10:08.151046 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.151278 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3430,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13968,"spinlock_wait_cycles":495882112,"thread_start_us":158668,"threads_started":1,"wal-append.queue_time_us":218264,"wal-append.run_cpu_time_us":2057,"wal-append.run_wall_time_us":1133211}
I20260709 13:10:08.185667 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.187240 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.137159 32074 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.139506 32670 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.142799 32598 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.140154 32682 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.185858 32596 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:08.184432 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.194418 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.195726 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.196353 30410 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:08.192238 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1566) took 1111 ms. Trace:
I20260709 13:10:08.197614 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.197695 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.200407 30557 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:08.200287 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.201262 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.201933 30553 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:08.202569 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.203474 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.195753 30402 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:08.204133 30559 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:08.209129 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.209395 30411 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:08.204048 30557 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:10:08.210368 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 269309us
I20260709 13:10:08.210638 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.211584 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:08.211853 30557 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:08.204035 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.213269 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.214354 30558 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:08.197338 30403 rpcz_store.cc:276] 0709 13:10:07.080360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.081032 (+   672us) service_pool.cc:224] Handling call
0709 13:10:07.102379 (+ 21347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.102636 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:07.116184 (+ 13548us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.908377 (+792193us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.191921 (+283544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.191982 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:08.192031 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.192091 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.192189 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1636,"prepare.queue_time_us":13387,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":205149,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":5305,"thread_start_us":1074088,"threads_started":2,"wal-append.queue_time_us":884879}
I20260709 13:10:08.190829 32499 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.207237 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.203168 30552 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:10:08.231462 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:08.212965 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:08.234064 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:08.198002 32436 raft_consensus.cc:1064] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:10:08.196300 32596 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:08.194936 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.280444 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:08.199110 32181 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.196408 32625 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.261677 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:08.340302 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59957.9us
I20260709 13:10:08.247678 30560 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:08.204785 32125 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.217123 32644 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:08.335803 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.342334 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:08.338550 30585 heartbeater.cc:646] Failed to heartbeat to 127.28.152.62:45705 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.152.62:45705 timed out after 15.000s (SENT)
I20260709 13:10:08.259126 32659 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.355911 32659 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.328997 32573 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.251192 32683 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:08.358059 32659 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.357919 32683 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.349920 32392 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:08.359066 32392 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.359433 32392 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.360049 32683 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.363931 32670 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.365312 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.351929 32125 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.262257 32434 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:08.316704 32507 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:08.375432 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1314) took 1289 ms. Trace:
W20260709 13:10:08.380589 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.375821 30404 rpcz_store.cc:276] 0709 13:10:07.086504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.797073 (+710569us) service_pool.cc:224] Handling call
0709 13:10:07.797443 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.873202 (+ 75759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.873245 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.873957 (+   712us) log.cc:844] Serialized 52 byte log entry
0709 13:10:08.192710 (+318753us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:08.192764 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.192870 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.375227 (+182357us) raft_consensus.cc:1685] finished
0709 13:10:08.375243 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.375380 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106762,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":23691,"thread_start_us":235129,"threads_started":1,"wal-append.queue_time_us":426435}
I20260709 13:10:08.302033 30410 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:10:08.216563 32540 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.344895 30406 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:08.318158 32596 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:08.365023 32598 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.314215 32614 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:10:08.394286 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.373932 32434 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.392824 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.325745 32569 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:08.396693 30404 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:08.313648 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.391304 32670 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.403630 31152 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:08.392717 32540 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.411495 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.422045 30402 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 3.
I20260709 13:10:08.416571 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.382514 32507 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.349541 32181 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.426064 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.390902 32645 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.436355 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.437448 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.438170 30406 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:08.444317 32683 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:08.444924 32683 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.412222 32576 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.390337 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.412535 32598 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.430104 32507 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:08.435724 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.462970 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.457728 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 306) took 2353 ms. Trace:
I20260709 13:10:08.413590 32434 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:08.431814 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 337943us
I20260709 13:10:08.429438 32499 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.474784 32125 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.475055 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1319) took 1305 ms. Trace:
I20260709 13:10:08.496125 30554 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:08.497480 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.503512 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.514154 30409 rpcz_store.cc:276] 0709 13:10:07.169531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.853455 (+683924us) service_pool.cc:224] Handling call
0709 13:10:07.853800 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.914307 (+ 60507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.914358 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.915024 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.258456 (+343432us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:08.258500 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.258566 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.474856 (+216290us) raft_consensus.cc:1685] finished
0709 13:10:08.474877 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.474997 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":275402,"threads_started":1,"wal-append.queue_time_us":489395}
I20260709 13:10:08.506385 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.476300 32074 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.475445 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.524040 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:08.508343 32156 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:08.524909 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.429802 32670 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.518258 32499 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.498382 32598 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.497422 31145 rpcz_store.cc:276] 0709 13:10:06.104433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.117963 (+ 13530us) service_pool.cc:224] Handling call
0709 13:10:06.184860 (+ 66897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.126886 (+942026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.457333 (+1330447us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54004f3dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:08.457609 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099405184}
I20260709 13:10:08.547469 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.548346 30554 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:08.496105 31144 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:10:08.535251 32672 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 13:10:08.517910 32650 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.501258 32645 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:08.478550 32576 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.529282 32573 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.598330 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:08.599130 31147 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:08.599808 32645 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:08.600383 32645 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:08.603165 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 69955.4us
I20260709 13:10:08.546346 32697 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.586889 32392 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.623809 32540 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.614161 32573 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.625797 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1310) took 1556 ms. Trace:
I20260709 13:10:08.604104 32650 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.626195 30407 rpcz_store.cc:276] 0709 13:10:07.069669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.070536 (+   867us) service_pool.cc:224] Handling call
0709 13:10:08.625616 (+1555080us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b5400209754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:08.625732 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128232192}
W20260709 13:10:08.597482 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 69103.5us
I20260709 13:10:08.602547 32645 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:08.633042 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 109054us
I20260709 13:10:08.637009 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.637687 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.638469 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.640323 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:08.644672 30407 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:08.645709 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:08.646256 30407 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:08.653597 30407 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:08.603050 32693 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:08.657100 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:08.657485 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.658056 30410 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:08.657900 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.657055 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:08.665436 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.595631 32672 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.667375 32645 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.682518 32181 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.682411 32645 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.684190 32156 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:08.684906 32645 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.686790 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.687714 30410 raft_consensus.cc:2410] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:10:08.679842 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:08.689342 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:08.703150 32698 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:10:08.703652 32518 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 13:10:08.703366 32697 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:08.704227 32518 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:08.704628 32518 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.705018 32518 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:08.705960 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.706871 30403 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:08.708527 32684 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.709226 32684 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.656845 32540 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:08.710613 32540 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:08.711146 32540 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:08.712572 32573 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.668061 32693 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:08.715377 32701 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:08.718647 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.716396 30404 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:08.678099 32612 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.723423 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.681565 32461 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.685293 32507 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:08.723841 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 199335us
I20260709 13:10:08.644457 32392 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.668392 32685 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:08.742882 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:08.746188 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.742601 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:08.757122 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.746583 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:08.748255 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1317) took 1630 ms. Trace:
I20260709 13:10:08.762400 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:08.757838 32672 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.774989 30405 rpcz_store.cc:276] 0709 13:10:07.117386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.803456 (+686070us) service_pool.cc:224] Handling call
0709 13:10:07.853224 (+ 49768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.888493 (+ 35269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.888542 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.889178 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.335291 (+446113us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:08.335348 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.335446 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.408064 (+ 72618us) raft_consensus.cc:1685] finished
0709 13:10:08.408084 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.748033 (+339949us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54002a67d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:08.748203 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34817,"raft.queue_time_us":144860,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":113588608,"thread_start_us":445740,"threads_started":1,"wal-append.queue_time_us":503294}
I20260709 13:10:08.780647 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:08.741003 32690 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 13:10:08.796129 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 217) took 1765 ms. Trace:
I20260709 13:10:08.735827 32670 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.796552 30556 rpcz_store.cc:276] 0709 13:10:07.031061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.031202 (+   141us) service_pool.cc:224] Handling call
0709 13:10:07.031617 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.797550 (+765933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.797594 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.798169 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.311976 (+513807us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:08.312036 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.754420 (+442384us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000ee2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:08.754470 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.795812 (+ 41342us) raft_consensus.cc:1685] finished
0709 13:10:08.795834 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.796065 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":672453,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":516,"spinlock_wait_cycles":233585024,"thread_start_us":396467,"threads_started":1,"wal-append.queue_time_us":483573}
I20260709 13:10:08.794359 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.799762 32507 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.800001 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.800697 30551 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:08.749500 32683 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.737593 32576 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.803382 32592 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.785653 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:08.804064 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.804245 30403 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.804809 30482 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:08.792688 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.739890 32693 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.733801 32612 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.806766 32672 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.759177 32596 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.807345 32672 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.808928 32612 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:08.809393 32672 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:08.809669 32572 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.007s
I20260709 13:10:08.809957 32672 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:08.806457 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.810678 30554 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:08.803930 32592 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.811110 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.811669 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.811983 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.812319 30554 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:08.812654 30477 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:08.806457 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.801599 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.813737 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.814366 30479 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:08.814844 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.815747 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.810250 32572 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.812716 32592 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.747365 32649 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.799642 32540 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.859995 32540 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.851194 32518 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:08.817157 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.817458 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.304522 30480 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.305625 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.306424 30480 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:08.819142 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.816466 30551 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:08.813303 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.346153 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.346828 30554 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:09.347846 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:08.815846 30560 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:09.351665 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:09.352596 30560 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.353494 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.354146 30560 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
W20260709 13:10:08.783078 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.820533 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.375746 30477 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:09.376792 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:08.785951 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:09.381866 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 595968us
I20260709 13:10:08.808971 32596 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.844691 32598 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.827239 30483 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:08.803659 32576 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.816460 32392 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:09.417186 32471 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.417665 32392 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:09.417835 32471 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.418771 32392 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.420265 32471 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:08.737082 32650 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:08.810529 32672 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:08.946435 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.008244 30481 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:09.423300 30481 pending_rounds.cc:85] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 1
I20260709 13:10:09.423324 30411 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:09.423733 30481 pending_rounds.cc:107] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:09.424036 30481 raft_consensus.cc:2889] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.008291 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.424860 30478 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
W20260709 13:10:09.019692 30452 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34032 dropped due to backpressure: service queue is full with 50 items
W20260709 13:10:09.026620 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.737679 32461 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.081307 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:09.106127 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 307698us
I20260709 13:10:09.108952 30403 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:10:09.111176 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.128966 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:09.433534 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 304624us
I20260709 13:10:09.168606 30479 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:09.188470 32434 consensus_meta.cc:287] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.002s
W20260709 13:10:09.203924 30451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.020s
I20260709 13:10:09.213714 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.435182 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.435442 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.436169 30478 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:08.784503 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.224646 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.454437 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1314) took 1207 ms. Trace:
I20260709 13:10:09.454777 30557 rpcz_store.cc:276] 0709 13:10:08.247310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.389217 (+141907us) service_pool.cc:224] Handling call
0709 13:10:09.224421 (+835204us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:09.454379 (+229958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7680768}
I20260709 13:10:09.455611 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.231178 30484 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:09.232363 32518 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.232996 32070 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:09.238400 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.244623 30408 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:09.245493 30406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.019s
W20260709 13:10:09.468686 30406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.008s	sys 0.020s
I20260709 13:10:09.247233 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:09.253468 32499 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:09.262986 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 219) took 2080 ms. Trace:
I20260709 13:10:09.264237 32477 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.264820 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.272927 32073 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:09.277189 32684 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.279124 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:09.280555 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:09.537426 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.291810 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.539793 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1313) took 1322 ms. Trace:
I20260709 13:10:09.540251 30558 rpcz_store.cc:276] 0709 13:10:08.217653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.218589 (+   936us) service_pool.cc:224] Handling call
0709 13:10:09.291650 (+1073061us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:09.539708 (+248058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9913600}
W20260709 13:10:09.297801 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.309494 30486 raft_consensus.cc:2410] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:09.311168 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.542755 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1501) took 1161 ms. Trace:
I20260709 13:10:09.543188 30551 rpcz_store.cc:276] 0709 13:10:08.380968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.310622 (+929654us) service_pool.cc:224] Handling call
0709 13:10:09.542662 (+232040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.316473 32572 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.321271 30410 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:09.459956 32181 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.323333 32682 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.330344 32616 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:09.332418 32658 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 2.449s	user 0.013s	sys 0.001s
I20260709 13:10:09.580395 32672 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:09.341053 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.341456 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 222) took 1088 ms. Trace:
I20260709 13:10:09.582973 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:09.583360 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.583860 30558 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.385110 32156 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.393519 30554 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.398653 32688 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.402765 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.586372 30477 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.586671 30480 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:09.408483 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.587292 30560 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:09.415818 32436 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:09.406605 32657 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.404649 32576 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.439149 32434 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.441905 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:09.435164 30451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.013s	sys 0.020s
I20260709 13:10:09.435883 30485 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:09.450500 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:09.604528 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 924726us
I20260709 13:10:09.452072 30404 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:09.436861 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:09.459556 32650 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:09.458866 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:09.607266 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 148473us
I20260709 13:10:09.471586 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.609170 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1491) took 1231 ms. Trace:
I20260709 13:10:09.609599 30557 rpcz_store.cc:276] 0709 13:10:08.377926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.471360 (+1093434us) service_pool.cc:224] Handling call
0709 13:10:09.609097 (+137737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.456642 32598 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:09.470472 30555 rpcz_store.cc:276] 0709 13:10:07.182822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.183304 (+   482us) service_pool.cc:224] Handling call
0709 13:10:07.183609 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.905170 (+721561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.905227 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.906015 (+   788us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.236535 (+1330520us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b180003d480. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:09.254905 (+ 18370us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.262336 (+  7431us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.262543 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.262630 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.262667 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:09.262779 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.262927 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":720857,"prepare.queue_time_us":6865,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":736602,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":13431,"spinlock_wait_cycles":22319488,"thread_start_us":25254,"threads_started":2,"wal-append.queue_time_us":1335719}
I20260709 13:10:09.506049 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.614519 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.425593 30452 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34032 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1507)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1616)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1618)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1600)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1601)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1602)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1610)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1615)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1619)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 168)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 169)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 174)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 175)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1506)
I20260709 13:10:09.281376 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 223) took 1027 ms. Trace:
I20260709 13:10:09.471256 32655 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.574769 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.583180 30552 rpcz_store.cc:276] 0709 13:10:08.253330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.253470 (+   140us) service_pool.cc:224] Handling call
0709 13:10:09.340746 (+1087276us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:09.340950 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.341133 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.341162 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.341206 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:09.341241 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.341295 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.341406 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9183488}
I20260709 13:10:09.617024 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1513) took 1140 ms. Trace:
I20260709 13:10:09.533803 32070 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:09.583990 30478 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.584424 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1493) took 1206 ms. Trace:
I20260709 13:10:09.624708 30558 rpcz_store.cc:276] 0709 13:10:08.378402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.541381 (+1162979us) service_pool.cc:224] Handling call
0709 13:10:09.584369 (+ 42988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.582957 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.587705 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1498) took 1207 ms. Trace:
I20260709 13:10:09.616400 30553 rpcz_store.cc:276] 0709 13:10:08.253657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.253785 (+   128us) service_pool.cc:224] Handling call
0709 13:10:09.280668 (+1026883us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:09.280853 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.281039 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.281082 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.281121 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.281154 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.281208 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.281325 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7807232}
I20260709 13:10:09.624577 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.587662 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.626299 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.626660 30480 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.599108 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1499) took 1218 ms. Trace:
W20260709 13:10:09.599723 30408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1315) took 2480 ms (client timeout 1807 ms). Trace:
W20260709 13:10:09.600049 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 815599us
I20260709 13:10:09.600232 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:09.611443 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 174671us
W20260709 13:10:09.627573 30408 rpcz_store.cc:269] 0709 13:10:07.116964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.176097 (+ 59133us) service_pool.cc:224] Handling call
0709 13:10:09.596848 (+2420751us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400285fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:09.596964 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4755149568}
I20260709 13:10:09.628029 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.628834 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:09.626519 30478 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:09.630614 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.630820 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.631316 30555 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.629904 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.631767 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:09.627027 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 195979us
I20260709 13:10:09.612764 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.636811 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.625631 30560 rpcz_store.cc:276] 0709 13:10:08.380188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.404100 (+1023912us) service_pool.cc:224] Handling call
0709 13:10:09.587658 (+183558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.613329 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.302587 30305 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.639427 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1516) took 1140 ms. Trace:
I20260709 13:10:09.639830 30557 rpcz_store.cc:276] 0709 13:10:08.499122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.610400 (+1111278us) service_pool.cc:224] Handling call
0709 13:10:09.639357 (+ 28957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.617543 30551 rpcz_store.cc:276] 0709 13:10:08.476971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.543978 (+1067007us) service_pool.cc:224] Handling call
0709 13:10:09.616952 (+ 72974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.619480 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.620502 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.640924 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.641191 30411 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:09.641458 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:09.621951 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.642526 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.491416 32477 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.641464 30557 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:09.643648 30482 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.644006 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1521) took 1117 ms. Trace:
I20260709 13:10:09.644320 30557 rpcz_store.cc:276] 0709 13:10:08.526254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.640682 (+1114428us) service_pool.cc:224] Handling call
0709 13:10:09.643957 (+  3275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.644841 32477 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.623442 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.644948 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.645624 30485 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:09.645738 30482 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.646461 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.647050 30485 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:09.647861 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.648556 30485 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:09.412248 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.650431 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:09.651474 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.652427 30483 raft_consensus.cc:2410] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:09.654327 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.656293 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.656865 30403 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:09.657835 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1573) took 1022 ms. Trace:
I20260709 13:10:09.627868 30486 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:09.645052 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.629851 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:09.658169 30406 rpcz_store.cc:276] 0709 13:10:08.635164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.636724 (+  1560us) service_pool.cc:224] Handling call
0709 13:10:08.664748 (+ 28024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.665033 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:09.469075 (+804042us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.657554 (+188479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.657600 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.657640 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.657697 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.657787 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200910,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"thread_start_us":935847,"threads_started":2}
I20260709 13:10:09.659405 30484 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:09.632237 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1503) took 1250 ms. Trace:
I20260709 13:10:09.660508 30484 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:09.628607 30477 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.660775 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.622592 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.660504 30552 rpcz_store.cc:276] 0709 13:10:08.381566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.629673 (+1248107us) service_pool.cc:224] Handling call
0709 13:10:09.632185 (+  2512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8704}
I20260709 13:10:09.661755 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.662144 30479 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:09.660698 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1494) took 1282 ms. Trace:
I20260709 13:10:09.662563 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.663185 30407 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:09.663537 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1505) took 1277 ms. Trace:
I20260709 13:10:09.663659 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1316) took 1248 ms. Trace:
I20260709 13:10:09.664130 30558 rpcz_store.cc:276] 0709 13:10:08.415028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.629631 (+1214603us) service_pool.cc:224] Handling call
0709 13:10:09.663612 (+ 33981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.639871 30305 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:09.665107 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.665853 30558 raft_consensus.cc:2410] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:09.597780 32156 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.675429 30478 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.654846 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:09.678082 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:09.662797 30555 rpcz_store.cc:276] 0709 13:10:08.378636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.630403 (+1251767us) service_pool.cc:224] Handling call
0709 13:10:09.660653 (+ 30250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.627130 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1514) took 1133 ms. Trace:
I20260709 13:10:09.679530 30553 rpcz_store.cc:276] 0709 13:10:08.493322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.626086 (+1132764us) service_pool.cc:224] Handling call
0709 13:10:09.627077 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.666103 30305 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.679853 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:09.663684 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58294.8us
I20260709 13:10:09.663902 30557 rpcz_store.cc:276] 0709 13:10:08.386584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.644861 (+1258277us) service_pool.cc:224] Handling call
0709 13:10:09.663481 (+ 18620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.680519 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:09.681156 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.681433 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:09.662739 30484 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:10:09.681727 30557 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:09.682152 30484 pending_rounds.cc:85] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 2
I20260709 13:10:09.682479 30484 pending_rounds.cc:107] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:10:09.682709 30484 raft_consensus.cc:2889] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.682832 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.678960 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:09.667270 30485 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:09.666643 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.667827 30479 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:09.684118 30558 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:09.668023 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:09.669615 30523 connection.cc:256] RPC call timeout handler was delayed by -1.0358081880000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:10:09.628576 32572 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:09.670682 32725 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:10:09.694306 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:09.671504 32461 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:09.672178 32434 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:09.672729 30556 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.706624 32471 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.680542 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:09.708070 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.708735 30555 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:09.603821 32688 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:09.574102 32181 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.615952 32682 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.681596 30305 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 6, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 6 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.723573 30305 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.724853 30480 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:09.725059 30305 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.689040 30477 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:09.689345 30484 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:09.689596 30482 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:09.691463 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.692118 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.692706 30479 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:09.629349 32655 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.696138 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:09.690511 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:09.674299 32658 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:09.698975 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.627506 30554 rpcz_store.cc:276] 0709 13:10:08.380418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.347571 (+967153us) service_pool.cc:224] Handling call
0709 13:10:09.599033 (+251462us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.685082 30523 connection.cc:256] RPC call timeout handler was delayed by -1.0138420350000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:10:09.710292 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.689088 32572 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.711794 30481 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:10:09.712970 32724 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:09.705291 32499 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:09.713606 32721 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:10:09.714100 32726 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:10:09.713575 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 224) took 1459 ms. Trace:
I20260709 13:10:09.674805 32694 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.682194 32156 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.681833 32650 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:09.619004 32657 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:09.703212 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 87042.1us
I20260709 13:10:09.735826 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 225) took 1419 ms. Trace:
I20260709 13:10:09.726547 30486 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:09.805742 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 151475us
W20260709 13:10:09.864740 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08001485a0 after lost signal to thread 29283
W20260709 13:10:09.842833 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.729635 30478 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:09.812536 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.897598 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.756469 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1492) took 1378 ms. Trace:
I20260709 13:10:09.899124 30556 rpcz_store.cc:276] 0709 13:10:08.378173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.264569 (+886396us) service_pool.cc:224] Handling call
0709 13:10:09.756217 (+491648us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54003093d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:09.756394 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456694144}
I20260709 13:10:09.899682 30555 rpcz_store.cc:276] 0709 13:10:08.254070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.712285 (+1458215us) service_pool.cc:224] Handling call
0709 13:10:09.712949 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.713155 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.713191 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.713259 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.713310 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.713379 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.713507 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.896863 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080030ffa0 after lost signal to thread 30343
I20260709 13:10:09.733114 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:09.901525 30560 raft_consensus.cc:2410] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:10:09.811347 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 211223us
I20260709 13:10:09.726080 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:09.903574 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 212185us
W20260709 13:10:09.904328 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.788856 30305 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 3 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:09.902067 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08003db080 after lost signal to thread 30435
I20260709 13:10:09.906649 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.907598 30484 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:09.688560 32672 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:09.907282 30305 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.802474 30477 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:09.696828 32684 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:09.907033 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080022eea0 after lost signal to thread 30436
I20260709 13:10:09.913389 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.914048 30482 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:10:09.914073 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 223543us
I20260709 13:10:09.915086 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.894021 30558 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:09.898358 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.894133 30552 rpcz_store.cc:276] 0709 13:10:08.316292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.735038 (+1418746us) service_pool.cc:224] Handling call
0709 13:10:09.735320 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.735494 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.735518 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.735561 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:09.735594 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.735651 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.735768 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.913596 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08003365e0 after lost signal to thread 30510
W20260709 13:10:09.917287 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800310340 after lost signal to thread 30511
I20260709 13:10:09.911758 30556 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:09.918251 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1496) took 1539 ms. Trace:
I20260709 13:10:09.904290 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:09.902091 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1500) took 1521 ms. Trace:
I20260709 13:10:09.918617 30556 rpcz_store.cc:276] 0709 13:10:08.379365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.900205 (+1520840us) service_pool.cc:224] Handling call
0709 13:10:09.900478 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.918018 (+ 17540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.918201 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.920128 30555 rpcz_store.cc:276] 0709 13:10:08.380645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.901411 (+1520766us) service_pool.cc:224] Handling call
0709 13:10:09.901666 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.901818 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.901841 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.901877 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.901903 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.901949 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.902041 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.918272 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800357220 after lost signal to thread 30584
I20260709 13:10:09.921121 30556 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:09.923050 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1508) took 1526 ms. Trace:
I20260709 13:10:09.924590 30556 rpcz_store.cc:276] 0709 13:10:08.414599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.920614 (+1506015us) service_pool.cc:224] Handling call
0709 13:10:09.920915 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.922777 (+  1862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.922992 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.732218 32727 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:09.926476 30554 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:10:09.932327 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.932507 30554 pending_rounds.cc:85] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 1
I20260709 13:10:09.932905 30554 pending_rounds.cc:107] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:09.927929 30484 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:10:09.933288 30554 raft_consensus.cc:2889] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.927778 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1515) took 1431 ms. Trace:
W20260709 13:10:09.925477 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3680 after lost signal to thread 31180
I20260709 13:10:09.933699 30484 pending_rounds.cc:85] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 4
W20260709 13:10:09.934113 30340 debug-util.cc:398] Leaking SignalData structure 0x7b080032d6e0 after lost signal to thread 31181
I20260709 13:10:09.934142 30484 pending_rounds.cc:107] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:10:09.934254 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1490) took 1556 ms. Trace:
I20260709 13:10:09.896179 32572 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.905530 32499 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.733314 32518 raft_consensus.cc:2764] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:09.938727 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.890669 32576 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:09.949550 30477 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:09.707254 32471 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.741032 32598 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.744645 32688 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:09.937071 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:09.939473 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:09.952292 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.957551 30481 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:09.934677 30484 raft_consensus.cc:2889] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.958359 30484 pending_rounds.cc:107] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:10:09.958446 30477 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:09.959702 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.960443 30484 raft_consensus.cc:2889] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.961788 32434 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:09.962283 32434 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.935151 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.913082 32714 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:09.938413 32672 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:09.946803 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.912647 32684 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.722867 32682 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:09.951138 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1589) took 1208 ms. Trace:
I20260709 13:10:09.968804 30402 rpcz_store.cc:276] 0709 13:10:08.742894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.283422 (+540528us) service_pool.cc:224] Handling call
0709 13:10:09.283691 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.284009 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.284036 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.284502 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.395758 (+111256us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.395800 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.395859 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.950931 (+555072us) raft_consensus.cc:1685] finished
0709 13:10:09.950959 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.951082 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2875,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":108322,"threads_started":1,"wal-append.queue_time_us":141149}
I20260709 13:10:09.951689 30480 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:09.909073 30305 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 2, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added, no longer has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:09.944797 32650 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:09.935132 30554 rpcz_store.cc:276] 0709 13:10:08.377498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.899407 (+1521909us) service_pool.cc:224] Handling call
0709 13:10:09.926149 (+ 26742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.933960 (+  7811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.934188 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.963456 30560 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:09.973188 30560 pending_rounds.cc:85] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 1
I20260709 13:10:09.973568 30560 pending_rounds.cc:107] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:09.973842 30560 raft_consensus.cc:2889] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.971488 30305 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.974545 32672 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.975409 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1520) took 1455 ms. Trace:
I20260709 13:10:09.975327 30305 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 4, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:09.975900 30560 rpcz_store.cc:276] 0709 13:10:08.519664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.947802 (+1428138us) service_pool.cc:224] Handling call
0709 13:10:09.963166 (+ 15364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.974473 (+ 11307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.974663 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.976788 30305 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.913736 32694 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.981416 30557 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:09.947099 32499 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.946125 32592 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.965082 30477 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:09.963013 30484 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:09.974951 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 223) took 1210 ms. Trace:
I20260709 13:10:09.989548 30405 rpcz_store.cc:276] 0709 13:10:08.764853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.394858 (+630005us) service_pool.cc:224] Handling call
0709 13:10:09.395220 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:09.399247 (+  4027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.399327 (+    80us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:09.405707 (+  6380us) log.cc:844] Serialized 52 byte log entry
0709 13:10:09.468894 (+ 63187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.468943 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.469007 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.974760 (+505753us) raft_consensus.cc:1685] finished
0709 13:10:09.974785 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.974899 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3736,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4670,"thread_start_us":61228,"threads_started":1,"wal-append.queue_time_us":91936}
I20260709 13:10:09.960224 32598 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.994062 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:09.994999 32747 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:09.995081 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:09.995837 32747 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:09.990387 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.958382 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:09.979359 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 196342us
I20260709 13:10:09.979216 30305 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 3 to 6, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:10.000787 30305 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:10.002507 31145 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:10.002076 30305 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:09.980286 30479 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:10.003741 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.967149 32434 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.005867 30477 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.006685 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.007606 30477 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.008759 30477 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:10.009939 30477 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:09.972122 32684 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:09.997112 32747 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:09.942618 30556 rpcz_store.cc:276] 0709 13:10:08.496826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.926660 (+1429834us) service_pool.cc:224] Handling call
0709 13:10:09.927345 (+   685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.927510 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.927532 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.927568 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:09.927596 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.927643 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.927732 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.014503 32073 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:10.020716 32598 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.004588 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:09.977679 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1523) took 1350 ms. Trace:
I20260709 13:10:09.973240 32682 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.974998 32650 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:10.003407 30305 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:10.026590 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1524) took 1392 ms. Trace:
W20260709 13:10:10.025696 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 99378.4us
I20260709 13:10:10.033084 30557 rpcz_store.cc:276] 0709 13:10:08.633799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.682624 (+1048825us) service_pool.cc:224] Handling call
0709 13:10:10.026424 (+343800us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000721d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:10.026524 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685376896}
I20260709 13:10:10.026846 30479 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:10.023955 30560 rpcz_store.cc:276] 0709 13:10:08.627163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.976729 (+1349566us) service_pool.cc:224] Handling call
0709 13:10:09.977069 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.977361 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.977399 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.977441 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:09.977475 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.977528 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.977632 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14118,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116}
I20260709 13:10:10.033125 30305 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.982395 32694 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:10.043699 30305 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 5 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.048175 30305 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.049852 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1509) took 1030 ms. Trace:
W20260709 13:10:10.050001 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 109812us
I20260709 13:10:10.050262 30478 rpcz_store.cc:276] 0709 13:10:09.019188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.631568 (+612380us) service_pool.cc:224] Handling call
0709 13:10:10.049677 (+418109us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b540017bbd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:10.049797 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99185024}
I20260709 13:10:10.052333 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.032398 32650 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:10.052738 30305 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 3 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 4 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.049795 32684 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.055143 32181 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.055706 32471 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.069617 32655 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.053483 32735 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:10:10.071390 32657 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.073266 32638 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:10.073123 32156 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:10.060763 30478 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.061280 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.079478 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1600) took 1068 ms. Trace:
I20260709 13:10:10.079950 30480 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.081140 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1506) took 1062 ms. Trace:
I20260709 13:10:10.064937 30305 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.068913 32729 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.049436 32694 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.063769 32684 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.080998 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.079995 30486 rpcz_store.cc:276] 0709 13:10:09.010570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.659108 (+648538us) service_pool.cc:224] Handling call
0709 13:10:09.726319 (+ 67211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.903300 (+176981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.079203 (+175903us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400213750. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:10.079400 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61696256}
I20260709 13:10:10.081504 30477 rpcz_store.cc:276] 0709 13:10:09.018390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.010571 (+992181us) service_pool.cc:224] Handling call
0709 13:10:10.078379 (+ 67808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.078550 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.078573 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.078610 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:10.078636 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.080988 (+  2352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.081092 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.082579 30305 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.088392 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.089596 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.089908 30480 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.090137 30305 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.091887 30305 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 2 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.096179 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.096652 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.097321 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.097635 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.098222 30486 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.098289 30480 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.099284 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.099907 30478 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:10.100672 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.096211 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.101548 30478 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:10.102396 30477 raft_consensus.cc:2410] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:10.060464 32650 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.102675 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:10.100514 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 103753us
I20260709 13:10:10.093536 30305 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 6, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:10.116052 30478 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
W20260709 13:10:10.116492 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 179526us
I20260709 13:10:10.107360 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.117624 30486 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:10.108896 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:10.053138 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 129170us
I20260709 13:10:10.116461 30305 catalog_manager.cc:5697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.124207 30305 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:10.126482 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74512.6us
I20260709 13:10:10.131178 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:10.131417 30305 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:10.137543 30480 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:10.137974 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.138809 30486 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.141533 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.141981 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:10.142818 30405 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:10.146770 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.147986 30486 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.150442 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:10.152251 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:10.153113 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:10.153295 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:10.153370 30403 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:10.164511 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1507) took 1775 ms. Trace:
I20260709 13:10:10.165058 30552 rpcz_store.cc:276] 0709 13:10:08.391835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.917269 (+1525434us) service_pool.cc:224] Handling call
0709 13:10:09.917531 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.917726 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:09.935855 (+ 18129us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.164068 (+228213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.164142 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:10.164205 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.164292 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.164440 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28625,"prepare.queue_time_us":17879,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":199185,"threads_started":1}
I20260709 13:10:10.170849 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:10.174530 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.153714 30410 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:10.132525 32592 raft_consensus.cc:2764] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:10.191808 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:10.119560 32477 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:10:10.137270 32598 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.203068 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:10.212935 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.178953 32471 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.213792 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:10.218819 30405 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:10.098842 32729 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:10.217173 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.219991 30480 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.218114 30404 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:10.223040 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.223186 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:10.219297 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 102148us
I20260709 13:10:10.224448 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.231120 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.231746 30477 raft_consensus.cc:2376] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4. Re-sending same reply.
I20260709 13:10:10.233393 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.193885 32672 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:10.251082 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.220657 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.235558 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:10.236732 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 96770.8us
I20260709 13:10:10.237190 30408 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:10.195144 32576 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:10.250581 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1510) took 1819 ms. Trace:
I20260709 13:10:10.234390 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.282740 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.283833 30559 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:10.284215 30559 pending_rounds.cc:85] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:10.284422 30559 pending_rounds.cc:107] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:10.286278 30558 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.282495 30555 rpcz_store.cc:276] 0709 13:10:08.432186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.922022 (+1489836us) service_pool.cc:224] Handling call
0709 13:10:09.922331 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.922784 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.922823 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.923295 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.993759 (+ 70464us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.025745 (+ 31986us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.088319 (+ 62574us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18003fdea0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:10.232629 (+144310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.232718 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.232772 (+    54us) raft_consensus.cc:1685] finished
0709 13:10:10.250349 (+ 17577us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.250521 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39299,"prepare.queue_time_us":31751,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9390,"raft.queue_time_us":44912,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":12317,"spinlock_wait_cycles":11102592,"thread_start_us":214205,"threads_started":2,"wal-append.queue_time_us":74871}
I20260709 13:10:10.284638 30559 raft_consensus.cc:2889] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:10.287176 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.288499 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.264488 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.266721 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:10.203931 32739 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:10:10.232625 32471 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:10.265767 29285 debug-util.cc:398] Leaking SignalData structure 0x7b080000fec0 after lost signal to thread 30524
W20260709 13:10:10.277495 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 99994.6us
I20260709 13:10:10.276564 30552 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.280078 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:10.175976 32181 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:10:10.299736 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.289664 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.290305 30405 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:10.264600 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.291679 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.300657 30555 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
W20260709 13:10:10.291639 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 120898us
W20260709 13:10:10.292593 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57102.2us
I20260709 13:10:10.266579 32672 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.348148 30450 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:10.300329 30552 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:10:10.349339 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46785us
I20260709 13:10:10.350786 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.354741 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.355299 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:10.361277 30404 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:10.367741 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:10.290964 32576 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.371824 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.375949 30478 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.371104 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.299794 32471 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.400271 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.358338 32672 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.302428 32518 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.402572 32518 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.403173 32518 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.377445 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:10.406951 32749 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 13:10:10.348081 32733 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:10.411857 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:10.415683 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 217294us
I20260709 13:10:10.351236 32564 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.286746 32682 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:10.302053 32436 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:10:10.436853 30560 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:10.437536 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.426115 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.438481 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.376776 32576 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.494405 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.498781 30477 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.506318 30478 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.424042 32564 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.518519 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.519250 30560 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:10.509232 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.369444 32745 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.198s
I20260709 13:10:10.520104 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:10.526254 30560 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.519944 30477 raft_consensus.cc:2376] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4. Re-sending same reply.
I20260709 13:10:10.527076 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.528448 30560 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:10.520777 30411 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:10.426038 32572 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.527421 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.532308 30478 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.421298 32733 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:10.547516 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.548759 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.549301 30557 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:10.550087 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.555995 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 221) took 2303 ms. Trace:
I20260709 13:10:10.556423 30559 rpcz_store.cc:276] 0709 13:10:08.252986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.254264 (+  1278us) service_pool.cc:224] Handling call
0709 13:10:08.743886 (+489622us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:08.744119 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.287326 (+1543207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.555723 (+268397us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001d97d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:10.555901 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3547178624}
I20260709 13:10:10.438191 32499 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.559042 30482 raft_consensus.cc:2368] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5.
I20260709 13:10:10.561180 32499 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.563062 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.563827 30477 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:10.567219 30557 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:10.567711 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.527045 32564 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:10.583015 30481 raft_consensus.cc:2368] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5.
I20260709 13:10:10.588551 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.591578 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.592613 30551 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:10.540244 32733 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.608073 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:10.613364 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.614087 30557 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.614428 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 230) took 1029 ms. Trace:
I20260709 13:10:10.614862 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.618484 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.619094 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.619076 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.618588 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:10.622982 30556 rpcz_store.cc:276] 0709 13:10:09.585140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.027783 (+442643us) service_pool.cc:224] Handling call
0709 13:10:10.028070 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.028293 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:10.134613 (+106320us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.613827 (+479214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.614098 (+   271us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.614156 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.614232 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.614360 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25062,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":518,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2555,"thread_start_us":560611,"threads_started":2}
I20260709 13:10:10.632020 30410 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:10.610109 32766 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:10:10.650980 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 354307us
W20260709 13:10:10.609434 32746 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:10:10.667615 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:10.687127 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1343) took 1065 ms. Trace:
I20260709 13:10:10.687583 30411 rpcz_store.cc:276] 0709 13:10:09.621522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.641894 (+ 20372us) service_pool.cc:224] Handling call
0709 13:10:09.642250 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.529310 (+887060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.686837 (+157527us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54002f5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:10.687067 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990949248}
I20260709 13:10:10.693306 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.694583 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.703614 30410 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:10.707439 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.709203 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.710101 30477 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:10.640045 32436 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:10:10.694133 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:10.715345 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.724373 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:10.727939 32735 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:10.727722 32461 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.728513 32735 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:10.728751 32760 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:10.729430 32735 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.731652 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:10.714233 32434 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260709 13:10:10.748482 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 227) took 2145 ms. Trace:
I20260709 13:10:10.755455 30554 rpcz_store.cc:276] 0709 13:10:08.603312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.972929 (+1369617us) service_pool.cc:224] Handling call
0709 13:10:09.981102 (+  8173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.981444 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.981474 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.982109 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.105710 (+123601us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.105748 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.105809 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.748203 (+642394us) raft_consensus.cc:1685] finished
0709 13:10:10.748231 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.748403 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10296,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"thread_start_us":123214,"threads_started":1,"wal-append.queue_time_us":750274}
I20260709 13:10:10.765921 32572 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:10.726002 32748 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:10:10.769043 32753 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 13:10:10.757606 32758 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.770188 32758 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.770637 32758 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:10.797334 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.797808 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.803313 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.804080 30481 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7.
I20260709 13:10:10.803872 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.804556 30477 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:10.804951 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.805711 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.806356 30477 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:10.810842 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:10.812167 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.813580 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.798847 32682 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:10.814427 30554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:10:10.815013 30554 raft_consensus.cc:606] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:10.815575 30477 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7.
I20260709 13:10:10.818542 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.763415 32392 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:10.819449 30477 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.820393 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.821473 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.823210 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.824867 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.807346 32436 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:10.761173 32434 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.830368 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.829433 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.832302 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.818989 32729 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:10.808101 32694 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:10:10.828516 32436 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.840101 30553 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:10.841398 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.843039 30479 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:10.845396 32434 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:10.845600 32436 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:10.843946 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 183665us
W20260709 13:10:10.848457 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.852623 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1510) took 1158 ms. Trace:
I20260709 13:10:10.853060 30485 rpcz_store.cc:276] 0709 13:10:09.693768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.710077 (+ 16309us) service_pool.cc:224] Handling call
0709 13:10:10.852438 (+1142361us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540004f954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:10.852566 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638264192}
I20260709 13:10:10.871901 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:10.875196 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:10.896479 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.898721 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.899966 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:10.911229 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 344460us
I20260709 13:10:10.914414 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.907612 32682 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:10:10.853605   314 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:10:10.932181 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.931241 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.949823 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1519) took 1037 ms. Trace:
I20260709 13:10:10.951619 30482 rpcz_store.cc:276] 0709 13:10:09.912815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.914865 (+  2050us) service_pool.cc:224] Handling call
0709 13:10:10.949647 (+1034782us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400344ed4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:10.949767 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478790912}
I20260709 13:10:10.952111 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:10.953078 30481 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.962805 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:10.966084 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.966316 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.966195 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.967643 30482 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.968112 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.969188 30481 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:10.869148 32747 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:10:10.971009 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:10.935946 32650 consensus_meta.cc:287] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.000s
W20260709 13:10:10.945194   309 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.179s	user 0.008s	sys 0.007s
W20260709 13:10:10.937876 32471 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.000s
I20260709 13:10:10.972677 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:10.948622 32672 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.005s
I20260709 13:10:10.973456 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.978389 30481 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:10.978888 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:10.979590 30482 raft_consensus.cc:2376] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5. Re-sending same reply.
I20260709 13:10:10.980939 30482 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:10:10.939510   315 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.173s	user 0.003s	sys 0.003s
I20260709 13:10:10.941154 32694 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:10.974610 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:10.985870 30479 raft_consensus.cc:2376] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4. Re-sending same reply.
W20260709 13:10:10.975723 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 124192us
I20260709 13:10:10.942147 32156 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:10.987641 30482 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:10.931177 32434 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:10:10.948220 32688 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:10.982205 32471 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:10.985549 32694 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:10.977459 32650 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:10.991712 32747 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:10.967321 32735 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:10.930465 32729 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:10:10.939179 32758 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:11.011981 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 185669us
I20260709 13:10:10.930048   323 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:10:10.979664 32742 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:11.013165 32694 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.008339 32625 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 13:10:11.022627 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 310081us
I20260709 13:10:11.020915 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.024281 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:11.025341 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45561.9us
I20260709 13:10:11.026741 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:11.027335 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:11.027694 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.027971 30479 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:11.013381   325 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.983695 32672 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.016271 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:10.994932 32733 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.024128 32747 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:11.028517 32392 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.051254   326 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:11.050885   325 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:11.052390   323 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.053915 32471 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.055184   314 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.056777 32672 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.057447 30478 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:11.058996 32650 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:11.063802 32638 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:10:11.082924 32729 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.083655 32729 consensus_queue.cc:1243] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:11.084012 32181 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.084168 32729 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:11.084450 32181 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:11.085350 32733 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.022081 32742 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.018606 32564 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.034109 32767 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:10:11.089273 30525 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.069795   326 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:11.080825 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 53206.6us
W20260709 13:10:11.081681 32744 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.724s	user 0.003s	sys 0.000s
W20260709 13:10:11.081528 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131841us
I20260709 13:10:11.064193 32747 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.020074 32735 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.072904 32434 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:11.105966 32735 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:11.071313 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 647080us
I20260709 13:10:11.097452   326 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.054545 32436 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.082374   335 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:11.111982 32436 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.093662 30523 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7.
I20260709 13:10:11.111419 32747 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.046907   327 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 13:10:11.074553 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50327.1us
I20260709 13:10:11.113997   327 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.102574 32564 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.114765   327 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.115355 32758 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.113198 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.098217 32751 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.116483 32751 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:11.116086   327 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.116803 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.114060 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.118129 32392 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.119314 32564 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.084690 32729 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.120536 32729 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.121001 30523 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7.
I20260709 13:10:11.121757 32729 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.122346 32742 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.098006 32650 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:10:11.125164   334 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:11.124308 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.103437 30560 raft_consensus.cc:2368] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:11.099923 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:11.095868 32518 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.002s
I20260709 13:10:11.082930 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:11.127731 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.132093 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.098099   337 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:10:11.137338 32471 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.138056   337 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.138403   337 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.116848 32751 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:11.139168   337 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.141342 32751 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:11.119097 32576 consensus_meta.cc:287] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.003s
I20260709 13:10:11.134776 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.135529 30403 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:11.136200 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.149956 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.137106   325 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.152220 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.153106 30403 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.154066 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.140486 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.155232 30553 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:11.157506 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:11.157908 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.159145 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.179281 30403 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:11.133064   327 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.146378   323 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.140282 32436 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.189546 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:11.196537 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 56118.9us
I20260709 13:10:11.198382 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.085404 32181 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.166610 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:11.163437 32650 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:11.204965 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 331149us
I20260709 13:10:11.163442 32758 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.136786 32518 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.210980 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:11.214478 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.220638 30405 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.213488 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.215075 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.222440 30410 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:11.189430 32564 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.189040   335 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.200420 32073 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.155354 32576 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.200045   339 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.235572   326 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.237471   341 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:11.240077 32518 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.241849 30477 raft_consensus.cc:2368] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6.
I20260709 13:10:11.223172 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:11.157264   338 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:10:11.250743 30480 raft_consensus.cc:2368] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5.
I20260709 13:10:11.226461   335 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.252096   335 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.252367   347 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:11.252791   347 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:11.253885   326 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:11.254437   314 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.254578 30407 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.259855 32181 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:11.249850 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49207.5us
I20260709 13:10:11.291359 32576 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:11.296299   310 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.628s	user 0.002s	sys 0.001s
I20260709 13:10:11.316032 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:11.325058 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 111941us
I20260709 13:10:11.326654 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.317252 32073 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.328233 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.336745 30410 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:11.336263 30407 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.338668 30408 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:11.323974 32638 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:11.341471 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 113486us
I20260709 13:10:11.334645 32650 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.336213 32434 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:11.359268 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.297847 32751 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.335076 32764 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:11.365068 32638 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:11.375614 32638 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.378769 32694 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.381423 32694 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:11.381954   317 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.531s	user 0.000s	sys 0.003s
I20260709 13:10:11.364279 32564 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:10:11.389588 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.378844 32751 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.394977 32764 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:11.395452 32764 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:11.396235   335 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.396782 32764 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.398097 32764 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.389387 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.400878 30408 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:11.405520 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:11.386299 32650 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:10:11.411286 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 392) took 1371 ms. Trace:
I20260709 13:10:11.412292 32745 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.412739 32745 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:11.413621 32745 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.387269   357 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:10:11.420449 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1554) took 1129 ms. Trace:
I20260709 13:10:11.420881 30480 rpcz_store.cc:276] 0709 13:10:10.291279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.291467 (+   188us) service_pool.cc:224] Handling call
0709 13:10:11.420253 (+1128786us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54000334d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:11.420386 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183475968}
I20260709 13:10:11.411728 31150 rpcz_store.cc:276] 0709 13:10:10.039703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.039820 (+   117us) service_pool.cc:224] Handling call
0709 13:10:10.041270 (+  1450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.041614 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.041645 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.042594 (+   949us) log.cc:844] Serialized 556 byte log entry
0709 13:10:10.499532 (+456938us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.499580 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.499650 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.944308 (+444658us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:11.409055 (+464747us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b240030bfa8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041e429c4 00007fa041e40acb 00007fa041ffbdc9 00007fa041ffba55 00007fa041ffafb0 00007fa044c71488 00007fa044c71be8 00007fa044c49398 00007fa044c4476a 00007fa044c43bb6
0709 13:10:11.411080 (+  2025us) raft_consensus.cc:1685] finished
0709 13:10:11.411099 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.411213 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51120768,"thread_start_us":456648,"threads_started":1,"wal-append.queue_time_us":722968}
W20260709 13:10:11.433434   343 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:10:11.434386 32471 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.435050 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1503) took 2417 ms. Trace:
W20260709 13:10:11.435319 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 245843us
I20260709 13:10:11.436098 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.435447 30484 rpcz_store.cc:276] 0709 13:10:09.017568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.961368 (+943800us) service_pool.cc:224] Handling call
0709 13:10:09.961628 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.962852 (+  1224us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:10.087829 (+124977us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.353678 (+265849us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.748215 (+394537us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b48000b19d8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:10:11.434564 (+686349us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b180041c560. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:11.434724 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.434769 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.434814 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.434873 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.434998 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88571,"prepare.queue_time_us":108424,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":69066,"raft.run_cpu_time_us":3371,"raft.run_wall_time_us":530094,"spinlock_wait_cycles":196958720,"thread_start_us":160760,"threads_started":2,"wal-append.queue_time_us":437038}
I20260709 13:10:11.437255 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:11.438162 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1539) took 1203 ms. Trace:
I20260709 13:10:11.438476 30560 rpcz_store.cc:276] 0709 13:10:10.234419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.529044 (+294625us) service_pool.cc:224] Handling call
0709 13:10:11.437996 (+908952us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54003f2d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:11.438120 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103227136}
W20260709 13:10:11.443235 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.0879e+06us
I20260709 13:10:11.444324 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.447402 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.421947 32745 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.458071 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.427042   327 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.466883 30405 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:11.425209   335 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.429016   357 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:11.464138   323 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.462247   327 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:11.493768 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:11.467680 32499 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.496788 30484 raft_consensus.cc:606] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:11.465787 32765 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.504098 30484 raft_consensus.cc:614] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.470968   336 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.493031   326 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.490413   303 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.472345 32763 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.504712 32765 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.514819   303 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:11.510027 32759 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.493093   357 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:11.571303 32743 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:11.466441   347 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.587649 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1548) took 1410 ms. Trace:
W20260709 13:10:11.618034 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 180834us
I20260709 13:10:11.621811 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:11.615170 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 416853us
I20260709 13:10:11.620537 30486 rpcz_store.cc:276] 0709 13:10:10.177217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.177394 (+   177us) service_pool.cc:224] Handling call
0709 13:10:10.177736 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.177983 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:10.191296 (+ 13313us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.587035 (+1395739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.587104 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.587167 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.587258 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.587568 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969907,"prepare.queue_time_us":73026,"prepare.run_cpu_time_us":1498,"prepare.run_wall_time_us":14260,"thread_start_us":425384,"threads_started":2,"wal-append.queue_time_us":473768}
I20260709 13:10:11.623832 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:11.624646 30484 raft_consensus.cc:606] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:11.625083 30484 raft_consensus.cc:614] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.629508 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:11.614348   360 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:11.614872   303 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.631461 32070 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.630856 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.610482 32765 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.633229 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.631548 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1591) took 2622 ms. Trace:
I20260709 13:10:11.636981 32073 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:11.642407   339 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.642580 32073 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:11.641657 30483 rpcz_store.cc:276] 0709 13:10:09.009115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.653024 (+643909us) service_pool.cc:224] Handling call
0709 13:10:09.653282 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.653476 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:09.800059 (+146583us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.058339 (+258280us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b1800027b20. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:10.063246 (+  4907us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b1800027b20. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219
0709 13:10:10.101598 (+ 38352us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800027b20. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:10.486670 (+385072us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.631155 (+1144485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.631217 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:11.631270 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.631349 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.631487 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086997,"prepare.queue_time_us":361640,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5793,"raft.queue_time_us":171060,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10718,"spinlock_wait_cycles":138334592,"thread_start_us":766774,"threads_started":5,"wal-append.queue_time_us":144338,"wal-append.run_cpu_time_us":6871,"wal-append.run_wall_time_us":1431323}
I20260709 13:10:11.643918 32073 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.646533   339 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:11.648197 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:11.608850   327 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.648927 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.653889   339 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:11.654639 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.655378 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.656080   327 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:11.656276 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 1.28169e+06us
I20260709 13:10:11.654542   339 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:11.657341   339 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.636094 32436 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:11.661906 31116 leader_election.cc:336] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.653s (SENT)
I20260709 13:10:11.633229   319 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.664022 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.667189   372 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.661535 30374 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:11.641371   347 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.628468 32759 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:11.671703 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 213729us
I20260709 13:10:11.672497 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.673288 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.672051 30374 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.671216   357 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:11.668140   336 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.674417   372 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.675872 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:11.688387 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:11.628999 32743 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:11.677874   372 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:11.674361   359 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:10:11.781864   326 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.662369 32714 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:11.683558 32747 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.677413   336 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:11.798405 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:11.799419 30560 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:11.681972   362 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.668669 32590 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.684262 32499 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.790522 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.801471   336 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.808933   303 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.794530   372 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.814327 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:11.794147   371 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:11.815377 32499 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:11.675220 32759 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.803463 32590 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.822309 32590 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.823693 32765 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.826031 32765 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.827047   303 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.821161   371 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:11.828281   371 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.828625 32590 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.830366 32590 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.817606 32764 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.795114 32743 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:11.846490   372 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:11.875069 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.875502 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.876338 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.884960 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 196512us
I20260709 13:10:11.888476 30483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:11.889844 30483 raft_consensus.cc:606] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.890645 30483 raft_consensus.cc:614] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.891481 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1634) took 1069 ms. Trace:
W20260709 13:10:11.894757 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 222642us
I20260709 13:10:11.894155 30477 rpcz_store.cc:276] 0709 13:10:10.821593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.829063 (+  7470us) service_pool.cc:224] Handling call
0709 13:10:11.890800 (+1061737us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400388954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:11.891210 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942747392}
W20260709 13:10:11.898172 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.899943 30405 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.901780 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.792455 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:11.902606 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.902647 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:11.905362 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.908442 30405 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:11.908931 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116422us
I20260709 13:10:11.920758 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.923996 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.925330 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:11.937150 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 122806us
I20260709 13:10:11.909277 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:11.938661 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.939800 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:11.910930 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.911695 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:11.943369 30477 raft_consensus.cc:606] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:11.944002 30477 raft_consensus.cc:614] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.943933 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:11.945672 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:11.956295 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:11.972307 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.975188 32073 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.976444 32073 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.976816 32070 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:11.977556 32073 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.978076 32073 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:11.977567 32070 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.978574 32073 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.987370 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.962387 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:11.974279 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.992197 32156 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.992738 32156 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:11.993448 32156 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.995323 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.996624 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:11.998672 30374 leader_election.cc:400] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5.
I20260709 13:10:12.007464 30374 leader_election.cc:403] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.011477 32461 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.012777 32461 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:12.013386 32461 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:12.007615 32434 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:12.004753 32181 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.019714 32181 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:12.020197 32181 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:12.020628 32181 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.005797 32436 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:12.023298 32436 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.008203 32392 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:12.037185 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.038190 32461 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.057331 32181 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:11.831005 32499 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.067600 32616 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:12.068502 32471 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:12.069713 32625 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.087194 32434 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:12.088326 32650 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:12.089706 32655 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:12.090437 32657 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.093634 32682 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.802376 32714 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:12.118242 32714 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:11.992681 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:12.118049 32748 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:12.095101 32694 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:11.848143   371 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.095098 32745 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.109084 32471 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.134645 32471 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.136261 32729 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.115257 32655 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:12.139453 32655 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.139592   367 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:12.140386   367 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:12.144114 32616 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:12.144541 32616 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:12.145762 32616 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.146646   367 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.148904 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:12.153353 32755 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:12.162082 32616 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.120810 32181 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.146910   372 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.164754 32156 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:12.202215 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 209618us
I20260709 13:10:12.204615 32156 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.204485 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:12.206435 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:12.207984 30376 leader_election.cc:400] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:12.208257 30376 leader_election.cc:403] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:12.211824 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 208373us
I20260709 13:10:12.249768 32073 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.251214 32070 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.253685 32073 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.254225   362 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.253831 32070 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.241191 32436 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.259470 30411 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:12.266812   303 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.240602 32181 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:12.272555 32762 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:12.273269   337 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:12.276839 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69028.7us
I20260709 13:10:12.280083 30555 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:12.282183 30558 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:10:12.296823 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:12.297791 31145 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:12.306849   371 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.309904 32729 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.316905 32499 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:12.318642 32392 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:12.320508 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 52087.4us
W20260709 13:10:12.327797 32759 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:10:12.336565 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:12.368824 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.352280 32436 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.336957 32471 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.373823 32392 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.361572 32759 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.390056 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:12.397131 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:12.401263   361 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.792s	user 0.000s	sys 0.003s
I20260709 13:10:12.414901 32392 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.417918 32392 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:12.419152 32499 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.381915 32655 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.421799 32655 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.430889 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:12.431559 30558 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:12.431758 30557 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:10:12.433820   379 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.185s	user 0.001s	sys 0.002s
I20260709 13:10:12.434232 32392 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:12.435137 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 762606us
I20260709 13:10:12.435252 32392 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:12.436311 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.435731 32392 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:12.436633   378 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.437206 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:12.437348   378 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.439895 32740 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:12.441286 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.441735 32740 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.442205 32740 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.442960 32590 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:12.444183 30410 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:12.444368 32590 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.445039 32590 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.447065 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.440471 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.448351 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.449003 30480 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:12.450094 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.451081 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.451304 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.440846 30551 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:12.452522 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.453271 30478 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:12.454555 30402 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 8. Ops: [4.5-6.6]
I20260709 13:10:12.453810   378 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:12.441159 32572 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:12.455998 32714 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:12.453712 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.456374 32572 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.454545 30410 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:12.461290 32572 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.452847 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:12.468312 32471 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.470773 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:12.471973   336 consensus_meta.cc:287] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.005s
I20260709 13:10:12.454380   369 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.469484 32572 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.454895 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.476123 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.476222 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.476991 30409 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:12.478580 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.455596 31145 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:12.479565 30407 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:12.483014 32759 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.480515 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.478439 30402 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:12.485819 30482 raft_consensus.cc:2376] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4. Re-sending same reply.
I20260709 13:10:12.451661 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:12.478842 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.447999 30477 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:12.480064 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.451082 30484 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:12.525628 32590 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.527331 30308 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.528527 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.529239 30478 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.537348 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:12.542382 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 91987.8us
I20260709 13:10:12.456521 32714 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:12.553205 30486 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:12.549018 32764 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:12.549296 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.557572 30484 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:12.550359 30485 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:12.551236 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.548313 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:12.537817 30410 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:12.517328 32745 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5.
W20260709 13:10:12.563385 30523 leader_election.cc:336] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 2.021s (SENT)
I20260709 13:10:12.527346 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:12.563397 30402 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:12.529652 30308 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.563988 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:12.563941 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.568526 30477 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:10:12.573683 30559 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.583019 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.583809 30308 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.590046 30405 raft_consensus.cc:2410] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:12.440379 32392 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.591533 30479 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:12.563987 32657 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.601056 32729 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.601725 32729 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.603816 32729 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:12.605463 30478 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:12.605454 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.554827   378 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:12.611304   378 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:12.611737   378 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:12.612704   378 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:12.614126   378 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:12.614809 30308 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 4 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.617133 30308 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:12.621644 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.622903 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.623775 30477 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:12.624320 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:12.624727 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.625067 30556 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.626046 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.627194 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:12.628137 30486 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.632061 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.633000 30481 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:12.634124 30481 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:12.635591 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:12.637594 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:12.639086 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:12.639724 30558 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.641018 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:12.643036 30483 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:10:12.648027 32714 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:12.649446 32714 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:12.649634 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.606618 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.634497 30481 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:12.516371   336 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.672513 30478 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:12.677111 30485 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:12.686311 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.693425 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:12.694420 30557 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:12.694921 31150 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:12.666632 30477 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:12.568506 32750 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.700836 30559 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:12.706686 30410 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:12.712755   336 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:12.714789 30479 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:12.715245 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52448.5us
I20260709 13:10:12.746651 30408 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.752251 30556 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:12.754077 30402 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:12.701012 32729 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:12.754761 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.768349 30558 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:12.723075 30481 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:12.779019 32181 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:10:12.780031 32181 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.779438 30555 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:12.729743 30407 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:12.739590 32657 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.731564 30308 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:12.817363 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.750411 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:12.866860 30486 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
W20260709 13:10:12.871508 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.881034 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.890254 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:12.903591 30486 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:12.888358 31116 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.689s (SENT) [suppressed 76 similar messages]
I20260709 13:10:12.821700   367 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:12.887468 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.946843 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:12.945222 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 381903us
I20260709 13:10:12.993036 30481 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:12.994624 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.996569 30405 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:13.001693 32181 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.002388 32181 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.006474 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.007156 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:12.778723 32750 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.008029 30406 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:13.008939 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46245us
I20260709 13:10:13.009938 32750 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.011843 32758 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:13.012434 32758 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:13.015189   391 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:10:13.016414 32740 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.003s
I20260709 13:10:13.004364 32181 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.018416 32638 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.033245 32638 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.007403 30402 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:13.016866 32740 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:12.822106 32657 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.073137 32740 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.074424 30402 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:13.075241 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.079563 32638 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.083027 30481 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:13.083593 30481 pending_rounds.cc:85] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 2
I20260709 13:10:13.083909 30481 pending_rounds.cc:107] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:10:13.084254 30481 raft_consensus.cc:2889] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:13.084455 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.084867 30451 connection.cc:256] RPC call timeout handler was delayed by -3.605651924999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:10:13.085409 30451 connection.cc:256] RPC call timeout handler was delayed by -2.6171790629999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:10:13.085489 32590 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:13.085767 30451 connection.cc:256] RPC call timeout handler was delayed by -2.5766790630000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 13:10:13.085593 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:13.086295 30451 connection.cc:256] RPC call timeout handler was delayed by -1.5452790629999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2836s for a response
I20260709 13:10:13.086151 32590 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.087088 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.087925 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.088114 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.088518 32590 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.089112 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.089182 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.089974 30486 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.089905 30481 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:13.090170 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.090906 30480 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.091554 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.092151 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.092487 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.093214 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.093513 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.094269 30480 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.095181 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.095785 30480 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.097312 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.097976 30480 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.098664 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.101529 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.106534 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.107940 32181 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.108093 30480 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.108448 30480 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:13.103015 32758 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:13.094236 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.106544 30484 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:13.110026 30481 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
W20260709 13:10:13.114828 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.118884 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:13.126833 30407 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:13.129328 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:13.129499 30481 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.130913 30481 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.130929 30374 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:13.144279 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.148483 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:13.141572 32758 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.155825 30408 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:13.167855 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.165239 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:13.109405 30480 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.145939 32590 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:13.149119   336 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:13.176707 32181 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:13.178426 32181 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.178881 32181 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:13.179219 30523 leader_election.cc:336] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.522s (SENT)
I20260709 13:10:13.179867 30481 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.199210 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.102651   367 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.211426 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.178360   336 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.214634 30402 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:13.216595 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.217736 30480 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:13.219988 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 88336.2us
I20260709 13:10:13.178879 32572 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.203402   378 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.221215 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 72262.9us
W20260709 13:10:13.224545 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.225188 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52551.4us
I20260709 13:10:13.225453 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.226111 30405 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:13.226380 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.227849 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.228812   325 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.229136 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.229694   325 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.229878   331 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.232637 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.239779   325 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.235064 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.221320   336 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.259738 30523 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.223028 32758 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:13.261679 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 381328us
I20260709 13:10:13.279311 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.247021 32657 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.292367 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.262549 30407 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:13.266645 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:13.300203 32181 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.220944 32729 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.294656 30405 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:13.248313   337 consensus_meta.cc:287] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.974s	user 0.003s	sys 0.012s
W20260709 13:10:13.305656 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70900.7us
I20260709 13:10:13.307796 32181 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.309262 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.294221 32657 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:10:13.309551 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:13.236195   378 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.320935 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:13.322124 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.321441 32638 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.323416 32638 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.323770 32638 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.319060   331 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.324185 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.324462 32181 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:13.324870 32181 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:13.323781 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.328426 31116 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.319887   369 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:13.356658 32181 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:13.362778 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 113546us
I20260709 13:10:13.362869 30554 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:13.363618 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.363979 32735 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.364231   403 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:13.361639 32764 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.364655 32735 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.357450   369 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:13.366945 32750 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:13.369102 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.367161   369 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:13.371129   400 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:13.363631 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:13.306948 32729 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.376998 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.332791 32751 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:13.332041   331 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:13.382380 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:13.379227   337 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.385535 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.380501 32751 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:13.395011 32758 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:13.391495   367 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.391445   346 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:13.393559 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.394549 32729 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.395097 32751 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.389663 30480 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:13.380236   331 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:13.400151 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.400987 30480 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:13.401800 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:13.388597 32740 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.403858   378 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:13.405802 32714 consensus_meta.cc:287] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.004s
I20260709 13:10:13.406378   331 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.412595 30480 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:13.412129   378 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:13.415730 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.407198 32729 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:13.431156 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.431226 30480 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:13.448649 32764 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.448958 32156 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:13.449347 32156 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:13.449816 32156 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.454564 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.455386 30411 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:13.423069   346 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:13.455070 32729 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.457873 32729 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:13.457940 32392 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:13.462392 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 81163.9us
W20260709 13:10:13.446309 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.467464 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:13.470856 30482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.036s	sys 0.078s
W20260709 13:10:13.478518 30482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.036s	sys 0.079s
I20260709 13:10:13.481801 32714 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.441431   369 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.494148 31148 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.507447 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.508112 30411 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:13.509100 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.509934 30406 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:13.510754 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.511669 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.496770   336 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:13.518993 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 294659us
I20260709 13:10:13.528735 30405 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:13.501356 32156 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:13.505432 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.479118 32638 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.519140 31150 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:13.519882 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.497416   369 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:13.566200 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:13.585369 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:13.586197 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:13.587205 31148 raft_consensus.cc:1217] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-6.6]   Dedup: 4.5->[6.6-6.6]
I20260709 13:10:13.587879 31148 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 8. Ops: [4.5-6.6]
W20260709 13:10:13.588771 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.566787   325 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:13.590129 30477 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:13.592451 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:13.598539 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:13.603196 32729 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:13.603837 30483 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:13.604581 32729 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.604952 32729 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.605057 30483 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:13.605321 32729 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.606320 30483 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:13.590776 32590 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.645362 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:13.646293 30559 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:13.592839   337 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:10:13.670276 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 462582us
W20260709 13:10:13.673399 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.641368 32735 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:13.711473 30479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.010s	sys 0.007s
W20260709 13:10:13.718924 30479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.007s
I20260709 13:10:13.720136 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 184) took 1113 ms. Trace:
I20260709 13:10:13.709149 32735 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:13.710868   336 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:13.734179 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.737557 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.715893 32751 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.747877 30407 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.727751 32735 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:13.740617 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:13.750252 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 426178us
I20260709 13:10:13.764178 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:13.763965 30552 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
W20260709 13:10:13.782394 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.720626 30479 rpcz_store.cc:276] 0709 13:10:12.606293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.715697 (+109404us) service_pool.cc:224] Handling call
0709 13:10:12.716071 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.716489 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.716516 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.716998 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.884724 (+167726us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:13.719411 (+834687us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.719688 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.719800 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.719857 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:13.719876 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.720062 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34983,"prepare.queue_time_us":194221,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":11530,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11539,"spinlock_wait_cycles":70787968,"thread_start_us":824978,"threads_started":2,"wal-append.queue_time_us":432433}
W20260709 13:10:13.792308 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 423283us
I20260709 13:10:13.794065 30407 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:13.744397   336 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.803244 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.803794 32751 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.812702 32735 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.816037 32156 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.782116 32638 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.819307   336 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:13.820210 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 238) took 2655 ms (client timeout 2112 ms). Trace:
W20260709 13:10:13.820819 30554 rpcz_store.cc:269] 0709 13:10:11.165187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.166365 (+  1178us) service_pool.cc:224] Handling call
0709 13:10:13.819927 (+2653562us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54000ee7d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:13.820108 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4893530880}
W20260709 13:10:13.822320   392 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.100s	user 0.007s	sys 0.001s
I20260709 13:10:13.071025 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.824468 30308 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 4 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.814388 32735 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.838624 30523 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:13.837949   387 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.115s	user 0.004s	sys 0.004s
W20260709 13:10:13.851665 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 403464us
I20260709 13:10:13.836575   415 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:10:13.852519   417 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.850715   336 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:13.866026 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1671) took 1261 ms. Trace:
I20260709 13:10:13.869532 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.866554 30478 rpcz_store.cc:276] 0709 13:10:12.604702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.673603 (+ 68901us) service_pool.cc:224] Handling call
0709 13:10:12.720121 (+ 46518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.720555 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.720583 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.721077 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.854827 (+1133750us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b18003a0420. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1
0709 13:10:13.855003 (+   176us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:13.860254 (+  5251us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.862825 (+  2571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.862899 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.862952 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:13.865797 (+  2845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.865961 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6175,"raft.queue_time_us":32735,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":27253,"spinlock_wait_cycles":19549440,"thread_start_us":62157,"threads_started":1,"wal-append.queue_time_us":377832}
I20260709 13:10:13.871835   418 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:13.871871 30404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1647) took 1219 ms (client timeout 1592 ms). Trace:
W20260709 13:10:13.875625 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 282243us
W20260709 13:10:13.876329 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 352990us
W20260709 13:10:13.875568 30404 rpcz_store.cc:269] 0709 13:10:12.652269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.653462 (+  1193us) service_pool.cc:224] Handling call
0709 13:10:13.869330 (+1215868us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:13.871764 (+  2434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8347520}
I20260709 13:10:13.880524 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1558) took 1568 ms. Trace:
I20260709 13:10:13.880440 32688 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:10:13.880996 30553 rpcz_store.cc:276] 0709 13:10:12.278495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.278656 (+   161us) service_pool.cc:224] Handling call
0709 13:10:12.279088 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.279656 (+   568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.279694 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.280197 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.511369 (+231172us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:12.511420 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.511496 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.810253 (+1298757us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:13.844769 (+ 34516us) raft_consensus.cc:1685] finished
0709 13:10:13.844796 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.846806 (+  2010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":964,"raft.queue_time_us":1238,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6593,"spinlock_wait_cycles":40210688,"thread_start_us":230735,"threads_started":1,"wal-append.queue_time_us":441667}
I20260709 13:10:13.882917 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.883921   340 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:13.884161 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.884512   340 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:13.885074   335 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:13.885572   335 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.885368   340 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.885999   335 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.886039 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:13.871261 32729 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.878065 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:13.873178   336 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:13.900904 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:13.905612 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.889570 32750 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:13.863433   417 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.910764 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:13.910807 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 248266us
I20260709 13:10:13.899741 32392 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:13.911495 30404 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:13.912997 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:13.916206 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 152110us
I20260709 13:10:13.907881 32751 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.907598   419 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.911211   336 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:13.920306   331 consensus_meta.cc:287] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.001s
I20260709 13:10:13.929738   331 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.932010   331 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.926196   419 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.935127   419 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.928906   420 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:10:13.929258 32729 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.940711 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:13.915457 32392 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.942433 32392 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.928038   336 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:13.943786   336 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.945425   336 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.946424   417 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:13.938117   424 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:13.947189 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:13.947610   424 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:13.948022   424 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:13.948952   424 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.950176   424 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.920923 32750 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:13.951386 32750 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.928122 32751 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:13.955786 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:13.956409 30554 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:13.956635 32751 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:13.974040 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:13.977068 30405 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:13.977742 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 65108.4us
I20260709 13:10:13.978454 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:13.980499 30554 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:13.983685 31152 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:13.984280 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.984581 32732 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.985177 32732 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:13.984930 30406 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:13.992496   437 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.002672 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:13.992810   430 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.003397 32181 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.993665 32759 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.007841 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.000635 32732 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.003368 30406 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:13.998031 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:14.008682 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 90449.9us
W20260709 13:10:14.009284 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 90118.1us
I20260709 13:10:14.009814 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:14.009999 31152 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:14.011535   333 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.012027   333 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:14.013023   437 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:14.013574   437 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.012982   333 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:14.027814 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.035923 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:14.039294 30525 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:14.039784 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:14.039919 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.040829 30525 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:14.041953 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:14.042289 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:14.052845 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 53653us
I20260709 13:10:14.047680 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.055125 31152 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:14.059222 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:14.060689 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:14.058523 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:14.052065 32750 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.017592 32758 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:14.068135 30477 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:14.054908 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:14.047068   420 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.053930   331 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:14.099730 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 58948.4us
I20260709 13:10:14.057209 32729 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.104712 30525 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:14.014164 32759 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.114210 30485 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:14.089819 32735 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.089984 32758 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:14.122568 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 101381us
W20260709 13:10:14.127032 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.128988 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.129511 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.095826 32590 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:14.103843   331 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.133035 30481 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:14.116915   415 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.135778 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.120822   421 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:14.152192 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.142344   331 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.155891 30558 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.158274 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.139778   340 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:14.098105 32750 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.135695   436 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:14.160804 30559 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.150534   421 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.170524 30555 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:14.099328   437 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:14.178457 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 123641us
I20260709 13:10:14.182109 32181 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:14.182902 30554 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:14.180069 30450 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:14.189121 32181 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.158178   415 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.147346 32590 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.162233   340 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.148360   335 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.193747 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.222512 30557 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.194017 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.199019 32181 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.203088 30559 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:14.223292 30555 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:14.194213 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.223925 30551 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.204416 30560 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
W20260709 13:10:14.180222   431 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:14.173410   411 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:14.214886 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 110317us
I20260709 13:10:14.173758   421 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.195521   369 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:10:14.202806   436 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:14.234721   434 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:14.222292   340 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:14.284649 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 89578.3us
I20260709 13:10:14.284569 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.305419 30559 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:14.286810 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:14.285248 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 81916.2us
I20260709 13:10:14.289901 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.194885   409 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:14.293259 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.296808 32181 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:14.306419 30560 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.307937 31152 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:14.233036 32735 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:14.274822   437 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:14.312288 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 219179us
I20260709 13:10:14.315039 32181 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.317138 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.317196 30557 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:14.181243 32758 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.191576   410 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:10:14.332800 32181 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.291169   429 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:14.345837 30560 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:14.347214 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.354247 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.355901 30559 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.286835   411 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.360234 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.336314   430 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:14.319587 32735 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.357273   409 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.381107 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:14.380988 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.376466   448 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:14.398757 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 78017.7us
I20260709 13:10:14.351306   451 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:10:14.403723 32181 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.404243 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.405582 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.404246 32181 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.406683 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.410146   430 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:14.387543   369 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:14.357839   429 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.411273 30405 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:14.416234 32181 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.420477 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:14.413930   418 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 13:10:14.434073   418 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.439270   456 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.439667   439 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:14.440362   439 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.441604   439 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:14.443611   447 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:14.443107   331 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.443876 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.411808   438 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:14.428367 32590 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.429072   443 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:10:14.429692   454 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:14.430153 32750 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.364900   415 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.431695 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.425769   430 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.415508 32392 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.429111 30559 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.411999   419 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.451035 30552 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:14.405839   325 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 13:10:14.480180   450 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:14.480760   436 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.419534   369 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:14.486727 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 126798us
I20260709 13:10:14.433141 30551 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:14.425196   451 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:14.469211 31152 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:14.394291   409 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.470983 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.471238   460 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.445206   335 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.471946 32729 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:14.478821   457 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.492686 30553 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:14.479269   433 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:10:14.483884   466 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:14.485004   468 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:10:14.485630 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 164543us
W20260709 13:10:14.486825 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66458.4us
I20260709 13:10:14.488010 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.465708   438 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.490144   451 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.490521 30559 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:14.491616 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:14.495376   448 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.472556   454 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.507818   331 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.508596 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.508535   454 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.509363 30558 raft_consensus.cc:2368] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
W20260709 13:10:14.501001 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 94387.1us
I20260709 13:10:14.502821 30551 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.501889   468 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:14.506404   369 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.491768   410 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.500393   466 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:14.499735   460 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:14.515801 32392 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.567966 30551 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.546871   335 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:14.570989   451 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.579142 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.581341 30558 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.583504 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.584235 30554 raft_consensus.cc:2368] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:14.588124 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.600095 30559 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.501397   457 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.507874   448 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.603092   457 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.592646 32181 consensus_queue.cc:1059] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:14.579736   335 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.606590 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.568994 32729 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:14.614485 30559 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.616403 30556 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.616451   471 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:10:14.617549   438 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.631917 32181 raft_consensus.cc:3055] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:14.632328 32181 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.633154 32181 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:14.634279   458 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:10:14.618454 32759 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.607455   430 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.559199   410 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.618999   411 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.624198   429 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.639336   419 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.593999   451 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:10:14.675889 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:14.626567   340 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.643316   369 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.643762 32735 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.644425 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.634398 32181 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:14.639122 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:14.668807 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 162055us
I20260709 13:10:14.611460   335 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:14.668443   424 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.003s
I20260709 13:10:14.622777 30554 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:14.603825   460 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.681721 30558 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:14.644615   437 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:14.645861 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.705796 30559 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.613792 32729 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.702924 30560 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:14.713680 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.704541 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.704447 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.675318   336 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.687773 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:14.711385   469 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:14.698765 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.715796 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.722498   332 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.722872   336 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.723084   332 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.725008   336 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.725688   332 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.726400 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.727175 30551 raft_consensus.cc:2368] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:14.728030 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.728739 30551 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.728966   340 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.726866   476 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:14.730659 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.729585 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.736717 30551 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.744298 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:14.745123 31152 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.634302   421 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.746381 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.764258   410 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.764638 30556 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.767346 30559 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:10:14.767302 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 193409us
I20260709 13:10:14.769477 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.607434   468 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.784119 30556 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:14.714599   437 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.734895 32759 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.791337 30551 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:10:14.793704 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.793906 30558 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:14.795893 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:14.796126   437 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.796633   437 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:14.797086   437 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.797502 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:14.797924   437 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.798892   415 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:14.798781 32759 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:14.799461   415 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:14.800374   415 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.801245 32759 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.803081   336 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:14.803501   336 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.803838   336 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.809728 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.810560 30551 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.810480 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.811305 30408 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.809854 32590 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:14.813392 32590 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:14.813809 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.814385 30407 raft_consensus.cc:2376] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.813926 30555 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:14.814280 32590 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.815361 32590 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.815548 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.816372 30555 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:14.816924   409 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.817219 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.818253 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.818557 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.821669 32758 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.821956 30555 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:14.822820 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.822943 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.823328 30555 raft_consensus.cc:2376] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.824923 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.831056 31148 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:14.831210 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.832741 30405 raft_consensus.cc:2368] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:14.832556 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.833307 30404 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.835011 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.836127 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.836751 30411 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.837800 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.841539 31152 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:14.838409 30409 raft_consensus.cc:2376] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.861219 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.862320 30556 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:14.864467 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 52332.7us
I20260709 13:10:14.868209 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.868983 30407 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.869510 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.881381 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.882018 30408 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:10:14.882309 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.882812 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.882952 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.884369 30404 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:14.884604 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:14.885401   486 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:10:14.887818 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.888677 30556 raft_consensus.cc:2376] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.888854   460 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.889619 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.890311 30556 raft_consensus.cc:2368] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:14.889412   460 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.891096 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.891431 32729 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.891510   335 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:14.892884 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.893640   335 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:14.893957 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.860885   409 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.894651 30556 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
W20260709 13:10:14.895115 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.895061   409 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.895560 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.894742   460 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.891700 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.896957 30555 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.897342   409 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:14.897826 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.898579 30555 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.898844   421 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:14.899510 30556 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:14.878512   453 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.905057 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:14.904703 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.905678 30404 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:14.905738 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.906476 30558 raft_consensus.cc:2368] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
I20260709 13:10:14.903102 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.908223 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.909032 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.903533 30402 raft_consensus.cc:2376] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.903287 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.883841   461 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:14.912621 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.912883 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.916316 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:14.916791 30402 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.915717 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:14.919350 31148 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.912204   461 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:14.936131   461 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.937498   461 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.937552 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:14.913945   453 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:14.939404 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.925433 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.940529 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.941257 30560 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:14.942444 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:14.943913 30559 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:14.944096 32759 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:14.945801   476 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.947961 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.954416 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:14.955077 30560 raft_consensus.cc:2376] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5. Re-sending same reply.
I20260709 13:10:14.955521 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:14.957262   466 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:14.953208   477 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:10:14.960044 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.964341 30554 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:14.995496 30411 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:14.925670   409 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:15.007395 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.007213 32590 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:15.013031 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.013947 30410 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:15.013090 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.021988 30560 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:15.046820 32590 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.047430 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.049362 32590 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.051074 31152 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:15.051963 30404 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.056202   340 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.971123   418 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.058501 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:15.062258 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.059096 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.063556 30405 raft_consensus.cc:2410] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:15.063557 30408 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:15.062268 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.059711 30451 leader_election.cc:400] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.065407 30451 leader_election.cc:403] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.068346 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:15.070111 32590 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.070848 32590 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:15.071859 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.072072   369 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.071882 32590 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.068413 30450 leader_election.cc:400] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.078285 30450 leader_election.cc:403] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.080420 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.026356 32758 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.081683   460 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.084806 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:15.085897 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.085719   460 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.058672   453 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.083276 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.088763 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.090001 30555 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:15.081645 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.056381   409 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.066730   466 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.097304 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.093475   476 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:15.102465 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.105571 30560 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.111459 30402 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:15.110482 30558 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:15.116632 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.114001 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:15.123509 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.077494   418 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.112715   410 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:15.082238   340 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.087791 32758 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.120894   451 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.136278   460 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.136706 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:15.138242 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:15.140818 31116 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:15.128767 31148 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:15.145040 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.148825 32688 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.148313   459 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.149062   451 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.186579   451 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:15.187570   451 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.187762   406 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:15.186597 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:15.191818   441 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.178678 32750 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.181708 30558 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:15.192967 32750 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:15.194454 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.194321 32732 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:15.195725   369 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.175280   410 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:15.194324 32750 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.198112 32750 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.199198 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1573) took 1063 ms. Trace:
I20260709 13:10:15.199570 30552 rpcz_store.cc:276] 0709 13:10:14.135332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.135446 (+   114us) service_pool.cc:224] Handling call
0709 13:10:15.198994 (+1063548us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001e64d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:15.199120 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686013184}
I20260709 13:10:15.200734   340 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.207906 32758 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.207289 30308 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 4 to 6, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.137143   336 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.210901 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52693.2us
I20260709 13:10:15.213238 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:15.192571   441 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:15.229547 30555 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.230341 30409 raft_consensus.cc:2368] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.210706 32590 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:15.232372 32590 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.224061   369 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:15.236744   369 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.234648 32590 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:15.239674 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.240109 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:15.241744 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.242879 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:15.244356   471 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:15.244818   471 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:15.245689   471 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.246923 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:15.247041 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.247529 30411 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.248106   429 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:15.248605   429 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:15.249372   429 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.251120   430 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:15.251646   430 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:15.251993 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.252493   430 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.253185 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:15.253764 30407 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.223294 32688 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.230763   418 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.264606 30555 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:15.265642 30407 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:15.215402 32735 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:15.273862 30411 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:15.315821 30308 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.277468 31148 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:15.238441   411 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:15.223587 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.232394   409 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:15.317873 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 213105us
I20260709 13:10:15.278079   445 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.284145 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:15.323020 30406 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.274027   437 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.286420 32735 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:15.253784   336 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.288388 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:15.289829 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.344099 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.344771 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.343930 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:15.346408 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.347131 30485 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:15.347530 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.348260 30486 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.350652 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.351382 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.353096 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.354964 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:15.355630 30555 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.279382   369 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:15.292018 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.293565 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.360064 30404 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:15.294018   476 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.307729   468 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.365338 30486 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:15.366042 30481 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.307082   441 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.366670 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.367471 30486 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:15.310104 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:15.370249 30405 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.368434 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.312755 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.374122 30408 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:15.314945 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.280609 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:15.375296 30407 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
W20260709 13:10:15.375730 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 95222.7us
I20260709 13:10:15.376971 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.328920 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.378914   438 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:15.379671   438 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:15.380160   438 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.380482   438 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.382586   415 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:15.400883 30405 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.319542   411 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:15.403192 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.418047 30477 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:15.419148 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.419991 30481 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.402149   409 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.421399 30483 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:15.421532   409 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.422130   409 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.411161   418 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:15.386853 32750 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.424850 32750 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.425582 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.415307 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.408601 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:15.416610 30480 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:15.428231 30484 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.421401 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.429780 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.430399 30478 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.431599 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.432928 30402 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.433786 30551 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.434804 30557 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.440995 30555 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:15.433349 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:15.442299 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.443075 30482 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.446642 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.447544 30477 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.451895 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:15.451977 30479 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:10:15.454255 30480 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:15.461439 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 326837us
I20260709 13:10:15.402284 32758 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:15.463001 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.417498   336 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.464916 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:15.337461   445 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.469688 30402 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.345992   437 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.471920 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.464567 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:15.475338 30486 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.476841 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.479363 32735 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.481983 30411 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:10:15.482223 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.482571   445 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.482544 30411 pending_rounds.cc:85] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 1
I20260709 13:10:15.484086 30411 pending_rounds.cc:107] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:10:15.484417 30411 raft_consensus.cc:2889] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.486882   460 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:15.486924 32758 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:15.489432 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.491026 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.492137 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.493163 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:15.443786   418 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:15.497485 30478 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:15.494328 30477 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:15.499558 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.500416 30479 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 3.
I20260709 13:10:15.463260   369 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.462163   468 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:15.513585 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.469655   336 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:15.525339 30481 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:15.544121 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.545025 30479 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.512246 32759 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.512787   340 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:15.500768   460 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.500248   337 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:15.561885 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48417.4us
I20260709 13:10:15.553330 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.562647 30481 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.562505 30484 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:15.508921   369 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:15.500648   420 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:15.488338 32758 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.513401   476 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:15.499549 32729 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:15.586150 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.550958 32750 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.587489 30484 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:15.591293 30451 leader_election.cc:400] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.592221 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:15.564400   337 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.605255 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 227297us
I20260709 13:10:15.582319   340 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:15.572968 30481 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:15.561331   460 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.582077   420 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.611377 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.584050   410 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:15.592731   369 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.589852 32729 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.561985   468 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.617686 30376 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:15.639274 30376 leader_election.cc:403] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.605155   419 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:15.635838 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.637892 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.644243 30484 raft_consensus.cc:2410] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:15.610713   463 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:15.614804   337 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.648976 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.612803   476 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:15.679270 30484 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:15.680022   476 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.638958 32729 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.613085   495 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:15.620369   420 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.594061   409 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.654565 30451 leader_election.cc:400] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
I20260709 13:10:15.701553 30451 leader_election.cc:403] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.647174 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:15.643187 32759 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:15.702263 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55168.8us
I20260709 13:10:15.649822   466 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.652047   460 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.643013   493 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:15.704420 30450 leader_election.cc:400] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.705991 30450 leader_election.cc:403] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.670266   445 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:15.672513   494 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:15.606581   418 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.707042 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 213920us
W20260709 13:10:15.720041 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.586843   411 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.740744 30305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 199) took 11785 ms (client timeout 15000 ms). Trace:
I20260709 13:10:15.705305   466 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:15.712430 32759 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.720929   463 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
W20260709 13:10:15.753773 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 99397.3us
W20260709 13:10:15.747812 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 43531.7us
I20260709 13:10:15.748961 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.755052 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.755337 30481 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:15.749109 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:15.750780 30557 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.734803   430 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:15.703366   471 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:15.669749   336 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.762796 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.770578 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:15.772154 30551 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:15.772624 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.773283 30481 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.752682   410 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.751879   466 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.709270   495 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.734473 32750 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:10:15.762266   430 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.777138   340 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:15.800179   497 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:10:15.800922   498 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:10:15.804169   499 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:15.804894 30406 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:15.807097   496 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:10:15.799588   336 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.807142 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.834187 30486 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.813820 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.835443 30481 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:15.819041 30479 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:15.731477   494 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.823257 30477 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:15.779774   437 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.832391   438 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.815745   411 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.820324   430 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.848111 30482 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:15.827823   453 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.872720 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.837651   471 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.862278   466 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.850203   451 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:15.870857   512 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.744570 30305 rpcz_store.cc:269] 0709 13:10:03.711241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.716771 (+  5530us) service_pool.cc:224] Handling call
0709 13:10:15.470909 (+11754138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:10.856481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:10.992529 (+136048us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:10.992573 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:10:10.992593 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:11.055191 (+ 62598us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.055250 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.055279 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:10:11.057708 (+  2429us) tablet.cc:701] Row locks acquired
0709 13:10:11.057726 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:11.057918 (+   192us) write_op.cc:270] Start()
0709 13:10:11.058050 (+   132us) write_op.cc:276] Timestamp: P: 1783602611057843 usec, L: 0
0709 13:10:11.058070 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.100952 (+ 42882us) log.cc:844] Serialized 10942 byte log entry
0709 13:10:11.288762 (+187810us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18002c98c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:11.502004 (+213242us) op_driver.cc:464] REPLICATION: finished
0709 13:10:11.681700 (+179696us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a4e28 00007fa048adf581 00007fa048aded58 00007fa048ae39f1 00007fa048ae39a9 00007fa048ae3939 00007fa048ae3901 00007fa048ae2b2d 000000000038f354 000000000038f199
0709 13:10:11.838637 (+156937us) write_op.cc:301] APPLY: starting
0709 13:10:11.838755 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:11.839104 (+   349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:11.839118 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:12.120706 (+281588us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:12.121563 (+   857us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:10:12.121620 (+    57us) write_op.cc:312] APPLY: finished
0709 13:10:12.122484 (+   864us) log.cc:844] Serialized 187 byte log entry
0709 13:10:12.180633 (+ 58149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.325038 (+144405us) write_op.cc:454] Released schema lock
0709 13:10:12.351436 (+ 26398us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:12.487222 (+135786us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.487262 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1258062,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":333542,"apply.run_cpu_time_us":9318,"apply.run_wall_time_us":648439,"num_ops":28,"prepare.queue_time_us":252376,"prepare.run_cpu_time_us":48238,"prepare.run_wall_time_us":844245,"raft.queue_time_us":166474,"raft.run_cpu_time_us":18397,"raft.run_wall_time_us":352321,"replication_time_us":431873,"spinlock_wait_cycles":44572288,"thread_start_us":587964,"threads_started":4,"wal-append.queue_time_us":108331,"wal-append.run_cpu_time_us":27809,"wal-append.run_wall_time_us":1842165}]]}
I20260709 13:10:15.910889   493 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:15.912067   438 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.914572 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.888726   453 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:15.915313 30480 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:15.915892 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.916623 30482 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:15.917603   453 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:15.907402   512 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.919917   504 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:15.920867   512 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.893262   471 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.964713   471 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.935706   493 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.965680   493 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.968436   493 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.969156 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:15.969310   420 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.969908 31148 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:15.973613   430 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.950944 32729 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:15.987926   491 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.675s	user 0.000s	sys 0.005s
I20260709 13:10:15.989531 32729 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:15.953465 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.953850 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.990546 30477 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:15.990912   468 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:15.991261   337 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.954149 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:15.954620 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.995651 30482 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:15.996066 30484 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:15.954893 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.955144 32759 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:15.997609 30480 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:15.998345 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:15.957715   369 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.959280 32750 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.000648 32750 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:15.960151   409 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:16.003849   505 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 13:10:16.004598   369 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:16.005422 30478 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.005560   460 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.007019 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.007159 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.008133 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.008692 30478 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:15.961733   466 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:15.949472   429 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:15.982856   410 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:15.984586   420 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.035254 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:15.986472   501 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:10:15.993327   337 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.008615 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:15.960371   494 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:16.009996 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 136014us
I20260709 13:10:15.996999 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.028292 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.040346 30484 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:16.029227   430 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:16.029747 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.066324 30484 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.030084 30402 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:16.030298 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.066846 30486 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:16.030890 30407 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:16.031129 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.007977   336 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.069154 30403 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:16.034226 30481 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:16.036340 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.036455 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.037777 30480 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:16.029042 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.047940 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:16.068094 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 297650us
I20260709 13:10:16.073359 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:16.076583 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.027328   429 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:16.087319 30484 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:16.089092 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48892.7us
I20260709 13:10:16.106338 30480 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.117668 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:16.118460 30555 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:16.118525 30558 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:16.136576 30478 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.034812   445 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:16.120596 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:16.069779 32750 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.139431 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:16.082226   430 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:16.145874 30556 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:16.146099 30484 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:16.146404 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:16.147006 30551 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:10:16.154333 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 232678us
I20260709 13:10:16.140767 30557 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:16.142045 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.143574 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.144354 30558 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:16.140590 30402 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:16.069564   507 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:10:16.069380   471 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:10:16.184902 30477 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.187552 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.187917 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.188154 30477 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.189106 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.189822 30406 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.190896 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.191704 30408 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:16.159660 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.195148 30407 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:16.163127 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.152462   508 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:16.197060 30484 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:16.159264 30553 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:16.088347   415 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:10:16.143596 32590 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.221491 30409 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:16.095049   506 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:10:16.221938 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.222133   512 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:16.222535   512 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:16.222716 30404 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:16.107200   337 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:10:16.223531   512 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.147318   519 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.086743   336 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:16.155820 32750 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:16.254308 30478 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:16.263861 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.266040 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.264506 30484 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:16.269306 30485 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:16.271384 30485 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:16.277032 30485 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:16.266641 30402 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
W20260709 13:10:16.284787 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 145279us
I20260709 13:10:16.255704 30480 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:16.271828 32750 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:16.305009 30478 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:16.329563 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.329910   336 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:16.257625   519 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.350159 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.350337 32750 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.351063 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.357250 30477 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.350149 30485 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:16.354496 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.359831 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.354665 30480 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:16.355119 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 89657.1us
I20260709 13:10:16.296353 30406 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:16.358614 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.363448 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.365492 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.366153 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.366258 30485 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:16.367125 31152 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.371533 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.372099   537 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.374390   537 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.375105 30484 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:16.376736   537 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:16.372663   525 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:16.373418   336 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:16.378008   512 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.370371 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.381418 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.381930 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.382184 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.385308 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.380034   430 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:16.388016   340 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.388479   430 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.391115 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.391693 30480 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.384222   471 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.399938   517 raft_consensus.cc:2764] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:16.401000   517 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:16.402271   517 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:16.401265   519 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.403566   517 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:16.404911   495 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:16.404630   517 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:16.406455   517 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.383931   515 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:16.407431 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.407641   515 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:16.408041   515 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.409058 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.409680 30486 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:16.411312 30486 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:16.413000 30486 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:16.396625   336 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.415035 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.415743 30478 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.399948 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.417615 30523 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.418159 30480 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:16.419967 30477 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.420317 30407 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:16.422477 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.423305 30477 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.427469 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.428092   519 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:16.428145 30480 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:16.431921   519 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:16.432610   519 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:16.433782   519 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.437876 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:16.439648 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52173us
I20260709 13:10:16.440748 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:16.443006   336 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:16.444455   336 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:16.446154   336 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:16.448783   471 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.439020   340 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:16.449949   340 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:16.450438   340 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.455680 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:16.456656   525 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:16.457297   525 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:16.458425   525 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.462841 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:16.466773 30560 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:16.466770 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.416501   537 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.476253 30478 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:16.477603 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78998.7us
I20260709 13:10:16.446628   336 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:16.464818   415 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.471051   507 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.513120   415 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.513284   540 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:16.477136   445 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:10:16.510941   518 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.239s	user 0.003s	sys 0.000s
I20260709 13:10:16.524176 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.495314   523 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:16.533910 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.470842   510 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:10:16.490610   417 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:10:16.522917   507 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.544853 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1692) took 1191 ms. Trace:
W20260709 13:10:16.557348 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 474295us
I20260709 13:10:16.531183   337 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:16.557495 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 484226us
I20260709 13:10:16.560273 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.539408 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:16.549845 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 89570.7us
I20260709 13:10:16.562466 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.522579   437 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:10:16.563853 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71994.7us
I20260709 13:10:16.576064   521 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.577682   336 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.531796   537 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:10:16.579457   336 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.573057 32735 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.582933   522 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.584192   515 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:16.586145 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64039.1us
I20260709 13:10:16.528724   415 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.543061 32758 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:16.550637 30483 rpcz_store.cc:276] 0709 13:10:15.353239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.422343 (+ 69104us) service_pool.cc:224] Handling call
0709 13:10:15.422658 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:15.427544 (+  4886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.427571 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:15.540470 (+112899us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b2c00010828. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:15.546618 (+  6148us) log.cc:844] Serialized 52 byte log entry
0709 13:10:15.706435 (+159817us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:15.869110 (+162675us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.068200 (+199090us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.544199 (+475999us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b180043d020. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:16.544426 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.544524 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.544584 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:16.544602 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.544782 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48853,"prepare.queue_time_us":304458,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":580164,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":28870,"spinlock_wait_cycles":77937792,"thread_start_us":462173,"threads_started":3,"wal-append.queue_time_us":313030}
I20260709 13:10:16.528795   471 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:16.557847   507 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.543366   523 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:16.603339   495 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.586319   420 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.600275   430 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:10:16.607370 31152 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:16.612318 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:16.588315 32735 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.573283   429 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.587216 32732 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.614054   337 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.605288   471 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:16.600695 32758 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.590359   418 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:10:16.627322   544 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:10:16.628552 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 69442.4us
I20260709 13:10:16.630139   460 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:16.631762 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71595.2us
I20260709 13:10:16.632469 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:16.633546 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.619745 32735 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.599227   445 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:10:16.617748   420 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.590000   406 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:16.635273 32758 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.641247   429 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.641367   460 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:16.641040 32590 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.618561   495 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.634996   521 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:10:16.642098   528 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.649557   476 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.649657   420 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:16.683219 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49735.1us
I20260709 13:10:16.684080 30451 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.684785 32590 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:16.685601 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.686290 32590 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:16.695019   532 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260709 13:10:16.695611 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:16.698288 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.698657   430 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:16.699355   430 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:16.700003 32590 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.701722   430 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:16.703292 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:16.704138 30552 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.708940 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:16.709756 30403 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:16.670295   460 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.715706 30405 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:16.718845 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:16.732642 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:16.733371 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
W20260709 13:10:16.738867 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 123718us
I20260709 13:10:16.701717 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:16.757376 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55781.7us
W20260709 13:10:16.755643 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.762440 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:16.763185 30555 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:16.720213   460 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:16.764341   522 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:16.787555 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 295631us
I20260709 13:10:16.768193 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:16.678835   523 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.777944   420 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.763566 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.819001   519 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.820267 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 208055us
W20260709 13:10:16.820386 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56942.4us
I20260709 13:10:16.819171 30552 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.821496 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:16.824956 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.821563 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:16.832664 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:16.721953   340 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.844311 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:16.835619   515 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.830540   528 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.807279   547 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:16.868685 30557 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:16.839108   522 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:16.867460 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 272227us
W20260709 13:10:16.871381 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.852792   410 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:16.861832   346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.007s	sys 0.011s
I20260709 13:10:16.887645 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.830897   519 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:16.892092 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:16.870745   555 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.903308 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.887655   553 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:10:16.893863   346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.008s	sys 0.011s
I20260709 13:10:16.910297 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.912575 30485 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:16.917287 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:16.907842 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 139710us
I20260709 13:10:16.921205 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.899006   445 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.924422 30478 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.928413 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.925127 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.927153 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.902060   515 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:16.930718 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:16.932746 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.912286   525 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:16.909096   476 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.932085 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.901687   410 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:16.906482   517 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.941457 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:16.942987   437 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:16.898485   522 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:16.916183   513 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.962803 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.963387   525 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:16.975697 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45553.5us
I20260709 13:10:16.976537   340 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:16.976354   525 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.977098   340 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.977317 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:16.955680 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:16.979449 31148 raft_consensus.cc:2368] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:16.963485   437 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.964475   510 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:16.978215   340 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.939507   515 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.978300 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:16.959717   517 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.004761 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:17.007586 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 180755us
I20260709 13:10:16.989230   515 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.022272   495 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:17.025409 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76974.7us
I20260709 13:10:17.031013 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:16.996265   337 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:17.032909 30481 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:17.032739 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:17.046844 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:16.972266   563 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:17.017935   517 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.054651 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:17.058683 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:17.048751 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.961270   476 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:17.044793 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 130163us
I20260709 13:10:17.057212 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.060710 30481 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:17.061467 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.063617 30482 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:17.016947   340 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:17.061673 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:16.938840 32750 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:10:17.065677 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.067916 30556 raft_consensus.cc:2368] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:17.029814   420 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.068709 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:17.071576 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:17.072764 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46706.5us
I20260709 13:10:16.985189   513 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.047084   495 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:17.092959 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 134702us
I20260709 13:10:17.085800   521 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:17.062270   555 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.043996   574 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:17.065997   525 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.064584   494 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:17.099689 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:17.067718   519 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.097880 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.124531 30481 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:17.111282 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:17.053378 32735 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:16.999971   410 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:17.090248   437 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.125274 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:17.130649   562 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:10:17.132162   570 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:10:17.133642 32735 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.134913 30560 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:10:17.136369   507 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:10:17.136811   507 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.137429 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.138573 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.138980   566 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:17.139664 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:17.139495   566 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.139778 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.140164   340 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.140674 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.141278 30551 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:17.141515   566 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:17.143219   507 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.143953   476 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.144443 30551 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:17.145614   415 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.003s
I20260709 13:10:17.145833 30551 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:17.132069   519 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.152333 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:17.170446 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59260.5us
I20260709 13:10:17.172410   564 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.174065 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:17.172219 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 81191.8us
W20260709 13:10:17.128988   557 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:10:17.143784   336 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:10:17.177939 30478 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.178977 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.144482   513 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:17.185259 32758 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.008s
I20260709 13:10:17.146051   415 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:17.190896   429 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
W20260709 13:10:17.191159   572 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:17.126818   525 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.219962   337 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:17.200343   517 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.202243   453 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.202415 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:17.203649 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.221990 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 163396us
I20260709 13:10:17.231446 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:17.243026 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.243079 30410 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:17.233244 30478 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:17.244508 30451 leader_election.cc:400] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:17.244830 30451 leader_election.cc:403] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.245042 30407 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:10:17.193703 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:17.249262 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46945.2us
I20260709 13:10:17.251734 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.252403 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.101554   522 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.234191   421 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:17.176016   519 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:17.286872 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 57473.8us
W20260709 13:10:17.289297 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59813us
I20260709 13:10:17.311733   421 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:17.312533 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68906.3us
I20260709 13:10:17.312677   517 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.313822 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.314137   421 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.314445   337 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.314971   476 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.317152   519 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.265033   528 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:17.320122   578 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:17.229969 32758 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.322667 32758 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.323503 30554 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:17.324097 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.358521 30451 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.367532 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:17.370231 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.371343 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.372336 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.372974   494 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.373584   494 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.374181   494 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.374357   476 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:17.374817   494 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.375043   476 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.260192   453 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:17.378144 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 88230.6us
I20260709 13:10:17.375808   476 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:17.368263 30555 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:17.259424   340 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.409937 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.377543 30558 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:17.410748 30486 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.407930 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:17.410120 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:17.413861 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:17.418330 30451 leader_election.cc:400] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:17.420074 30451 leader_election.cc:403] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.415119   555 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:10:17.432417   453 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.393366   476 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:17.417838   460 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 13:10:17.440008 30486 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:17.420168   495 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:17.444639   596 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:17.414484   521 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.447614 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.414103   594 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.420320   513 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:17.356431   515 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.455174   415 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.455119 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.455873 30482 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:17.456684 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.457314   510 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:17.457733   513 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:17.458127 30482 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:17.459193 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.449798   460 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.437058   494 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:17.469555 30482 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:17.491914 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.458221   513 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.492766 30482 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:17.496461 30559 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:17.499356 30482 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:17.501214 30482 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:17.506886 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:17.507640 30483 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:17.508543 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 90369.8us
I20260709 13:10:17.508558   515 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:17.496187   476 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.574119   476 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.619149   460 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.620438 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.624825   528 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6.
I20260709 13:10:17.534605   525 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.640417   525 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:17.711030 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:17.739082 30480 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:17.746657   510 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:17.767272   512 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:17.767113   510 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.767709   512 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:17.770576 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1699) took 1063 ms. Trace:
I20260709 13:10:17.771334 30407 rpcz_store.cc:276] 0709 13:10:16.707501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.708801 (+  1300us) service_pool.cc:224] Handling call
0709 13:10:16.709109 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.245421 (+536312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.770302 (+524881us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540036db54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:17.770486 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232042880}
I20260709 13:10:17.790747 30480 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:17.688565   525 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:17.809064 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.816888 31152 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:17.818383 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.820013 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:17.820590 31152 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.824268 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:17.825314   506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.602s	user 0.033s	sys 0.073s
I20260709 13:10:17.817809   510 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.840706 31152 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:17.832397   553 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:17.843523 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.844524 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.841209   506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.617s	user 0.033s	sys 0.073s
I20260709 13:10:17.846163 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:17.847916 30480 raft_consensus.cc:606] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:17.839762   558 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:17.862871   525 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:17.864450 32732 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:17.855217   523 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.847842   553 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.868357 32732 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.870862 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:17.871624 30480 raft_consensus.cc:606] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:17.871963 30480 raft_consensus.cc:614] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.879829 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:17.880527 30480 raft_consensus.cc:606] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:17.880854 30480 raft_consensus.cc:614] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.872992   460 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.883867   460 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.870235   523 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.887156   460 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.888000   523 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.890400 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:17.891098 30480 raft_consensus.cc:606] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:17.891404 30480 raft_consensus.cc:614] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.892409 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1616) took 1168 ms. Trace:
I20260709 13:10:17.892791 30552 rpcz_store.cc:276] 0709 13:10:16.723605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.758894 (+ 35289us) service_pool.cc:224] Handling call
0709 13:10:16.759267 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.821592 (+ 62325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.892195 (+1070603us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b54001e55d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:17.892355 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137286912}
I20260709 13:10:17.894479 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1611) took 1775 ms. Trace:
I20260709 13:10:17.894882 30559 rpcz_store.cc:276] 0709 13:10:16.119335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.121069 (+  1734us) service_pool.cc:224] Handling call
0709 13:10:16.711897 (+590828us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:16.712152 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.496860 (+784708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.894257 (+397397us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54002b1bd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:17.894418 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812871680}
I20260709 13:10:17.907188   513 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.908716 32732 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.912799 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:17.912937 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:17.910048   513 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:17.911509   553 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:17.913434 30480 raft_consensus.cc:606] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:17.914934 30480 raft_consensus.cc:614] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.913445 32732 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:17.915880 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.918519 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:17.926934 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:17.928956 30481 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:17.930284 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:17.932938 30559 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:17.934855 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:17.935873   554 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:17.937314   554 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:17.938267   554 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.950661   512 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:17.962497   512 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:17.998100   574 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.998708   574 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:17.995961   594 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.017867 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:18.015172   594 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.024797   594 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.039752 30486 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:18.040886 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:18.041450 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:18.041646 30483 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:18.042018 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.042565 30480 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:18.048674   506 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.049330   506 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:18.051733   612 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:18.016535   574 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:18.087122 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1617) took 1363 ms. Trace:
I20260709 13:10:18.087656 30557 rpcz_store.cc:276] 0709 13:10:16.723933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.724049 (+   116us) service_pool.cc:224] Handling call
0709 13:10:16.724355 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.886412 (+162057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.079414 (+1193002us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000eddd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:18.087063 (+  7649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331304192}
I20260709 13:10:18.089177   506 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:18.092236 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.101372 31117 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:18.105012   538 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:18.105485   538 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:18.105852   538 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.115340 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.115895 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.116554 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.118372 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.119402 30407 raft_consensus.cc:2410] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:10:18.122339 30409 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:18.124524 30405 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:18.126974 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:18.128090 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.129298 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:18.130492 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.132036 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:18.143499 30485 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:18.145080 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.145861 30485 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:18.151674 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.152158 30481 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:10:18.152559 30481 pending_rounds.cc:85] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 2
I20260709 13:10:18.152789 30481 pending_rounds.cc:107] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:18.153064 30481 raft_consensus.cc:2889] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.152849 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.155339 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:18.169369 30405 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:18.181823 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.182706 30405 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:18.187448 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60577.9us
W20260709 13:10:18.165284   619 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.089s	user 0.012s	sys 0.000s
I20260709 13:10:18.161959   337 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.193059 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.161725   556 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:18.166940   523 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:18.193346 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 117153us
W20260709 13:10:18.172020   606 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:10:18.201326 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.175608   495 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.179862   515 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:18.215976 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.204617 30410 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
W20260709 13:10:18.214972 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 119955us
I20260709 13:10:18.223824 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.181129   512 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:10:18.190231   558 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:10:18.215577   515 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.219164   594 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.241151 30405 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:18.247540 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 62237.1us
I20260709 13:10:18.256409 30405 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:18.258868 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:18.239600   512 consensus_queue.cc:1243] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:18.257767 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:18.263305 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:18.250731   515 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.275498 30559 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.278330 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.289215 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:18.289429 30552 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:18.278960 30405 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.290517 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:18.294926 30559 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:18.249557   337 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:10:18.299661 30405 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:18.301839 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.302968 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:18.304348 30410 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:18.305322 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.306023 30407 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:18.306758 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.307331 30403 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:18.308441 30406 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:18.309676 30402 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:10:18.281414   512 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.316094   512 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.318284   512 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:18.254338   594 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:18.335232 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131864us
I20260709 13:10:18.275944   471 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:18.339151 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.341696 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:18.357159   523 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:18.279273   627 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.367461 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.337175   337 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.332573   506 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:18.411754 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:18.412245 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.415012 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73417.9us
I20260709 13:10:18.387221   444 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.363454   525 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:10:18.364924   628 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:10:18.402884   591 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.363919   471 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:18.373606   558 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:10:18.406062   624 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:10:18.436754   476 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.437469   558 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:18.437860   558 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:18.437884   476 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.438802   558 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.439960   558 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.440232   476 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.373944   627 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.419173 32590 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.443265 32590 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.445326 32590 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.410957   337 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.358510   523 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.446465 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.407856   635 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.447811 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.448072 30555 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:18.455221 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.409924   625 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:18.449479 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1647) took 1517 ms. Trace:
I20260709 13:10:18.465513 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.469504 30410 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:18.469805 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.475775 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.465292   556 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:18.461207 30484 rpcz_store.cc:276] 0709 13:10:16.932391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.194444 (+262053us) service_pool.cc:224] Handling call
0709 13:10:17.194776 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.946288 (+751512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.946322 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.946776 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.005089 (+ 58313us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:18.005128 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.108614 (+103486us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18001d58a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc557 00007fa041fbe7c1
0709 13:10:18.449091 (+340477us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540034b2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:18.449162 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.449222 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:18.449242 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.449409 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":599,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":1731730432,"thread_start_us":57975,"threads_started":1,"wal-append.queue_time_us":107989}
I20260709 13:10:18.430545   537 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:18.478200 32590 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.419979   506 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:18.463020   553 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:18.498459 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1649) took 1565 ms. Trace:
I20260709 13:10:18.499367 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.498948 30477 rpcz_store.cc:276] 0709 13:10:16.944699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.235639 (+290940us) service_pool.cc:224] Handling call
0709 13:10:17.241146 (+  5507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.241489 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.241517 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.258196 (+ 16679us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.905266 (+647070us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b180001b2e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:18.498015 (+592749us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b5400299120. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450206b8 00007fa0450a992b 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c
0709 13:10:18.498094 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:18.498142 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.498220 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.498269 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:18.498287 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.498404 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6230,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17373,"spinlock_wait_cycles":34223232,"thread_start_us":90454,"threads_started":1,"wal-append.queue_time_us":675645}
I20260709 13:10:18.444411   627 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.471443   629 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.483016   537 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.434540   444 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:18.483418   476 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:18.515246 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 265593us
I20260709 13:10:18.464941   635 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.482606 32590 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.506161 32750 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:18.502897   512 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.533850 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.516466 32732 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:18.535176 30450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.508s (SENT) [suppressed 35 similar messages]
I20260709 13:10:18.536886   639 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.530316   517 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:18.517297   537 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.466988   625 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.521731   629 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:10:18.553429 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 124537us
I20260709 13:10:18.458067   591 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:18.538477   626 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:10:18.512027   513 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:18.549202 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:18.607108 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 71947.3us
I20260709 13:10:18.544740   637 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.628311   637 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.631124   637 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:18.633237 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 133968us
I20260709 13:10:18.636003   644 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.637108 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:18.639873   632 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:18.642777   574 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.643350   574 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.645778   574 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.647675   594 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.648229   594 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.648826   594 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:18.650894   640 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.652951   640 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:18.653307   640 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.653649   640 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:18.654683 30308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 101) took 14223 ms (client timeout 15000 ms). Trace:
I20260709 13:10:18.596032   525 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:18.595947   639 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.601748   627 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:10:18.666363 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 117246us
I20260709 13:10:18.667553 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.668728   637 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.655735   512 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:10:18.501207   556 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.673341   553 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.674535   510 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:18.675107   510 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.675505   510 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.675603   506 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:18.676803   506 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:18.677186   506 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.677520   506 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.593242   624 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:10:18.660959   594 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:18.540707   476 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.622740   495 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.526161   538 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:18.660952   629 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:18.707398 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 237639us
W20260709 13:10:18.655205 30308 rpcz_store.cc:269] 0709 13:10:04.431422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.483069 (+ 51647us) service_pool.cc:224] Handling call
0709 13:10:18.654608 (+14171539us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:16.204625 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:16.345112 (+140487us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:16.345193 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:10:16.345215 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:16.346835 (+  1620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:16.347044 (+   209us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:16.347078 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:16.348042 (+   964us) tablet.cc:701] Row locks acquired
0709 13:10:16.348106 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:10:16.348295 (+   189us) write_op.cc:270] Start()
0709 13:10:16.348459 (+   164us) write_op.cc:276] Timestamp: P: 1783602616348229 usec, L: 0
0709 13:10:16.348474 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:10:16.399223 (+ 50749us) log.cc:844] Serialized 3573 byte log entry
0709 13:10:16.889480 (+490257us) op_driver.cc:464] REPLICATION: finished
0709 13:10:17.173772 (+284292us) write_op.cc:301] APPLY: starting
0709 13:10:17.173873 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:17.174091 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:17.174216 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:17.192640 (+ 18424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:17.192892 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:10:17.192938 (+    46us) write_op.cc:312] APPLY: finished
0709 13:10:17.193190 (+   252us) log.cc:844] Serialized 70 byte log entry
0709 13:10:17.194026 (+   836us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.194149 (+   123us) write_op.cc:454] Released schema lock
0709 13:10:17.194194 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:17.875431 (+681237us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a4e28 00007fa048adf581 00007fa048aded58 00007fa048ae39f1 00007fa048ae39a9 00007fa048ae3939 00007fa048ae3901 00007fa048ae2b2d 000000000038f354 000000000038f199
0709 13:10:17.875748 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.875788 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5059283,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":280262,"apply.run_cpu_time_us":2926,"apply.run_wall_time_us":20787,"num_ops":9,"prepare.queue_time_us":304994,"prepare.run_cpu_time_us":27317,"prepare.run_wall_time_us":1719594,"raft.queue_time_us":220678,"raft.run_cpu_time_us":33145,"raft.run_wall_time_us":288115,"replication_time_us":506133,"spinlock_wait_cycles":36603648,"thread_start_us":344629,"threads_started":4,"wal-append.queue_time_us":151555,"wal-append.run_cpu_time_us":13466,"wal-append.run_wall_time_us":1636641}]]}
W20260709 13:10:18.720329 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 102321us
I20260709 13:10:18.684600   645 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.722724 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.723380 30481 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:18.709931   337 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:18.721176   471 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:18.751137 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.751770 30478 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:18.752552 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.705987   495 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.756513 30481 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:18.731123 32590 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.768435 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:18.765882 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 223818us
I20260709 13:10:18.777997 30479 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:18.782811 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:18.799355 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 156257us
W20260709 13:10:18.799969 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.799026 30480 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:18.800886 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:18.748534   337 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.756726   574 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:18.804699 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:18.767966   647 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.769819   471 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.815845 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50963.8us
I20260709 13:10:18.727301   645 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.770072   515 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.870956 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:18.813841   574 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.831164   647 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.813457   337 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.839656   471 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:18.973202 30560 raft_consensus.cc:2368] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
W20260709 13:10:19.085182 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 284842us
I20260709 13:10:18.896823 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:19.086303 30553 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:18.882663 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.871126 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:18.887920 30556 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:19.087921 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 420438us
I20260709 13:10:18.870872 31152 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
W20260709 13:10:18.939460 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 80632us
I20260709 13:10:19.086952 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:18.934758 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:19.090837 30552 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:19.090168 30558 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:19.092161 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:19.093247 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.102775 30479 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:19.104498 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:19.086201 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:19.088975 31152 pending_rounds.cc:85] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Aborting all ops after (but not including) 4
I20260709 13:10:18.838333 32750 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:19.433739 30477 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.023s
W20260709 13:10:19.256417 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.357872 30479 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
W20260709 13:10:19.486567 30477 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.024s
I20260709 13:10:19.487739 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:19.180882 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 92337.1us
I20260709 13:10:19.488973 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:19.490067 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:19.491266 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:19.183115 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78770.4us
I20260709 13:10:19.493769 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:19.494396 30402 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:19.362813 30555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.021s
W20260709 13:10:19.499959 30555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.009s	sys 0.022s
W20260709 13:10:19.482731 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 396589us
W20260709 13:10:19.415198 30484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.001s	sys 0.009s
W20260709 13:10:19.504083 30484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.003s	sys 0.009s
I20260709 13:10:19.503635 30402 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
W20260709 13:10:18.961735   558 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.005s
I20260709 13:10:19.507215 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:18.963265   646 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:10:18.870486   556 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:19.484090 30486 pending_rounds.cc:85] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 2
W20260709 13:10:19.393414   506 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
I20260709 13:10:19.431895   471 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:19.429590   510 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.008s
I20260709 13:10:18.957448   635 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:18.938498   444 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.858669   657 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:18.906504 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:19.409946   630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.007s	sys 0.007s
I20260709 13:10:19.523455 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 341) took 1090 ms. Trace:
I20260709 13:10:19.523670 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:18.958583   591 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.525246 30486 pending_rounds.cc:107] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:19.029397   594 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:19.090667 32590 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:19.348124   667 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.121578 31152 pending_rounds.cc:107] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:10:18.907805   538 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.973742   495 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.028622   410 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:19.301337   624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.013s
I20260709 13:10:18.906929   639 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:19.285532   476 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:18.908162   629 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:19.292940   651 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:19.550258 30485 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:19.194504   658 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:18.938475   512 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.584s
I20260709 13:10:19.527890   556 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.527562   515 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:19.575435 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51879.2us
I20260709 13:10:19.574923 30407 rpcz_store.cc:276] 0709 13:10:18.433319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.433493 (+   174us) service_pool.cc:224] Handling call
0709 13:10:18.433757 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.473968 (+ 40211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.474011 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.474066 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.474112 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.523177 (+1049065us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54002864d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:19.523236 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.523377 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91967744}
W20260709 13:10:19.614464 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.530745   604 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:19.725809   684 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.724370   625 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.797456   667 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:19.622756 30374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.034s
I20260709 13:10:19.798125   629 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:19.798362 30486 raft_consensus.cc:2889] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:19.798441 30374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.000s	sys 0.035s
I20260709 13:10:19.799834   591 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:19.800347   591 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.797454   658 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.797837   684 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.526481   666 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:19.797856   556 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:19.655689   665 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.173s	user 0.000s	sys 0.003s
W20260709 13:10:19.622641   669 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:10:19.817626 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:19.573786   647 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:19.819213 30408 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:10:19.625860   645 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.640604   574 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.654284   634 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.166s
I20260709 13:10:19.527527   558 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 13:10:19.827159 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 318847us
I20260709 13:10:19.528721   506 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.802803 31152 raft_consensus.cc:2917] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:10:19.803524 32590 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.805717   410 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.804257   476 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.806483   604 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.804409   594 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.779346   635 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:19.809561   515 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:19.802742   690 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.565250   510 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:19.779083 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 199993us
I20260709 13:10:19.802940   658 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:19.628839 32750 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:19.723668   662 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:10:19.576131   630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.007s	sys 0.008s
I20260709 13:10:19.575331   657 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.811431   651 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.812124   667 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:19.812698   512 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:19.808179   495 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:18.961755   640 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.876996   670 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.877592   670 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:19.879393   515 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:19.852836   656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.022s	sys 0.015s
I20260709 13:10:19.802181 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:19.805258   624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.013s	sys 0.019s
I20260709 13:10:19.747011 31148 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:19.665061 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:19.890916 30555 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:19.652237   337 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:19.664814   636 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:19.725004   677 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:19.562163   668 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:19.727036   689 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:19.647421   671 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:10:19.804235   629 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.836248 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:19.802491   591 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:19.838264 31152 raft_consensus.cc:2889] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.839708 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1675) took 1088 ms. Trace:
I20260709 13:10:19.847172 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:19.853312 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1664) took 1108 ms. Trace:
I20260709 13:10:19.859290 30403 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:19.863977 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:19.844228   635 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:19.872644 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:19.850139   645 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:10:19.874544   495 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.875995   512 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:19.872076   667 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:19.881820 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 79704us
I20260709 13:10:19.884665 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1410) took 1009 ms. Trace:
I20260709 13:10:19.891669 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:19.879981   515 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.843768   476 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:19.889341   661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.006s	sys 0.018s
I20260709 13:10:19.880752   641 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:10:19.840512   666 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:19.856832   690 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.074231 30557 rpcz_store.cc:276] 0709 13:10:18.875122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.876024 (+   902us) service_pool.cc:224] Handling call
0709 13:10:19.084566 (+208542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.084859 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:19.458340 (+373481us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.851377 (+393037us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.884324 (+ 32947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.884382 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:19.884436 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.884504 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.884612 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25236,"prepare.queue_time_us":564242,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2662,"raft.queue_time_us":29313,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":12726272,"thread_start_us":677795,"threads_started":2,"wal-append.queue_time_us":421019}
I20260709 13:10:19.956452 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:20.077473 30405 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:20.004117 31152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 221) took 1098 ms. Trace:
I20260709 13:10:20.072492 30411 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.004506 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1670) took 1257 ms. Trace:
I20260709 13:10:19.859078   681 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.175s
I20260709 13:10:20.078917 31152 rpcz_store.cc:276] 0709 13:10:18.857588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.857721 (+   133us) service_pool.cc:224] Handling call
0709 13:10:18.858126 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.955575 (+1097449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.955762 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.955447 30484 rpcz_store.cc:276] 0709 13:10:18.751546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.758827 (+  7281us) service_pool.cc:224] Handling call
0709 13:10:18.763460 (+  4633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.763715 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:19.514882 (+751167us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.839271 (+324389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.839340 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:19.839410 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.839497 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.839638 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37610,"prepare.queue_time_us":194160,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":148879,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1010807,"threads_started":3,"wal-append.queue_time_us":218412}
I20260709 13:10:20.182862 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.185279 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:20.072209   661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.010s	sys 0.020s
I20260709 13:10:20.080183 30482 rpcz_store.cc:276] 0709 13:10:18.746951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.747970 (+  1019us) service_pool.cc:224] Handling call
0709 13:10:18.757161 (+  9191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.757485 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.757514 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.765067 (+  7553us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.837814 (+ 72747us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:18.837876 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.838067 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.004275 (+1166208us) raft_consensus.cc:1685] finished
0709 13:10:20.004299 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.004448 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2683,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":23672,"threads_started":1,"wal-append.queue_time_us":705624}
W20260709 13:10:20.189684 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 298194us
I20260709 13:10:20.199244 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:20.006705   444 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.955618 30477 rpcz_store.cc:276] 0709 13:10:18.745071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.755889 (+ 10818us) service_pool.cc:224] Handling call
0709 13:10:18.774143 (+ 18254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.774377 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:19.487364 (+712987us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.852998 (+365634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.853048 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:19.853089 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.853153 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.853260 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78347,"prepare.queue_time_us":473521,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3805,"raft.queue_time_us":119456,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":1000892,"threads_started":3,"wal-append.queue_time_us":258028}
I20260709 13:10:20.210762 30484 raft_consensus.cc:2410] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:20.212046 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:19.923621   636 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:19.961058   337 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.214201 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 330602us
I20260709 13:10:20.226142 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.226955 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:20.001788 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 220) took 1098 ms. Trace:
I20260709 13:10:20.081511   591 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:20.213325 30482 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:20.005728   702 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:20.228389 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:20.215443   658 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.234815   693 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:20.235289   693 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.235639   693 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:20.235936   594 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:20.238972 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.239874 30477 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:20.240629 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.240778   670 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:20.241174 30477 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:20.241988 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.081539   679 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:20.230902 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:20.177480   635 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.245398 30411 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:20.242547 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:10:20.220458 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 347862us
I20260709 13:10:20.081239   512 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:20.145040   667 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:20.287667 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 213730us
W20260709 13:10:20.312726 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.226369   668 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.279825   410 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:19.992216   689 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:20.345777 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 413765us
I20260709 13:10:20.354161 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.311147   658 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.354801 30477 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
W20260709 13:10:20.342321   695 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.492s	user 0.001s	sys 0.001s
I20260709 13:10:20.231573 31148 rpcz_store.cc:276] 0709 13:10:18.857214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.858730 (+  1516us) service_pool.cc:224] Handling call
0709 13:10:19.954550 (+1095820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.314829   651 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.355783 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:20.359512 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:20.252631   591 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.245412   337 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.232335   444 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:20.365559 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 154192us
I20260709 13:10:20.287251   664 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.427s
I20260709 13:10:20.370255 30408 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:20.330065   558 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.381374 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:20.385075 30482 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:20.387756 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 63980.2us
I20260709 13:10:20.388933 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:20.351084   506 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.351434 32590 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.392098 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 240) took 1185 ms. Trace:
I20260709 13:10:20.342948   460 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.345749   670 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.324925   594 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:10:20.378093 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 149781us
I20260709 13:10:20.363070   410 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.310178   679 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.363231   668 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 13:10:20.283803   702 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:20.344559   636 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.700582 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:20.765672 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 241) took 1558 ms. Trace:
I20260709 13:10:20.783711 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:20.919173 30484 rpcz_store.cc:276] 0709 13:10:19.207347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.764868 (+1557521us) service_pool.cc:224] Handling call
0709 13:10:20.765170 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.765356 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.765384 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.765427 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:20.765461 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.765517 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.765615 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.700132 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 348) took 1468 ms. Trace:
I20260709 13:10:20.748200 30554 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:20.389995 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:20.921569 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1414) took 1936 ms. Trace:
W20260709 13:10:20.495128 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 171288us
I20260709 13:10:20.778427 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:20.760262 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:20.511313 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1756) took 1305 ms. Trace:
I20260709 13:10:20.785642 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:20.392511 30482 rpcz_store.cc:276] 0709 13:10:19.207084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.386941 (+1179857us) service_pool.cc:224] Handling call
0709 13:10:20.391641 (+  4700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.391803 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.391827 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.391869 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:20.391900 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.391949 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.392046 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.921018 30553 rpcz_store.cc:276] 0709 13:10:19.231907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.699176 (+1467269us) service_pool.cc:224] Handling call
0709 13:10:20.699575 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.699777 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.699803 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.699842 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:20.699879 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.699932 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.700058 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:20.958878 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 568904us
I20260709 13:10:20.700179 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:20.930811 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1417) took 1944 ms (client timeout 1674 ms). Trace:
W20260709 13:10:20.961364 30559 rpcz_store.cc:269] 0709 13:10:18.986357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.088112 (+101755us) service_pool.cc:224] Handling call
0709 13:10:20.760085 (+1671973us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84e9c 00007fa041f84a5b 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:20.930739 (+170654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42812672}
I20260709 13:10:20.957798 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:20.506878   694 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:10:20.698786   700 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.379575   658 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:21.088887 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131158us
I20260709 13:10:21.117743 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1419) took 2130 ms. Trace:
I20260709 13:10:20.438585   670 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.204952 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:21.204859 30552 rpcz_store.cc:276] 0709 13:10:18.986921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.091540 (+104619us) service_pool.cc:224] Handling call
0709 13:10:20.778205 (+1686665us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:21.117671 (+339466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847325952}
I20260709 13:10:20.748112   512 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:20.892371   633 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 2.347s	user 0.004s	sys 0.004s
I20260709 13:10:20.960275 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:20.463068   506 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:20.776434   682 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.113s	user 0.000s	sys 0.005s
W20260709 13:10:20.562480   537 consensus_meta.cc:287] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.943s	user 0.010s	sys 0.012s
W20260709 13:10:20.601140   688 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:21.081368 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:21.225692 30411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.006s	sys 0.013s
W20260709 13:10:21.257411 30411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.007s	sys 0.013s
I20260709 13:10:21.257594 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1679) took 1110 ms. Trace:
I20260709 13:10:21.258312 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1746) took 1056 ms. Trace:
I20260709 13:10:20.698918   704 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.789201 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1669) took 2042 ms. Trace:
I20260709 13:10:20.790860 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:20.507890   701 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:20.419864   687 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.973344 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1420) took 1467 ms. Trace:
W20260709 13:10:20.700134   707 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:10:21.223178   712 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:20.768417   674 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.109s	user 0.005s	sys 0.001s
W20260709 13:10:20.777758   663 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.118s	user 0.002s	sys 0.003s
W20260709 13:10:20.512475   556 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.002s
I20260709 13:10:20.663157   721 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:20.464294 32590 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:20.507584   699 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.438767   460 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.262049   525 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.507726   697 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.667698   705 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.423241 32750 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:20.790005 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1755) took 1584 ms. Trace:
I20260709 13:10:20.420256   684 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.305614   684 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.306103   684 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.262646 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.276881   506 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:20.751902   337 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:21.251307 30451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.006s	sys 0.017s
I20260709 13:10:20.450971   631 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.752219   667 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:20.511204   515 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:20.508044   703 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:20.747356   444 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.258793 30411 rpcz_store.cc:276] 0709 13:10:20.201829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.283381 (+ 81552us) service_pool.cc:224] Handling call
0709 13:10:20.283662 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.283857 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:20.314889 (+ 31032us) log.cc:844] Serialized 14 byte log entry
0709 13:10:21.257993 (+943104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.258054 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:21.258100 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.258161 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.258262 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31000,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"thread_start_us":942694,"threads_started":1}
I20260709 13:10:20.638423   495 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:20.697216   591 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.615288   686 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:20.671048   690 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.513993   657 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:20.451613   698 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:10:21.085557   693 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.849s	user 0.007s	sys 0.003s
I20260709 13:10:21.268764 30556 rpcz_store.cc:276] 0709 13:10:19.506059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.785354 (+1279295us) service_pool.cc:224] Handling call
0709 13:10:20.973255 (+187901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.303741   525 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.601317   692 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:21.261868 30483 rpcz_store.cc:276] 0709 13:10:18.746672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.747789 (+  1117us) service_pool.cc:224] Handling call
0709 13:10:18.778646 (+ 30857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.246073 (+467427us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:19.259682 (+ 13609us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.682582 (+422900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.682646 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:19.682721 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.788904 (+1106183us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540017b1d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:20.788955 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.789114 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2831,"prepare.queue_time_us":139894,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":126328,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":1074267904,"thread_start_us":421358,"threads_started":1,"wal-append.queue_time_us":589120}
I20260709 13:10:21.221040 30485 rpcz_store.cc:276] 0709 13:10:19.205683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.798916 (+593233us) service_pool.cc:224] Handling call
0709 13:10:19.799252 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.887549 (+ 88297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.887579 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.950000 (+ 62421us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.286886 (+336886us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:20.286938 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.287019 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.511071 (+224052us) raft_consensus.cc:1685] finished
0709 13:10:20.511093 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.511245 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21066,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":351866,"threads_started":2,"wal-append.queue_time_us":502470}
I20260709 13:10:21.084125   645 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:20.751283   689 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.962956   517 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:21.081858   628 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:20.507261   594 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.082075   647 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.235029   636 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.404287   666 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:20.404704   558 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:20.404467   604 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.309022   697 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.088018   668 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:21.280442   711 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.824169   574 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:21.249007   661 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:21.267922   701 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:21.285077 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.296639   702 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:21.299384 30480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1668) took 2553 ms (client timeout 2099 ms). Trace:
W20260709 13:10:21.300381 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.515848 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1751) took 2334 ms. Trace:
I20260709 13:10:20.785682   635 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:20.561456   641 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.715s
I20260709 13:10:21.501011   628 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:20.386565   651 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.257958 30482 rpcz_store.cc:276] 0709 13:10:20.147171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.230714 (+1083543us) service_pool.cc:224] Handling call
0709 13:10:21.257083 (+ 26369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.257257 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.257281 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.257322 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:21.257351 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.257402 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.257539 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.270958   704 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.303591 30478 rpcz_store.cc:276] 0709 13:10:19.205378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.666785 (+461407us) service_pool.cc:224] Handling call
0709 13:10:19.667060 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.853170 (+186110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.853205 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.853244 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:19.853277 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.789779 (+936502us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54000c9754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:20.789830 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.789949 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427589504}
I20260709 13:10:21.516363 30481 rpcz_store.cc:276] 0709 13:10:19.181311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.182286 (+   975us) service_pool.cc:224] Handling call
0709 13:10:19.182681 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:19.524998 (+342317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.525052 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:19.528661 (+  3609us) log.cc:844] Serialized 52 byte log entry
0709 13:10:19.850502 (+321841us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:19.869799 (+ 19297us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.871846 (+  2047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.871951 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.515665 (+1643714us) raft_consensus.cc:1685] finished
0709 13:10:21.515683 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.515797 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12498,"prepare.queue_time_us":19312,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":464226,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":24807,"thread_start_us":559754,"threads_started":2,"wal-append.queue_time_us":619622}
I20260709 13:10:20.922199 30554 rpcz_store.cc:276] 0709 13:10:18.985401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.985584 (+   183us) service_pool.cc:224] Handling call
0709 13:10:20.747620 (+1762036us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:20.747846 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.921344 (+173498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.921511 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10561408}
W20260709 13:10:21.310254   678 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.647s	user 0.005s	sys 0.002s
I20260709 13:10:21.311241 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.310283   684 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.312623 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.513640   574 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:21.318868   705 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.321034   670 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.322597   658 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.501415   647 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.279981   721 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:21.261504   537 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:20.955585   410 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.343870   631 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:21.366783 30452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.023s	sys 0.028s
W20260709 13:10:21.562598 30452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.024s	sys 0.028s
W20260709 13:10:21.367137 30477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.023s	sys 0.046s
W20260709 13:10:21.565681 30477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.023s	sys 0.046s
W20260709 13:10:21.368438 30450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.009s	sys 0.046s
W20260709 13:10:21.569339 30450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.009s	sys 0.046s
W20260709 13:10:21.572099 30450 connection.cc:256] RPC call timeout handler was delayed by -1.1902159170000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:10:21.572625 30450 connection.cc:256] RPC call timeout handler was delayed by -1.1768033380000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:10:21.573269 30450 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.508s (SENT)
I20260709 13:10:21.573752 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:21.356773   674 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:10:21.357002   663 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:21.279583   556 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.599004   556 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.435721 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.600884 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.284225 32590 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:21.439013 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.018s	sys 0.011s
W20260709 13:10:21.603507 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.018s	sys 0.012s
I20260709 13:10:21.603950   705 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.513994   668 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.604725 32590 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:20.778921   685 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:21.461246   720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.008s	sys 0.018s
W20260709 13:10:21.439127 31119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.027s	sys 0.060s
I20260709 13:10:21.463354 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:21.463092   523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.006s
W20260709 13:10:21.467407   643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.008s
I20260709 13:10:21.278357   687 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.602355 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.493726 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1681) took 1346 ms. Trace:
I20260709 13:10:21.301895   699 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:21.464352   629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.006s	sys 0.030s
I20260709 13:10:21.467056   645 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:20.962713   627 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.315s
I20260709 13:10:21.492472   517 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:21.408869   703 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.461781   693 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.497977   460 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:21.515731 30480 rpcz_store.cc:269] 0709 13:10:18.746392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.747703 (+  1311us) service_pool.cc:224] Handling call
0709 13:10:21.299099 (+2551396us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b540017b6d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:21.299284 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68623232}
I20260709 13:10:21.277251   712 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:21.305027 32750 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:21.531383 30449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.019s	sys 0.003s
W20260709 13:10:21.664332 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.019s	sys 0.004s
I20260709 13:10:21.532635 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1766) took 1328 ms. Trace:
W20260709 13:10:21.504146   713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.006s	sys 0.014s
I20260709 13:10:21.438256   686 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.546440 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:21.317457 30403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 346) took 2513 ms (client timeout 2865 ms). Trace:
I20260709 13:10:21.547536 30552 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:21.479853   506 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.513005   661 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:21.546859 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1418) took 2560 ms. Trace:
I20260709 13:10:21.518817   701 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.683009 30410 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:21.548925 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.478500   692 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.498992   594 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:21.341758 30451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.006s	sys 0.017s
W20260709 13:10:21.667508   713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.008s	sys 0.014s
W20260709 13:10:21.689283 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.30794e+06us
I20260709 13:10:21.668193   712 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:21.651002   732 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:21.565843   717 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:10:21.583154   722 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:10:21.585701   704 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.586202   679 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.586879   574 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.590324   537 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.559454   721 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:21.592360   631 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.561362   628 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.595566   558 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.596065 30408 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:21.595965   635 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.605943   668 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.606062   410 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.607210   647 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.607079   730 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:21.607470   651 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:21.608258 31119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.027s	sys 0.060s
W20260709 13:10:21.611172 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 177428us
W20260709 13:10:21.479318 30486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.009s	sys 0.023s
W20260709 13:10:21.786770 30486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.755s	user 0.009s	sys 0.023s
W20260709 13:10:21.635825 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 172545us
W20260709 13:10:21.609236   523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.004s	sys 0.007s
W20260709 13:10:21.582675   724 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:10:21.612982 30483 rpcz_store.cc:276] 0709 13:10:20.201236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.463753 (+1262517us) service_pool.cc:224] Handling call
0709 13:10:21.493004 (+ 29251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.493254 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.493294 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.493355 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:21.493407 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.493495 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.493648 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:21.640945 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67711.5us
W20260709 13:10:21.612488   643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.007s	sys 0.008s
W20260709 13:10:21.612586   720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.009s	sys 0.019s
W20260709 13:10:21.637385   629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.007s	sys 0.031s
I20260709 13:10:21.665096 30481 rpcz_store.cc:276] 0709 13:10:20.203837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.531827 (+1327990us) service_pool.cc:224] Handling call
0709 13:10:21.532121 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.532301 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.532327 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.532371 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:21.532405 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.532464 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.532578 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:21.650151 32758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.012s	sys 0.047s
W20260709 13:10:21.651561   715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.026s	sys 0.068s
I20260709 13:10:21.638741   630 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:21.678210 30403 rpcz_store.cc:269] 0709 13:10:18.804216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.804342 (+   126us) service_pool.cc:224] Handling call
0709 13:10:21.317256 (+2512914us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002a5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:21.317377 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2423060224}
I20260709 13:10:21.611768   685 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:21.806923   715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.026s	sys 0.069s
I20260709 13:10:21.807374 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.681655 30558 rpcz_store.cc:276] 0709 13:10:18.986634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.092717 (+106083us) service_pool.cc:224] Handling call
0709 13:10:21.312421 (+2219704us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:21.546789 (+234368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37000960}
I20260709 13:10:21.808650 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.684238 30406 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:21.686317 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:21.811247 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.812270 30480 raft_consensus.cc:2410] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:10:21.561491 30526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.031s	sys 0.058s
W20260709 13:10:21.812808 30526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.031s	sys 0.059s
I20260709 13:10:21.663252   525 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.691012 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1684) took 1488 ms. Trace:
I20260709 13:10:21.689971 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.653329   667 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:21.819873   667 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.690029 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:21.710779 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.668731   697 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.681541 32750 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.677973   460 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.679219 32590 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:21.763568 30409 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:21.773896 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1732) took 1959 ms. Trace:
I20260709 13:10:21.775864 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 356) took 1074 ms. Trace:
W20260709 13:10:21.784667   723 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 13:10:21.804620 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:21.688809   645 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.782963   661 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:21.806056   738 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:10:21.806372 32758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.013s	sys 0.047s
I20260709 13:10:21.806206 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.784737   730 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.819125 30485 rpcz_store.cc:276] 0709 13:10:20.202117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.464088 (+1261971us) service_pool.cc:224] Handling call
0709 13:10:21.464445 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.464692 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:21.680849 (+216157us) log.cc:844] Serialized 14 byte log entry
0709 13:10:21.690618 (+  9769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.690671 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:21.690741 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.690805 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.690935 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3890,"prepare.queue_time_us":138195,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"raft.queue_time_us":19359,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":51662,"spinlock_wait_cycles":3306368,"thread_start_us":224645,"threads_started":2,"wal-append.queue_time_us":85092}
W20260709 13:10:21.896859 31116 connection.cc:256] RPC call timeout handler was delayed by -1.4592149439999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:10:21.890184 30560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1627) took 3631 ms (client timeout 2220 ms). Trace:
I20260709 13:10:21.905261 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.906136 30552 rpcz_store.cc:276] 0709 13:10:20.701556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.234051 (+532495us) service_pool.cc:224] Handling call
0709 13:10:21.234373 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.681090 (+446717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.775638 (+ 94548us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000ee2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:21.775804 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719746944}
I20260709 13:10:21.908305 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:21.905762 30407 rpcz_store.cc:276] 0709 13:10:19.814193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.814371 (+   178us) service_pool.cc:224] Handling call
0709 13:10:19.815023 (+   652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.890597 (+ 75574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.890625 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.891068 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.326144 (+435076us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:20.326178 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.773508 (+1447330us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54002878d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:21.773559 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.773604 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:21.773618 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.773834 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173241600,"thread_start_us":434805,"threads_started":1,"wal-append.queue_time_us":492553}
I20260709 13:10:21.905001 30410 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:21.901726 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.911294 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 354) took 1210 ms. Trace:
I20260709 13:10:21.911690 30557 rpcz_store.cc:276] 0709 13:10:20.700993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.962516 (+261523us) service_pool.cc:224] Handling call
0709 13:10:20.962815 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.344711 (+381896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.344741 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.344779 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:21.344813 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.911072 (+566259us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400070dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:21.911116 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.911239 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877869824}
I20260709 13:10:21.904868 30483 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:21.914577 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.871059 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1747) took 1669 ms. Trace:
I20260709 13:10:21.916374 30405 rpcz_store.cc:276] 0709 13:10:20.202081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.285633 (+ 83552us) service_pool.cc:224] Handling call
0709 13:10:20.285916 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.382571 (+ 96655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.382618 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.419502 (+ 36884us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.916744 (+497242us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:20.916804 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.916903 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.870783 (+953880us) raft_consensus.cc:1685] finished
0709 13:10:21.870804 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.870980 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42935,"raft.queue_time_us":210904,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":123399,"thread_start_us":535619,"threads_started":2,"wal-append.queue_time_us":879718}
I20260709 13:10:21.919440 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.920192 30405 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:21.905916 30560 rpcz_store.cc:269] 0709 13:10:18.258439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.258609 (+   170us) service_pool.cc:224] Handling call
0709 13:10:21.889973 (+3631364us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400186354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:21.890113 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629567360}
I20260709 13:10:21.915292 30483 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:21.922159 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.922830 30480 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:21.923166 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.923734 30403 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:21.923938 30483 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:21.793416   537 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.925091 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.929716 30483 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:21.928251 30481 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:21.837685   737 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:10:21.800710   736 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:10:21.928854 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:21.888025   747 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:21.935261 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:21.939244 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.943531 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:21.944029 30410 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:21.940215 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.945384 30403 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:21.941368 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.942057 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.941967 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.943531 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.957472 30560 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:21.957513 30404 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:21.890801   629 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.891113   720 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.979358 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:21.980039 30407 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:21.890960   523 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.993643   523 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.994395 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.995713 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.891650   687 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.996208   631 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.870491   635 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:21.996730   631 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:21.996958   635 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.967557 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.998589 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.887990   703 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.999192 30552 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:21.980549 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1429) took 1019 ms. Trace:
I20260709 13:10:22.007236 30407 rpcz_store.cc:276] 0709 13:10:20.961335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.928339 (+967004us) service_pool.cc:224] Handling call
0709 13:10:21.980495 (+ 52156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.980772 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:21.870803   734 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.828245   667 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.921721   554 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.984210 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 356) took 1637 ms. Trace:
I20260709 13:10:21.974493   556 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.989652   720 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:21.990134   685 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:21.995795   523 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.894385   594 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:22.000007 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:22.000305 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.005259   640 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.996886 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:21.969295 30376 connection.cc:256] RPC call timeout handler was delayed by -3.8607736400000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:21.921348   725 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:22.006536 30555 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:22.008687 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:21.939045   645 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.012691 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:21.921679   699 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:22.021160 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.026232 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1748) took 1823 ms. Trace:
I20260709 13:10:22.081733 30408 rpcz_store.cc:276] 0709 13:10:20.202322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.381375 (+179053us) service_pool.cc:224] Handling call
0709 13:10:20.420737 (+ 39362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.772041 (+1351304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.025914 (+253873us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003eec54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:22.026157 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663700864}
I20260709 13:10:22.026945   641 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:21.943290   661 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:22.056173 31148 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.027369   631 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:22.033661 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:21.987186   730 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:22.103313   748 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:22.105129 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.036983 30404 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.105453 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:22.105131   701 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.106261 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1412) took 1187 ms. Trace:
I20260709 13:10:22.106613 30404 rpcz_store.cc:276] 0709 13:10:20.918409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.984237 (+1065828us) service_pool.cc:224] Handling call
0709 13:10:22.031575 (+ 47338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.106018 (+ 74443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.106207 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:22.107182   749 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:10:22.107610 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.107839   701 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:22.075922   636 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.108199 30404 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:22.108565   636 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.037947 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1741) took 2184 ms. Trace:
I20260709 13:10:22.109318 30484 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.109279 30406 rpcz_store.cc:276] 0709 13:10:19.854044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.959288 (+105244us) service_pool.cc:224] Handling call
0709 13:10:19.959579 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.810050 (+1850471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.037716 (+227666us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54002a53d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:22.037881 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3965876480}
I20260709 13:10:22.037740 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.110185 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:22.111008 30551 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:10:22.111570 30551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1415) took 3125 ms (client timeout 1578 ms). Trace:
W20260709 13:10:22.040706 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.110512 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.112687 30406 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:22.113715 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.114362 30406 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:21.921434   460 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.060138 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.117465   460 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:21.965198 30557 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:22.061326 30407 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:22.119175 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1413) took 1200 ms. Trace:
I20260709 13:10:22.119588 30407 rpcz_store.cc:276] 0709 13:10:20.918719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.030536 (+1111817us) service_pool.cc:224] Handling call
0709 13:10:22.061047 (+ 30511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.118880 (+ 57833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.119114 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.120749 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.122083 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.000819   647 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.122887   647 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:22.123507   647 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:21.928048 32590 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.128207 32590 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:21.940729   537 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.130441   537 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:22.009941   709 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:22.131316   709 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.133276   711 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:22.133785   711 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.133814   709 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:22.079239 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71681us
I20260709 13:10:22.032037   512 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.051590   554 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.134969   512 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:22.135380   512 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.136018 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.136498   554 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:22.139638 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 353) took 1439 ms. Trace:
I20260709 13:10:22.140020 30553 rpcz_store.cc:276] 0709 13:10:20.700725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.963300 (+262575us) service_pool.cc:224] Handling call
0709 13:10:20.963505 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.550822 (+587317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.550852 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.550898 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:21.550931 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.139433 (+588502us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54001d97d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:22.139475 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.139587 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350251392}
I20260709 13:10:22.142313   657 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.142724   657 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:22.143131 31116 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:22.143499   657 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.144088 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:22.144536   657 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.145543 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 355) took 1444 ms. Trace:
I20260709 13:10:22.145922 30559 rpcz_store.cc:276] 0709 13:10:20.701266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.963193 (+261927us) service_pool.cc:224] Handling call
0709 13:10:20.963477 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.653771 (+690294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.653815 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.653876 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:21.653923 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.145335 (+491412us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540039fb54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:22.145374 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.145487 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586998656}
I20260709 13:10:22.086169 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:22.087270 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74671.4us
I20260709 13:10:22.037098   734 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.161572   686 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:22.088389 31117 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:22.030556 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 233578us
I20260709 13:10:22.162669   693 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:22.163163 30450 connection.cc:256] RPC call timeout handler was delayed by -1.0434618859999318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:10:22.163635   734 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:22.095434 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:22.164112   625 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:22.164561   625 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:22.164584 30554 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.165562   625 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.166853   625 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:21.998616   629 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.089907 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.099541   628 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.095661 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.179970 30408 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:22.032428 30402 rpcz_store.cc:276] 0709 13:10:20.346501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.983376 (+1636875us) service_pool.cc:224] Handling call
0709 13:10:21.983666 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.983858 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.983887 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.983930 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:21.983963 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.984032 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.984147 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.180491 30555 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:22.050336 30481 raft_consensus.cc:2410] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:22.183460 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:22.184967 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:22.185631 30481 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:22.115521 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.122954   720 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:22.073928 30376 connection.cc:256] RPC call timeout handler was delayed by -2.1019257169999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:10:22.146826 30407 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:22.147673 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.188812 30406 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:22.147876 31147 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:10:22.111943 30551 rpcz_store.cc:269] 0709 13:10:18.985778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.985904 (+   126us) service_pool.cc:224] Handling call
0709 13:10:22.037538 (+3051634us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:22.111501 (+ 73963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45162880}
I20260709 13:10:22.111935   636 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:22.150312 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:22.192360 30554 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:22.151173 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:22.151635   558 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.152073   641 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.193801   558 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:22.151854   512 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.057582   556 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.155548   721 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.155771 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:22.213068 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 185604us
I20260709 13:10:22.213320 30411 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.085868 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:22.096742 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.186498 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:22.152916   647 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.205822 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.218111 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:22.218452 30408 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:22.214293 30480 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 3.
I20260709 13:10:22.215077 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:22.217350 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 129933us
I20260709 13:10:22.195564   574 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.272660 30481 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:22.274129 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.316090 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:22.316672 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:22.319264 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 108722us
I20260709 13:10:22.209029   558 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.336189 30485 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.327514 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:22.327601 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.330106 30558 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:22.328990 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:22.339039 30481 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:22.340816 30558 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:22.341231 30481 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:22.342667 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:22.345782 30557 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.359566 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.091881   725 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.319929   651 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.387588 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.376716 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:22.314640   655 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:22.273555   692 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:22.342474 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:22.320953   643 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:22.195047   712 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.402933 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:22.410602 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:22.412175 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:22.404364 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:22.405089 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.406281 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:22.344425   739 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:22.415062 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.204131   628 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.373098   639 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:22.418500 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:22.343636 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:22.428994 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.433634 30411 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:22.343911   758 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:22.437090 30558 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:22.455864 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:22.456370 30558 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.430487 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:22.448390 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44142.4us
I20260709 13:10:22.453052   757 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.461408 30405 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:22.402756   655 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.465193 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:22.418076   635 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:22.476115 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 132599us
I20260709 13:10:22.453436 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.387598   720 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:10:22.453764   751 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 13:10:22.407444   553 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:22.400561   506 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.486248   506 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.498134 30558 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:22.460505   523 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.456048   766 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 5 LEARNER]: Advancing to term 6
I20260709 13:10:22.460202   667 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.413924   651 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.468233   655 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.449251   624 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:10:22.476701   758 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:22.525509 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:22.441615   643 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:22.478861   757 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.500771   635 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:22.506269   523 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.543963   517 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.548444   648 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:22.510434   734 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:22.575563   635 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.551254 30558 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:23.145081 30404 raft_consensus.cc:2410] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:23.147761 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1427) took 2186 ms. Trace:
I20260709 13:10:23.185228 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1654) took 1017 ms. Trace:
I20260709 13:10:23.209846 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1762) took 3007 ms. Trace:
I20260709 13:10:23.208485 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1776) took 1437 ms. Trace:
W20260709 13:10:23.128832 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.183377 30526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.000s	sys 0.011s
W20260709 13:10:23.179939 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.183007 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.007s	sys 0.004s
W20260709 13:10:23.169879 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.185047 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.133608 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.180956 30524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.000s	sys 0.008s
I20260709 13:10:22.553418   757 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.207041 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1690) took 1630 ms. Trace:
W20260709 13:10:23.160427 30409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1431) took 2198 ms (client timeout 1761 ms). Trace:
I20260709 13:10:22.580384   523 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:23.204605 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.51443e+06us
W20260709 13:10:23.291988 30526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.004s	sys 0.014s
I20260709 13:10:23.294365   512 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.295543   517 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.155220 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.136811 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.296505 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1750) took 4115 ms. Trace:
I20260709 13:10:23.297575   410 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:23.285055 30524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.003s	sys 0.021s
W20260709 13:10:22.658295   754 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:10:23.145507 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:22.577091   670 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:22.942584   661 consensus_meta.cc:287] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.835s	user 0.003s	sys 0.010s
W20260709 13:10:23.056084   766 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.523s	user 0.016s	sys 0.000s
W20260709 13:10:22.827096   771 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:10:23.287510 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.009s	sys 0.009s
W20260709 13:10:22.829272   756 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.495s	user 0.004s	sys 0.000s
W20260709 13:10:22.838289   763 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.257s	user 0.000s	sys 0.003s
I20260709 13:10:23.296550 32590 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.307543 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.000s	sys 0.008s
I20260709 13:10:22.655385   648 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:22.591118   647 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:22.824489   711 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.005s
I20260709 13:10:22.595312   629 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.399573   648 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:22.697466   641 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.401499   648 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:22.681922   627 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.679699   725 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.350488 30402 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:10:23.292514 30409 rpcz_store.cc:269] 0709 13:10:20.961869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.548606 (+586737us) service_pool.cc:224] Handling call
0709 13:10:23.159981 (+1611375us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b5400285ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.160208 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15994752}
I20260709 13:10:22.874650   643 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:22.774487   765 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:10:22.581422   734 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.381426 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 364) took 1148 ms. Trace:
I20260709 13:10:23.389465 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1755) took 1374 ms. Trace:
W20260709 13:10:23.375185 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 914454us
I20260709 13:10:22.680488   628 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.255987 30554 rpcz_store.cc:276] 0709 13:10:22.167875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.192855 (+ 24980us) service_pool.cc:224] Handling call
0709 13:10:22.193191 (+   336us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:22.207855 (+ 14664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.207881 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:22.208403 (+   522us) log.cc:844] Serialized 78 byte log entry
0709 13:10:22.458225 (+249822us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:23.181739 (+723514us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.183393 (+  1654us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.183902 (+   509us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.184235 (+   333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.184483 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.184595 (+   112us) raft_consensus.cc:1685] finished
0709 13:10:23.184616 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.184929 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27972,"prepare.queue_time_us":260012,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":128,"raft.queue_time_us":281419,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":109869,"spinlock_wait_cycles":73032576,"thread_start_us":306477,"threads_started":2,"wal-append.queue_time_us":391645}
I20260709 13:10:23.422278 30406 rpcz_store.cc:276] 0709 13:10:22.220723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.144963 (+924240us) service_pool.cc:224] Handling call
0709 13:10:23.368720 (+223757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.249605 30405 rpcz_store.cc:276] 0709 13:10:20.960840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.928582 (+967742us) service_pool.cc:224] Handling call
0709 13:10:23.147170 (+1218588us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54001293d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.147506 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191515008}
I20260709 13:10:22.876457   712 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.420822 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1441) took 1223 ms. Trace:
W20260709 13:10:23.394833 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.000s	sys 0.008s
W20260709 13:10:23.407207 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.257865 30481 rpcz_store.cc:276] 0709 13:10:21.770665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.350110 (+579445us) service_pool.cc:224] Handling call
0709 13:10:22.350462 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.351530 (+  1068us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:22.524917 (+173387us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.207679 (+682762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.207809 (+   130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:23.207929 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.208064 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.208299 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706273,"prepare.queue_time_us":103470,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":774200,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":148751,"threads_started":1}
I20260709 13:10:22.659941   556 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.420248   639 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:23.459537 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1750) took 3213 ms. Trace:
W20260709 13:10:23.425334   645 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.327s	user 0.009s	sys 0.004s
I20260709 13:10:23.337260   410 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:23.461803 30408 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:23.462824   624 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.463284   711 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.331213 30486 rpcz_store.cc:276] 0709 13:10:19.180939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.182070 (+  1131us) service_pool.cc:224] Handling call
0709 13:10:19.483536 (+301466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:19.863999 (+380463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.864034 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:19.871519 (+  7485us) log.cc:844] Serialized 52 byte log entry
0709 13:10:21.787170 (+1915651us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:21.813775 (+ 26605us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.295492 (+1481717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.295667 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.295749 (+    82us) raft_consensus.cc:1685] finished
0709 13:10:23.295760 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.296255 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1432059,"prepare.queue_time_us":33789,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":1507393,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":234,"thread_start_us":1819428,"threads_started":2,"wal-append.queue_time_us":1619203,"wal-append.run_cpu_time_us":2938,"wal-append.run_wall_time_us":1257325}
I20260709 13:10:23.467787   651 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.468997   766 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:23.442867 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.470417 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 1.32725e+06us
I20260709 13:10:23.443372   636 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.472303   636 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.473416 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:23.256542 30478 rpcz_store.cc:276] 0709 13:10:20.202735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.530561 (+1327826us) service_pool.cc:224] Handling call
0709 13:10:21.530895 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.531114 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:21.684006 (+152892us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.209093 (+1525087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.209229 (+   136us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.209348 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.209459 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.209640 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1426707,"prepare.queue_time_us":71943,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":1517805,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":168,"thread_start_us":250231,"threads_started":2,"wal-append.queue_time_us":242577,"wal-append.run_cpu_time_us":2221,"wal-append.run_wall_time_us":1380320}
I20260709 13:10:23.475880 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.476466   690 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:23.476720 30478 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:10:23.447351 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 982181us
I20260709 13:10:23.447860 32590 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:23.453169   655 consensus_meta.cc:287] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.003s
I20260709 13:10:23.477427   690 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.456344 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.479257 30481 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:23.479965 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1703) took 1028 ms. Trace:
I20260709 13:10:23.456866   627 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:23.480559   643 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.447806 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.458405 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:23.481395   643 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.461920   410 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.482848 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1660) took 1085 ms. Trace:
I20260709 13:10:23.463495   624 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.483374 30558 rpcz_store.cc:276] 0709 13:10:22.340785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.549265 (+208480us) service_pool.cc:224] Handling call
0709 13:10:22.550727 (+  1462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.332204 (+781477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.426187 (+ 93983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.485365 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.486295 30486 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:23.487038   628 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.480803   556 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:10:23.488241   628 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:23.489801   538 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:23.490882   734 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.459985 30403 rpcz_store.cc:276] 0709 13:10:20.245822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.979209 (+1733387us) service_pool.cc:224] Handling call
0709 13:10:21.979562 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.979972 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.980007 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.980545 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.178632 (+198087us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:22.178671 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.178763 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.459054 (+1280291us) raft_consensus.cc:1685] finished
0709 13:10:23.459116 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.459312 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28960,"raft.queue_time_us":2011,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":192900,"threads_started":1,"wal-append.queue_time_us":469611}
I20260709 13:10:23.478117   655 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.492621   712 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.477442 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1705) took 1025 ms. Trace:
I20260709 13:10:23.481137 30481 rpcz_store.cc:276] 0709 13:10:22.451640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.455858 (+1004218us) service_pool.cc:224] Handling call
0709 13:10:23.479880 (+ 24022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.546411 30478 rpcz_store.cc:276] 0709 13:10:22.452100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.475503 (+1023403us) service_pool.cc:224] Handling call
0709 13:10:23.477324 (+  1821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.487039 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1790) took 1104 ms. Trace:
I20260709 13:10:23.547209 30486 rpcz_store.cc:276] 0709 13:10:22.382271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.465815 (+1083544us) service_pool.cc:224] Handling call
0709 13:10:23.486874 (+ 21059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.480036 32590 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.442659   726 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:23.551676   705 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:23.552619   703 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.441888   721 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:22.680810   758 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:23.543327 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52651.3us
I20260709 13:10:23.435788 30402 rpcz_store.cc:276] 0709 13:10:22.189796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.136066 (+946270us) service_pool.cc:224] Handling call
0709 13:10:23.412673 (+276607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.422410 30407 rpcz_store.cc:276] 0709 13:10:22.015008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.154743 (+1139735us) service_pool.cc:224] Handling call
0709 13:10:23.389385 (+234642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.553277   703 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:23.493873   538 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.562006 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1759) took 4355 ms. Trace:
W20260709 13:10:23.571722 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.292537 30480 rpcz_store.cc:276] 0709 13:10:21.576826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.219139 (+642313us) service_pool.cc:224] Handling call
0709 13:10:22.324509 (+105370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.324745 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:22.378661 (+ 53916us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.205845 (+827184us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.206150 (+   305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.206214 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:23.206303 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.206437 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.206739 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728496,"prepare.queue_time_us":43401,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":161,"raft.queue_time_us":915144,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":509,"thread_start_us":97317,"threads_started":1,"wal-append.queue_time_us":206950}
I20260709 13:10:23.605414 30406 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:23.606381 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1417) took 2686 ms. Trace:
I20260709 13:10:23.606516 30402 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:10:23.606992 30402 pending_rounds.cc:85] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 3
I20260709 13:10:23.606810 30406 rpcz_store.cc:276] 0709 13:10:20.919948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.553789 (+2633841us) service_pool.cc:224] Handling call
0709 13:10:23.591343 (+ 37554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.606041 (+ 14698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.606291 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.607452 30402 pending_rounds.cc:107] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:10:23.608032 30402 raft_consensus.cc:2889] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.608844 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 361) took 1601 ms. Trace:
I20260709 13:10:23.608978 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1762) took 1590 ms. Trace:
I20260709 13:10:23.609434 30402 rpcz_store.cc:276] 0709 13:10:22.018730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.591678 (+1572948us) service_pool.cc:224] Handling call
0709 13:10:23.606095 (+ 14417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.608680 (+  2585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.608885 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.609295 30553 rpcz_store.cc:276] 0709 13:10:22.006951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.141050 (+134099us) service_pool.cc:224] Handling call
0709 13:10:22.141342 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.179598 (+ 38256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.179640 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.179697 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:22.179745 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.608354 (+1428609us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54001e4bd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.608423 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.608662 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87463808}
I20260709 13:10:23.612403 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 360) took 1521 ms. Trace:
I20260709 13:10:23.612864 30406 rpcz_store.cc:276] 0709 13:10:22.090827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.611124 (+1520297us) service_pool.cc:224] Handling call
0709 13:10:23.611550 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.611926 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.611962 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.612044 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:23.612090 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.612158 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.612315 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.615532 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1678) took 3468 ms. Trace:
I20260709 13:10:23.616015 30484 rpcz_store.cc:276] 0709 13:10:20.146880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.921137 (+774257us) service_pool.cc:224] Handling call
0709 13:10:20.921370 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.109769 (+1188399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.615008 (+1505239us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400343ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.615327 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731683584}
I20260709 13:10:23.584041   538 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:23.620352   574 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.295s	user 0.014s	sys 0.004s
I20260709 13:10:23.577121 30477 rpcz_store.cc:276] 0709 13:10:19.206479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.370825 (+1164346us) service_pool.cc:224] Handling call
0709 13:10:20.371261 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.371663 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.371699 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.384112 (+ 12413us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.032767 (+1648655us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b1800402ee0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1
0709 13:10:23.553426 (+1520659us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400295f20. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450206b8 00007fa0450a992b 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c
0709 13:10:23.561192 (+  7766us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:23.561298 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.561425 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.561524 (+    99us) raft_consensus.cc:1685] finished
0709 13:10:23.561544 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.561783 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":291087,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"spinlock_wait_cycles":57869824,"thread_start_us":1096544,"threads_started":1,"wal-append.queue_time_us":1121904,"wal-append.run_cpu_time_us":9211,"wal-append.run_wall_time_us":1734854}
I20260709 13:10:23.624442 30409 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:23.625387 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1414) took 2706 ms. Trace:
I20260709 13:10:23.625805 30409 rpcz_store.cc:276] 0709 13:10:20.919134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.500600 (+2581466us) service_pool.cc:224] Handling call
0709 13:10:23.624016 (+123416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.625011 (+   995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.625292 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.576923   703 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.629019   645 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:23.629667   645 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:23.627223   711 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.629848   776 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:23.632261   645 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:23.632800 32750 consensus_meta.cc:287] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.694s	user 0.004s	sys 0.011s
I20260709 13:10:23.632879   776 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:23.633389 32750 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.634828 30552 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:23.636653 30552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1653) took 1540 ms (client timeout 1786 ms). Trace:
W20260709 13:10:23.637123 30552 rpcz_store.cc:269] 0709 13:10:22.096191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.104863 (+  8672us) service_pool.cc:224] Handling call
0709 13:10:23.636257 (+1531394us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002472d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.636492 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3515467648}
I20260709 13:10:23.628376 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:23.552804   726 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:23.683696   556 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.683537 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.687505 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.685875 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 359) took 1605 ms. Trace:
I20260709 13:10:23.665333   647 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:23.697638 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.692309 30402 rpcz_store.cc:276] 0709 13:10:22.080750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.638149 (+1557399us) service_pool.cc:224] Handling call
0709 13:10:23.684938 (+ 46789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.685360 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.685396 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.685468 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:23.685549 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.685634 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.685786 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.576704   712 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.707260   506 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.707697   510 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:23.696215 31145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43936 (request call id 369) took 1713 ms (client timeout 1606 ms). Trace:
I20260709 13:10:23.696790   476 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.708837 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.709808 30409 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
W20260709 13:10:23.708670 31145 rpcz_store.cc:269] 0709 13:10:21.982849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.996437 (+ 13588us) service_pool.cc:224] Handling call
0709 13:10:23.674361 (+1677924us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800142898. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:23.696078 (+ 21717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9546112}
I20260709 13:10:23.712029   690 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:23.716915 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 88701.9us
I20260709 13:10:23.717896 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:23.719044   553 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.719517   553 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:23.719892   643 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.720012   553 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.722487   734 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.730988   628 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:23.731292   558 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.359s	user 0.020s	sys 0.000s
I20260709 13:10:23.697980   647 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:23.731770   558 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.732497   553 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:23.733059 30555 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:23.732771   647 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.734129   647 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:23.734404 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1655) took 1524 ms. Trace:
I20260709 13:10:23.734815 30555 rpcz_store.cc:276] 0709 13:10:22.209863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.209991 (+   128us) service_pool.cc:224] Handling call
0709 13:10:22.210254 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.733484 (+1523230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.734157 (+   673us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001e5fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.734351 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3501361408}
W20260709 13:10:23.735782 30404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1756) took 1720 ms (client timeout 1868 ms). Trace:
W20260709 13:10:23.736322 30404 rpcz_store.cc:269] 0709 13:10:22.015295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.115250 (+ 99955us) service_pool.cc:224] Handling call
0709 13:10:23.735552 (+1620302us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54002f58d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.735717 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199083392}
I20260709 13:10:23.738962 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1640) took 1746 ms. Trace:
I20260709 13:10:23.734803   553 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.743104 30406 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:23.743994   635 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.696913   655 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.739332 30556 rpcz_store.cc:276] 0709 13:10:21.992016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.997189 (+  5173us) service_pool.cc:224] Handling call
0709 13:10:21.997478 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.080605 (+ 83127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.080637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.093421 (+ 12784us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.345884 (+252463us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:22.345944 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.773706 (+427762us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:23.738367 (+964661us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54000ed8d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.738431 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.738488 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:23.738500 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.738747 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4454,"raft.queue_time_us":3414,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4407,"spinlock_wait_cycles":296795776,"thread_start_us":136511,"threads_started":1,"wal-append.queue_time_us":333058}
I20260709 13:10:23.748250 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.751896 30409 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:23.753165 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.688755   636 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:23.770505 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 121968us
I20260709 13:10:23.789436 30406 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:23.794674 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:23.801561 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:23.804689 30402 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:23.795018 30450 connection.cc:256] RPC call timeout handler was delayed by -1.4991937720000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3214s for a response
W20260709 13:10:23.797693 31118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.002s	sys 0.014s
W20260709 13:10:23.809718 31118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.003s	sys 0.015s
I20260709 13:10:23.770560   643 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:23.808867   625 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 1.568s	user 0.011s	sys 0.005s
I20260709 13:10:23.785641   661 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.811836 30525 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.4:39627 timed out after 1.606s (SENT) [suppressed 8 similar messages]
I20260709 13:10:23.821564   648 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:23.818066 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.3398e+06us
I20260709 13:10:23.101617 30309 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 3, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), now has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:23.815207   781 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.235s	user 0.000s	sys 0.004s
I20260709 13:10:23.829043 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 362) took 1729 ms. Trace:
I20260709 13:10:23.834617 30403 rpcz_store.cc:276] 0709 13:10:22.091385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.784584 (+1693199us) service_pool.cc:224] Handling call
0709 13:10:23.811642 (+ 27058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.820771 (+  9129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.820801 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.820845 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:23.820880 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.820944 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.821055 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.833655 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 360) took 1665 ms. Trace:
I20260709 13:10:23.834753 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:23.837810 30557 rpcz_store.cc:276] 0709 13:10:22.006633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.118210 (+111577us) service_pool.cc:224] Handling call
0709 13:10:22.118530 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.369308 (+250778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.497820 (+1128512us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003098d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.671510 (+173690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522239232}
I20260709 13:10:23.826934   635 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:23.847129 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 82034.6us
I20260709 13:10:23.847177 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.847373   726 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:23.855271 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.856103   625 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.857102 30411 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:23.860589 30402 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:23.867000 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1420) took 2900 ms. Trace:
I20260709 13:10:23.859115 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 361) took 1768 ms. Trace:
I20260709 13:10:23.813889   703 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.856753   625 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.867511 30409 rpcz_store.cc:276] 0709 13:10:22.091125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.776802 (+1685677us) service_pool.cc:224] Handling call
0709 13:10:23.817349 (+ 40547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.852369 (+ 35020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.852403 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.858829 (+  6426us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.858885 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.858945 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.859063 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.867439 30411 rpcz_store.cc:276] 0709 13:10:20.959158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.499044 (+2539886us) service_pool.cc:224] Handling call
0709 13:10:23.675213 (+176169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.858988 (+183775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.859190 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.868476 32758 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:23.875937 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.877583 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 363) took 1657 ms. Trace:
W20260709 13:10:23.895395 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 75322us
I20260709 13:10:23.883198 30406 rpcz_store.cc:276] 0709 13:10:22.220420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.798431 (+1578011us) service_pool.cc:224] Handling call
0709 13:10:23.843713 (+ 45282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.877293 (+ 33580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.877319 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.877358 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.877390 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.877442 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.877533 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.905390 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1749) took 3697 ms. Trace:
I20260709 13:10:23.905838 30410 rpcz_store.cc:276] 0709 13:10:20.202610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.979125 (+1776515us) service_pool.cc:224] Handling call
0709 13:10:21.985107 (+  5982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.195716 (+210609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.195757 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.196302 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.403496 (+207194us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:22.403539 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.403612 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.873558 (+1469946us) raft_consensus.cc:1685] finished
0709 13:10:23.877176 (+  3618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.899917 (+ 22741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24568,"raft.queue_time_us":42355,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":19911,"thread_start_us":377338,"threads_started":2,"wal-append.queue_time_us":1546503}
I20260709 13:10:23.908589   523 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.911136 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1753) took 4729 ms. Trace:
I20260709 13:10:23.911576   712 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.911587 30479 rpcz_store.cc:276] 0709 13:10:19.181947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.492459 (+310512us) service_pool.cc:224] Handling call
0709 13:10:21.299283 (+1806824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.299739 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:21.299778 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.300299 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.527982 (+227683us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:21.528028 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.528098 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:21.785289 (+257191us) raft_consensus.cc:1685] finished
0709 13:10:21.785314 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.910658 (+2125344us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540017b6d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.910931 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109067,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":26967,"spinlock_wait_cycles":4154662272,"thread_start_us":227363,"threads_started":1,"wal-append.queue_time_us":367464,"wal-append.run_cpu_time_us":2133,"wal-append.run_wall_time_us":1118282}
I20260709 13:10:23.914651 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1761) took 3712 ms. Trace:
I20260709 13:10:23.915347 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:23.916091 30479 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.916709   624 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.919726 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1685) took 2344 ms. Trace:
I20260709 13:10:23.920097 30485 rpcz_store.cc:276] 0709 13:10:21.575248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.934231 (+358983us) service_pool.cc:224] Handling call
0709 13:10:21.934504 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.336641 (+402137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.919277 (+1582636us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003d7a54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.919550 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923398400}
I20260709 13:10:23.921274 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.873548   558 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.921824 30485 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:23.870352 32750 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:23.923688 30479 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:23.924993 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.914078   721 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:23.927032   721 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.927503   721 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:23.931211 30408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1439) took 1742 ms (client timeout 2073 ms). Trace:
I20260709 13:10:23.925511 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:23.931685 30408 rpcz_store.cc:269] 0709 13:10:22.189177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.348178 (+159001us) service_pool.cc:224] Handling call
0709 13:10:23.930963 (+1582785us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400122854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:23.931136 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532348288}
I20260709 13:10:23.932502 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:23.933408 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 62856.8us
I20260709 13:10:23.934263 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:23.936162 32750 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:23.936779 32750 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:23.937321 32750 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.939344   721 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.942132   721 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:23.946329 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.947060 31152 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:23.948918 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.949333   460 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.949909   460 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:23.950378   460 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.943863 30479 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:23.857985   643 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:23.950821 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.969300 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1788) took 1615 ms. Trace:
I20260709 13:10:23.952414 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.953603 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.953770 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 370) took 1954 ms. Trace:
I20260709 13:10:23.955842 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.956969 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:23.957764 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.943264 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69099.3us
I20260709 13:10:23.913297 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.959604 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:23.960788   785 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:23.915097 30482 rpcz_store.cc:276] 0709 13:10:20.202431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.530366 (+1327935us) service_pool.cc:224] Handling call
0709 13:10:21.535461 (+  5095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.552307 (+ 16846us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:21.552336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.552830 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.683296 (+130466us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:21.683351 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.914028 (+2230677us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54000c9c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.914094 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.914154 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:23.914168 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.914459 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10490,"raft.queue_time_us":1597,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":6174,"spinlock_wait_cycles":37868288,"thread_start_us":130070,"threads_started":1,"wal-append.queue_time_us":226635,"wal-append.run_cpu_time_us":1629,"wal-append.run_wall_time_us":1028082}
I20260709 13:10:23.925065 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:23.842617   661 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:23.932209 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1698) took 1481 ms. Trace:
I20260709 13:10:23.983500 30484 rpcz_store.cc:276] 0709 13:10:22.450361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.925071 (+1474710us) service_pool.cc:224] Handling call
0709 13:10:23.932127 (+  7056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.969703 30479 rpcz_store.cc:276] 0709 13:10:22.353457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.924713 (+1571256us) service_pool.cc:224] Handling call
0709 13:10:23.969205 (+ 44492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.964219 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:23.970247 31153 rpcz_store.cc:276] 0709 13:10:21.998897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.999556 (+   659us) service_pool.cc:224] Handling call
0709 13:10:22.026380 (+ 26824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.439086 (+412706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.439135 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.439203 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.439261 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.953225 (+1513964us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540069ebd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:23.953304 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.953540 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948464000}
I20260709 13:10:23.986809 30486 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:23.962584 32758 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:23.987397 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1709) took 1495 ms. Trace:
I20260709 13:10:23.991124 30486 rpcz_store.cc:276] 0709 13:10:22.491726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.950491 (+1458765us) service_pool.cc:224] Handling call
0709 13:10:23.987341 (+ 36850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.992933 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:23.995666 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:23.994339 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:23.993707 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:23.999789 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.002816 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.003034 30477 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.003633 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 197116us
I20260709 13:10:24.000768 30478 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:24.008322 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1701) took 1557 ms. Trace:
I20260709 13:10:24.008661 30478 rpcz_store.cc:276] 0709 13:10:22.451166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.951992 (+1500826us) service_pool.cc:224] Handling call
0709 13:10:24.008267 (+ 56275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.993075 32758 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:24.009423 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.006582 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.012948 30481 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
W20260709 13:10:24.013402 30481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1700) took 1562 ms (client timeout 2077 ms). Trace:
W20260709 13:10:24.013671 30481 rpcz_store.cc:269] 0709 13:10:22.450921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.984023 (+1533102us) service_pool.cc:224] Handling call
0709 13:10:24.013347 (+ 29324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.003927 30309 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 2 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:24.019266 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1780) took 2085 ms. Trace:
I20260709 13:10:24.005760   523 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:24.020650 30482 rpcz_store.cc:276] 0709 13:10:21.930195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.982979 (+2052784us) service_pool.cc:224] Handling call
0709 13:10:24.012387 (+ 29408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.012568 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.012591 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.015099 (+  2508us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:24.015137 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.015207 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.015314 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.023610 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.026258 30406 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:24.034885 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:24.038499 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 243) took 2105 ms. Trace:
W20260709 13:10:24.023085   410 consensus_meta.cc:287] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.002s
I20260709 13:10:24.050827 30479 rpcz_store.cc:276] 0709 13:10:21.933155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.984847 (+2051692us) service_pool.cc:224] Handling call
0709 13:10:24.015614 (+ 30767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.038060 (+ 22446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.038100 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.038160 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.038208 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.038288 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.038428 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.062134 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 244) took 2125 ms. Trace:
I20260709 13:10:24.064400 30486 rpcz_store.cc:276] 0709 13:10:21.933423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.991926 (+2058503us) service_pool.cc:224] Handling call
0709 13:10:24.031015 (+ 39089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.054236 (+ 23221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.054296 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.058851 (+  4555us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.058889 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.058942 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.059042 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.059394   774 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:24.067024 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.068053 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.091935 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 246) took 2156 ms. Trace:
I20260709 13:10:24.093756 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 247) took 2158 ms. Trace:
I20260709 13:10:24.094178 30478 rpcz_store.cc:276] 0709 13:10:21.935232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.018021 (+2082789us) service_pool.cc:224] Handling call
0709 13:10:24.061910 (+ 43889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.083404 (+ 21494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.083446 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.086179 (+  2733us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.091616 (+  5437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.091712 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.091860 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.094336 30481 rpcz_store.cc:276] 0709 13:10:21.935475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.018760 (+2083285us) service_pool.cc:224] Handling call
0709 13:10:24.059730 (+ 40970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.087212 (+ 27482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.087237 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.093510 (+  6273us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.093548 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.093609 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.093703 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.089100 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 250) took 2042 ms. Trace:
I20260709 13:10:24.056030   410 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.097599 30479 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.090991 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 242) took 2158 ms. Trace:
I20260709 13:10:24.103655 30484 rpcz_store.cc:276] 0709 13:10:21.932753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.992932 (+2060179us) service_pool.cc:224] Handling call
0709 13:10:24.020918 (+ 27986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.066865 (+ 45947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.066896 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.082900 (+ 16004us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:24.090675 (+  7775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.090773 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.090915 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.105444 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 251) took 2012 ms. Trace:
I20260709 13:10:24.105993 30479 rpcz_store.cc:276] 0709 13:10:22.092690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.058175 (+1965485us) service_pool.cc:224] Handling call
0709 13:10:24.092789 (+ 34614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.105137 (+ 12348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.105379 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.100788 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 245) took 2167 ms. Trace:
I20260709 13:10:24.109797 30485 rpcz_store.cc:276] 0709 13:10:21.934963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.004669 (+2069706us) service_pool.cc:224] Handling call
0709 13:10:24.036459 (+ 31790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.100349 (+ 63890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.100391 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.100451 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:24.100498 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.100586 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.100719 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.102463 30482 rpcz_store.cc:276] 0709 13:10:22.050809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.024689 (+1973880us) service_pool.cc:224] Handling call
0709 13:10:24.069409 (+ 44720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.088660 (+ 19251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.088689 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.088733 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.088772 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.088858 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.089020 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.114257 30450 connection.cc:256] RPC call timeout handler was delayed by -1.2920229479999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:10:24.116147 30450 connection.cc:256] RPC call timeout handler was delayed by -1.1615229479999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:10:24.119210 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:24.127413 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 114790us
I20260709 13:10:24.129703 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.113893   703 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.136018 30478 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:24.139662 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1782) took 1929 ms. Trace:
I20260709 13:10:24.138217 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.140130 30478 rpcz_store.cc:276] 0709 13:10:22.210506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.095509 (+1885003us) service_pool.cc:224] Handling call
0709 13:10:24.130619 (+ 35110us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:24.139333 (+  8714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.139611 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.141914 30486 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:24.130213   625 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:24.148057   786 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:10:24.150871 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1767) took 3898 ms. Trace:
I20260709 13:10:24.151778 30481 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:24.133242   784 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.154861 30556 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:24.161078 30484 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:24.164366 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1783) took 1952 ms. Trace:
I20260709 13:10:24.164727 30481 rpcz_store.cc:276] 0709 13:10:22.212108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.095515 (+1883407us) service_pool.cc:224] Handling call
0709 13:10:24.119655 (+ 24140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.164135 (+ 44480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.164314 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.049603   538 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.145609 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.159132 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.160712 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1697) took 1955 ms. Trace:
I20260709 13:10:24.172514 30486 rpcz_store.cc:276] 0709 13:10:22.204961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.065668 (+1860707us) service_pool.cc:224] Handling call
0709 13:10:24.139636 (+ 73968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.160362 (+ 20726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.160636 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.164986 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1785) took 1850 ms. Trace:
I20260709 13:10:24.173918 30484 rpcz_store.cc:276] 0709 13:10:22.314366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.113035 (+1798669us) service_pool.cc:224] Handling call
0709 13:10:24.139203 (+ 26168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.164678 (+ 25475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.164909 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.140223   777 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:24.178666 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 374757us
I20260709 13:10:24.168032 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:24.185761 30559 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:24.184172   757 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.655s	user 0.013s	sys 0.000s
I20260709 13:10:24.171468   703 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.163106 30483 rpcz_store.cc:276] 0709 13:10:20.204133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.930489 (+1726356us) service_pool.cc:224] Handling call
0709 13:10:21.930883 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.209443 (+1278560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.209493 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.210385 (+   892us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.379565 (+169180us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:23.379695 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.397493 (+ 17798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.096569 (+699076us) raft_consensus.cc:1685] finished
0709 13:10:24.096591 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.102084 (+  5493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1277795,"raft.queue_time_us":1368916,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"thread_start_us":168387,"threads_started":1,"wal-append.queue_time_us":647220}
I20260709 13:10:24.187793 30557 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:24.195883 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.196758 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.200549 30309 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 6, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.202862 31152 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:24.203869   782 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:24.205255   643 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.203114 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1789) took 1829 ms. Trace:
I20260709 13:10:24.184815   777 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:24.202806   769 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:24.206313 30485 rpcz_store.cc:276] 0709 13:10:22.374048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.116488 (+1742440us) service_pool.cc:224] Handling call
0709 13:10:24.142206 (+ 25718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.202786 (+ 60580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.202816 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.202860 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:24.202895 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.202956 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.203064 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.175894   476 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.215185 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.209949 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:24.215056 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.219867 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.220645 31149 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:24.197690   774 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:10:24.196254   703 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.224556 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.225283 31152 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:24.226222 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:24.227717   703 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.215097 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.231459 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1706) took 1779 ms. Trace:
I20260709 13:10:24.231818 30486 rpcz_store.cc:276] 0709 13:10:22.452321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.173586 (+1721265us) service_pool.cc:224] Handling call
0709 13:10:24.194973 (+ 21387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.231173 (+ 36200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.231199 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.231246 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:24.231275 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.231327 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.231408 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.233227 30478 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:24.237444 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1704) took 1785 ms. Trace:
I20260709 13:10:24.237865 30481 rpcz_store.cc:276] 0709 13:10:22.451872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.165942 (+1714070us) service_pool.cc:224] Handling call
0709 13:10:24.199627 (+ 33685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.231071 (+ 31444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.231105 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.237143 (+  6038us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:24.237184 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.237254 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.237373 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.221190 31151 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
W20260709 13:10:24.240435 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 45900.2us
I20260709 13:10:24.247829 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.241602 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1702) took 1790 ms. Trace:
I20260709 13:10:24.218251   523 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:24.248973 30478 rpcz_store.cc:276] 0709 13:10:22.451416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.175816 (+1724400us) service_pool.cc:224] Handling call
0709 13:10:24.206853 (+ 31037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.241374 (+ 34521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.241551 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.246726 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52270.9us
I20260709 13:10:24.243149 30556 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.216971   777 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.196326   757 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.266736 30486 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.247687 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1708) took 1763 ms. Trace:
I20260709 13:10:24.260805 31145 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:24.261232 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.245726   661 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.267939 30483 rpcz_store.cc:276] 0709 13:10:22.484689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.196572 (+1711883us) service_pool.cc:224] Handling call
0709 13:10:24.241024 (+ 44452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.247334 (+  6310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.247364 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.247433 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:24.247463 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.247525 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.247634 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.251202 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1707) took 1781 ms. Trace:
I20260709 13:10:24.281220 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1786) took 1933 ms. Trace:
I20260709 13:10:24.311406 30407 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:24.299001 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45565.5us
I20260709 13:10:24.326499 30484 rpcz_store.cc:276] 0709 13:10:22.469616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.175441 (+1705825us) service_pool.cc:224] Handling call
0709 13:10:24.199790 (+ 24349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.250890 (+ 51100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.250917 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.250960 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:24.251002 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.251062 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.251154 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.326838 30479 rpcz_store.cc:276] 0709 13:10:22.322656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.115267 (+1792611us) service_pool.cc:224] Handling call
0709 13:10:24.142309 (+ 27042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.187547 (+ 45238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:24.203607 (+ 16060us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.256023 (+ 52416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.256070 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:24.256112 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.256170 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.256262 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2658,"prepare.queue_time_us":14370,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":18535,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":40298,"threads_started":1}
I20260709 13:10:24.294199 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:24.281606 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 168889us
I20260709 13:10:24.281934 30553 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:24.329023 30559 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:10:24.330046 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1662) took 1988 ms (client timeout 2037 ms). Trace:
I20260709 13:10:24.329703 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:24.330375 30559 rpcz_store.cc:269] 0709 13:10:22.341340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.416942 (+ 75602us) service_pool.cc:224] Handling call
0709 13:10:24.048287 (+1631345us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:24.329992 (+281705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910592}
I20260709 13:10:24.362329 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:24.366317 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.279065   703 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.370883 30554 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:24.370719 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.311785   512 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:24.368664 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 118549us
I20260709 13:10:24.371773 30553 raft_consensus.cc:2368] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
I20260709 13:10:24.317581   523 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:24.373719 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.253837   476 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.379163 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.380272   476 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:24.382325 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.382927 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.383605 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.370687   703 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:24.385207   703 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.385308 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.385475 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.386118 30410 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.386197 30402 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.376497 30556 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 4: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.364214 30309 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 2 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.372978   512 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:24.378386 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.393493 30559 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.393102   627 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.394186   627 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.393841   523 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.294420 32750 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.391577 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1652) took 2278 ms. Trace:
I20260709 13:10:24.391953   512 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.397688   512 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.400254 30309 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 4, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.387750 30558 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:24.397403 30551 rpcz_store.cc:276] 0709 13:10:22.087521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.191249 (+103728us) service_pool.cc:224] Handling call
0709 13:10:22.191521 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.207740 (+ 16219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.207769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.208219 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.459121 (+1250902us) spinlock_profiling.cc:243] Waited 895 us on lock 0x7b180034cf00. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:23.840599 (+381478us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:23.840795 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.859484 (+ 18689us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.259502 (+400018us) raft_consensus.cc:1685] finished
0709 13:10:24.259520 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.366300 (+106780us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15875,"raft.queue_time_us":16047,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":16939,"spinlock_wait_cycles":2059520,"thread_start_us":315047,"threads_started":1,"wal-append.queue_time_us":1796899}
I20260709 13:10:24.392477   757 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.413219 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.431054 30408 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 4.
I20260709 13:10:24.415048 30403 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:24.419214   721 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.431663 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.420635 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.421756 32758 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.422430   410 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.429499   538 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.435088   554 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.435554   554 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.419837 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.432476 30402 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:24.437443 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.432502 30552 raft_consensus.cc:2410] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:24.434290   721 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.429198   460 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.437500 30410 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:24.440177 30409 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:24.441692 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.445158 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.446175   734 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:24.446302 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.447670 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.449214 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.450482 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.450901   777 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:24.451654 30451 connection.cc:256] RPC call timeout handler was delayed by -3.7303214839998873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 13:10:24.454843 30551 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.453246 30309 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.440197   721 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.461531 30559 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.462800   460 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.462939 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.463486 30560 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.463853 30559 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.465654 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.465878 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.466380 30480 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.436084   769 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:24.467301   769 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.467042   476 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.467689   769 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.468664   769 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:24.470229 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.470268 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.472415 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.473233 30552 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.459074 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:24.478601 30555 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.451725   410 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:24.480648 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.484665 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.485953 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.486184 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.486610 30553 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.486896 30560 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.488063 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.488828 30451 leader_election.cc:400] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:24.489313 30451 leader_election.cc:403] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.486889 30309 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 2, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.492162   476 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:24.497166   476 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:24.497588   476 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.499429 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.499920 30559 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.500643 30553 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.498371 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:24.502467 30552 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:24.505941 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73820.7us
I20260709 13:10:24.509014 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.510389 30560 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:24.512334 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.512477 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.503046   769 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.486042   410 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.518273 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.519407 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.519708   554 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.526822 30483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:24.527645 30483 raft_consensus.cc:606] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:24.522044 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 357) took 2492 ms. Trace:
I20260709 13:10:24.522948 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.523380 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:24.527143   792 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.300s	user 0.004s	sys 0.000s
I20260709 13:10:24.521384 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1763) took 2502 ms. Trace:
I20260709 13:10:24.531366 30407 rpcz_store.cc:276] 0709 13:10:22.019004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.982711 (+1963707us) service_pool.cc:224] Handling call
0709 13:10:24.007290 (+ 24579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.327081 (+319791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.521136 (+194055us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002f71d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:24.521310 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697109376}
I20260709 13:10:24.509534 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.529013 30405 rpcz_store.cc:276] 0709 13:10:22.029214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.923538 (+1894324us) service_pool.cc:224] Handling call
0709 13:10:23.923894 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.990819 (+ 66925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.990852 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.996357 (+  5505us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.996400 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.521860 (+525460us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5400267354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:24.521898 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.521994 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139583232}
I20260709 13:10:24.536533 30481 raft_consensus.cc:2410] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:10:24.538158 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.543366 30484 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:24.509913   734 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:24.557155   410 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.558032   410 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.588549   476 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.592166 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.597159 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.611368   476 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.612190   476 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.577162 32758 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:24.625178 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:24.626058 30486 raft_consensus.cc:606] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:24.626543 30486 raft_consensus.cc:614] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.627527 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.628674 30485 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:24.635929 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:24.632833 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 162899us
I20260709 13:10:24.638830 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1791) took 2234 ms. Trace:
I20260709 13:10:24.638921 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.623217   777 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.643890 30406 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 4.
I20260709 13:10:24.634900 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.645861 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:10:24.658196 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 165832us
I20260709 13:10:24.659945 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.664719 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.664858   703 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.666049 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.667275 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.668121   703 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.668676 31153 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:24.645535 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.671095 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:24.679435 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:24.687918   793 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.269s	user 0.000s	sys 0.003s
I20260709 13:10:24.639647 30482 rpcz_store.cc:276] 0709 13:10:22.401467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.126924 (+1725457us) service_pool.cc:224] Handling call
0709 13:10:24.176168 (+ 49244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.202046 (+ 25878us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:24.329659 (+127613us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.635396 (+305737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.635459 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:24.635511 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.635681 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.635795 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4397,"prepare.queue_time_us":24830,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":79876,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"thread_start_us":361197,"threads_started":3,"wal-append.queue_time_us":274980}
I20260709 13:10:24.695924 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.696323 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.697324 30480 raft_consensus.cc:2410] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:24.698942 31150 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:24.656930 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.694228 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.682327 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:24.721485 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 69102us
I20260709 13:10:24.723088 30485 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:24.724429 30480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1699) took 2270 ms (client timeout 2586 ms). Trace:
W20260709 13:10:24.724916 30480 rpcz_store.cc:269] 0709 13:10:22.450646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.458930 (+2008284us) service_pool.cc:224] Handling call
0709 13:10:24.721032 (+262102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.731709 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.732352 30404 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:24.733949 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70836.7us
I20260709 13:10:24.739012   703 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.738183   721 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.739038   798 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:24.739934   800 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:24.740527   798 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:24.740595   800 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:24.741030   798 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.741357   721 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.741611   800 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.743042 30551 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:24.732300   777 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:24.747768 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.748652 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:24.749398 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:24.730897   799 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:24.750360   799 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:24.754577 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.750308   476 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.755412 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.752405 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.753824 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.754931   799 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.751174 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.774627 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.755492   476 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:24.775481 30479 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:24.775730   476 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.778275 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.756498 30404 raft_consensus.cc:2368] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 6.
I20260709 13:10:24.778880 30480 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.779187 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:24.780771 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.781991 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.753114 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:24.773774 30450 connection.cc:256] RPC call timeout handler was delayed by -1.3008679299999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:10:24.784597 30554 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.790035   777 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:24.790644   777 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:24.791081 30450 connection.cc:256] RPC call timeout handler was delayed by -1.208167929999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 13:10:24.792764   777 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:24.756925 30407 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.761940   800 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.764130 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.794317 30555 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:24.764499   554 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.764907 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 85558.1us
I20260709 13:10:24.765483 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.765003 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.766834 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.767236 32750 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.797387 32750 consensus_queue.cc:1059] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:24.798240 32750 raft_consensus.cc:3055] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:24.798389 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.798661 32750 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:24.799787 32750 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.801122 30482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:24.801397 32750 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.801673 30482 raft_consensus.cc:606] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:24.802060 30482 raft_consensus.cc:614] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:24.768929 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.805061 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.773695   798 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.767234   410 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:24.757906 31152 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:24.796631 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.810171   476 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.810810 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.813012 30480 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:24.827349 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.828246 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.828756 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.829557 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.828882 30408 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:24.831818 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:24.833782 32758 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.835040   460 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:24.835515   460 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.834950 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.835758 30482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:24.835048 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.836616 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.837091 30409 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:24.836282 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.837765 30486 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:24.836423 30482 raft_consensus.cc:606] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:24.830078 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 80734us
I20260709 13:10:24.835850   460 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.838762 30482 raft_consensus.cc:614] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.839574 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.839859 30551 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:10:24.841235 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.841755 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.843894 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.844645 30402 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.847849 30410 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:24.817298   721 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.849236 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:24.849906 30406 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.848361 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.853010 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.854873   758 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:10:24.858453   802 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:10:24.861032   798 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:24.863595   801 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:24.864248 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.865496 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.866098 30479 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:24.866158 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.867071 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.867498 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.867710 30479 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:24.867666   559 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:24.868242 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.868852 30478 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:24.868901   559 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.869087 30481 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:24.855590 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.869756 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.869957 30405 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:24.870296 30478 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.869932 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.870980   476 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.866870   648 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.871246 30479 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:24.867525   784 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:24.868057 30485 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:24.866851 30477 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:24.872928 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.880410 30484 raft_consensus.cc:2410] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:24.872715 31151 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:24.884708 30404 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.884922 30405 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:24.885120   758 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.885506   758 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.886420   758 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.890969 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.892113 30408 raft_consensus.cc:2410] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:24.893373 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:24.894004 30485 raft_consensus.cc:606] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:24.893561   802 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.894338 30485 raft_consensus.cc:614] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.894505   802 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.873010   784 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.895475   802 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.895665   784 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.896507   758 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.896871   802 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:24.898710 30450 leader_election.cc:336] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.578s (SENT)
I20260709 13:10:24.899832 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.900092   784 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.900465 30477 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:24.901746   799 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.903095 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:10:24.904838 30450 leader_election.cc:336] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.674s (SENT)
W20260709 13:10:24.907801 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50077.2us
I20260709 13:10:24.909399 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.909832 30404 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:24.910326 30486 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.913627 30403 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:24.916868 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:24.919191   794 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.507s	user 0.009s	sys 0.000s
W20260709 13:10:24.920092 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 69453.7us
I20260709 13:10:24.922355 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.922302 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.869388   559 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:24.926316   799 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:24.926851 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.926589   559 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.927866   559 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.924544 30480 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:24.920194 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.923660 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:24.924228 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.920267 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.932433 30409 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:24.925115 32750 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.933879 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.934835 32750 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:24.935209 32750 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:24.936131 32750 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.937224 32750 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:24.937856 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.933969 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.939059 30486 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:24.940696 31153 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:24.933004 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.942772   476 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:24.922087 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.943235   476 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:24.943037   798 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.943742   476 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.943373   460 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.944842   410 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:24.946882   703 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:24.947023   460 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:24.947368   703 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:24.948704 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.948411   703 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:24.949262 30557 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.949862   703 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:24.946549 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.950620 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.951113 31146 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 6 LEARNER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:24.951292 30556 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:24.951782 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.943909   798 consensus_queue.cc:1243] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:24.949877 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.952613 30554 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:24.953665 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.954243 30558 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.955935 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.956023 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.957877 30555 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:24.958065 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:24.934042 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:24.959097 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.959187 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.959597 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.959110 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:24.960647 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.961244 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.959268 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.962268 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.962800 31152 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.963482 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.964046 30484 raft_consensus.cc:2376] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7. Re-sending same reply.
I20260709 13:10:24.965070 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.966454   410 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:24.967231   410 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:24.967679   627 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.968148   410 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:24.970039   410 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:24.970713 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:24.966396 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:24.943238 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:24.975078 30483 raft_consensus.cc:2410] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:24.975697 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:24.977471 30553 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:24.978024 30482 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:24.978536 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:24.980115   721 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.981860 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:24.982887   476 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:24.984983   476 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:24.995308 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.000849 31152 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:25.002573 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.003305 30480 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:25.006584 30478 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:25.006549 30557 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:25.009577 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:25.010787 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.011466 30402 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:25.013703   800 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.014127   800 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:25.014490   800 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.014976 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.015764 30558 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:25.016562 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.018232   777 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.018769   777 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.019083   460 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.019672   777 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.021553 30404 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:25.009876 30376 connection.cc:256] RPC call timeout handler was delayed by -1.1692511549999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:10:25.027029 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 83886.2us
I20260709 13:10:25.027935 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.028779   721 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.029181   721 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.029513   721 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.030114   798 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.030411 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:25.030539   798 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:25.031185 30551 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:25.031077   798 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:25.032066 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74092.1us
I20260709 13:10:25.031612   800 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.039757 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:25.040643 30402 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:25.041368   798 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.029453 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.043326   460 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.052614   476 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:25.052809 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.053108   476 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:25.053509   476 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.053515 30559 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:25.054685 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.055953 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.056043   721 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.057116 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.047210 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.047891 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.048501 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.048607 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:25.051209 30376 connection.cc:256] RPC call timeout handler was delayed by -1.0810511549999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 13:10:25.060683 30558 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:25.060984 30376 connection.cc:256] RPC call timeout handler was delayed by -1.0810511549999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 13:10:25.063450 31152 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:25.034116   800 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:25.071704 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:25.074680 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.075981 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.079071 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.079698 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:25.080327 30482 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:25.081235 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 113864us
I20260709 13:10:25.082463 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.083989 30483 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:25.084735 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.085790 30551 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:25.089658 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.089730 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.094812 30558 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:25.069347   799 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:25.095326 30484 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:25.076292   703 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:25.096118 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47593.4us
I20260709 13:10:25.101599 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.102679 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:25.103369 30483 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.082867 32750 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.104349 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:25.107877 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:25.109210 30551 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:25.109535 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.109767 30558 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:25.110313 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.093771   721 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.092420   800 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:25.094684 32758 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.116943 30486 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.097151   799 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.103742   703 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.109095   810 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.127719   810 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.128610   810 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.129715   810 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.133630   410 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.122398 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:25.136011 30478 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:25.122903 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.127055   721 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:25.121642   703 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.139451 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.140455 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:25.142186 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.143491 30480 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:25.144444 30485 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:25.119966   799 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:25.147392 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.147719 30402 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:25.116494   800 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:25.151839 30451 leader_election.cc:400] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
I20260709 13:10:25.152305 30451 leader_election.cc:403] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.159314 30484 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:25.166028 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:25.167570 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.168030   798 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:25.168299 30402 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:25.175423   627 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:25.126410   476 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.111845   523 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:10:25.188740 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50788.9us
I20260709 13:10:25.189514 30483 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:25.190217 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.141150   721 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:25.192015 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 134998us
I20260709 13:10:25.195277 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:25.196576 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.178444   476 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.154719   800 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:25.191622 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 87950.5us
I20260709 13:10:25.165673   559 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.210276 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.203159   798 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7.
I20260709 13:10:25.213125   815 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:25.213536   815 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.213873   815 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.199667   721 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.203094   784 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:25.209910   758 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:25.221181 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69545.8us
I20260709 13:10:25.221946 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.223464 30482 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:25.224329 30486 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:25.229300 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116600us
I20260709 13:10:25.236351 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.238209 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:25.219862   648 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.246461 30478 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:25.251699 30482 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:25.244817 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.253827 30402 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.242686   817 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:25.254882   817 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.263893 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.262454 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.243476   648 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:25.271513   648 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.273623   648 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.261430   559 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:25.266950   817 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.279583   559 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.279953   817 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:25.280161 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.280025   559 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:25.281157   559 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.280025   810 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:25.284044   810 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:25.256389   784 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:25.259091   523 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:25.287144 30402 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
W20260709 13:10:25.285459 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76717.5us
I20260709 13:10:25.248440   802 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:25.295179 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.255954   816 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.293578 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:25.298357 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.282487   559 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.303357 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.287184 32758 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.291213   810 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.263999   758 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:25.307240 30406 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:25.291595   410 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:25.308692 31152 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:25.311411   758 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.311846   758 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:25.312772   758 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.314013   758 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.292264   777 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:10:25.317970   815 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.303699   784 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:25.319618   784 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.299685   523 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.289453 32750 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:10:25.331067 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46944.1us
I20260709 13:10:25.332507   825 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.333559   825 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.333855   825 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.335740   799 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.338822 30477 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.309976   410 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.338891   523 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.339519   410 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.343222 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.348449 30451 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.350889 30477 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
W20260709 13:10:25.351112 30376 connection.cc:256] RPC call timeout handler was delayed by -1.0207511549999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
W20260709 13:10:25.351533 30376 connection.cc:256] RPC call timeout handler was delayed by -1.0059744969998974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 13:10:25.304359   734 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:10:25.354226 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.355014 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.355646 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.356324 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:25.359019 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:25.368819 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:25.369076 30406 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:25.369406 30404 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.370121 30408 raft_consensus.cc:2410] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:25.374293 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:25.379092 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85616.2us
I20260709 13:10:25.387171 30404 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:25.387411 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.388962 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.390851 30407 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.397560 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.404065 30407 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:25.391103 32750 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.383919   799 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.379606   703 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:25.416873   821 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:25.418052   820 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.334623   825 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.418632   820 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.419510   825 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.420745   820 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:25.422067   800 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:25.425146   823 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:25.426031   800 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.428417   651 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:25.428797   651 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.429538   651 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.430126   815 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.431182   651 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.433101   810 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.435808 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.436805 30374 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.437131 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.437750   817 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.438524   460 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.438876   828 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.441365   826 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:10:25.443305   512 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:25.444026   721 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.446182 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.460703   800 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.458000   512 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:25.466470   703 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.423511 32750 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.468356 32750 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.469125   523 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.469496 32758 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:25.469902 32758 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.471305 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.472666   816 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.461973   798 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.478870   476 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:25.491077 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 130191us
I20260709 13:10:25.492508 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.497632   836 raft_consensus.cc:2764] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:10:25.458724   830 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:25.499507   627 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.504788   810 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:25.508883 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.511245 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74507.9us
I20260709 13:10:25.512214 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.505455   734 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:25.514647 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.514935 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:25.516316 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 127403us
I20260709 13:10:25.516855 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.517225 30478 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:25.517958 30482 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:25.518024 30483 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:25.520776   836 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:25.521168 30374 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.521453   836 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.521945   836 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.522724 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.524893 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:25.526432 30409 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:25.527153 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 129731us
I20260709 13:10:25.528560 30485 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:25.499900   830 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.531590 30486 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:10:25.538270 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.513211   721 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:25.539286   829 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:25.529707   523 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:25.551074 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.514371   559 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:10:25.552446 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.554755 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.559957   832 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:25.560532   832 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.560907   832 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.561365 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:25.563549 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.549965   826 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:25.551637   820 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.566438 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:25.583521 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.585163   838 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.586386   839 raft_consensus.cc:2764] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:25.593145 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.558732   523 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.565814   831 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.565732   721 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.565860   817 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:25.566715   826 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.579429   810 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:25.617350 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 229989us
I20260709 13:10:25.623862   827 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.624439   827 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.627285 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.629410 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.630893   798 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.631506   816 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.619903   826 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.645615 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:25.622018   523 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.647787   846 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.648350   846 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.630532 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.650345 30411 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:25.579298   734 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:25.657799 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.570521   834 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:10:25.673949 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.617889   817 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:25.688007 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.676352 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.707283 31153 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:25.650038   820 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.620657   810 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.632244   816 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:25.609457   410 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.626608   827 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:25.707780 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.709504 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:25.672776   476 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:25.680905   721 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:25.681643   798 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:25.671272   841 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:25.697765   817 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.696007   703 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.680395   800 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:25.731622 30486 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:25.721733 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 157993us
I20260709 13:10:25.726148 30479 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:10:25.726620 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52756.3us
W20260709 13:10:25.732720 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.733043 30450 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:25.727676 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54071.4us
I20260709 13:10:25.734088 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:25.734148 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.649231   846 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.715694   834 consensus_queue.cc:1243] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:25.714414   799 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.734897 30483 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:25.736162 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:25.737192 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.731563   800 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.727581   798 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.739197 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:25.739668 30480 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:25.741160 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:25.752002   410 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.774360   476 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.755574   847 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:25.755967 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:25.845148 30486 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:25.756934 30479 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.757305   627 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:25.757634   816 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.759141   651 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:25.726927   721 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:25.728809   842 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:25.727170   815 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:25.750078   826 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.738886 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:25.618623   830 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.753216   810 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.783514   800 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.783342   460 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:10:25.816241   845 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:25.784893   798 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.728982   827 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:10:25.779281   777 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:10:25.737352   835 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:10:25.830300 30480 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:25.732661   838 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:25.831607 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 95483.9us
I20260709 13:10:25.892740 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.894141 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:25.836568 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49862us
I20260709 13:10:25.837309 31153 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:25.870587 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 304224us
I20260709 13:10:25.875376   815 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:25.844179   799 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:25.774710   820 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:10:25.849635   410 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:25.851828   651 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:25.855823   721 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.846884   627 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.855201   847 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:25.852274   849 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:25.844058   476 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.897444 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.897250 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:25.957998 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.855378   832 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:25.958268 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61152.7us
W20260709 13:10:25.958814 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.891443   850 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.139s	user 0.003s	sys 0.002s
I20260709 13:10:25.953233 30551 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:10:25.959498 30551 pending_rounds.cc:85] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:10:25.959781 30551 pending_rounds.cc:107] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:10:25.899143   559 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:10:25.963243   559 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.963111   627 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.963681   559 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:25.964103   476 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:25.964690   476 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:25.964598   559 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:25.965277   476 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:25.966154   559 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.966665 30305 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 6, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 6 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:25.954643   843 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:25.775734 32750 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260709 13:10:25.944140 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 87381.3us
I20260709 13:10:25.952553   460 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:25.902406   841 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:25.898269   703 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:25.967012   855 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:25.964603   627 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:25.894922   838 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:25.957945 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 60570.1us
I20260709 13:10:25.968750 30305 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 6, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 6 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.960045 30551 raft_consensus.cc:2889] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:25.966216   476 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:25.984458 30309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 195) took 21451 ms (client timeout 15000 ms). Trace:
I20260709 13:10:25.984809   820 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:25.988399   815 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.989665 32750 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:25.989812 31146 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:25.982661 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:25.991346 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.004408   832 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.005386   857 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.996807   460 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.006953   651 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.009126   866 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:10:26.010751   853 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:10:26.011111   854 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:10:26.011904 32758 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.059929 32758 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.012348   841 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:25.979935   410 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.035567   703 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.063030   410 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:26.051753 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 159992us
I20260709 13:10:26.022673 30305 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 2 to 3, term changed from 3 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to <none>, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:26.055588 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73000.9us
I20260709 13:10:26.072418 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.023686   838 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.981493   817 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:26.063172 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71911.8us
W20260709 13:10:26.043691   851 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:10:26.048239   835 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:26.073235   836 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.006s
W20260709 13:10:26.084106 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 351146us
W20260709 13:10:26.084651 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 125625us
I20260709 13:10:26.085721 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.033201   803 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:10:26.071224   831 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.087705 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:26.097388 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.072463   862 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:26.100337 30305 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 5, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.081024   835 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.069898   703 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.103929 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.105526 30482 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:26.015697 30309 rpcz_store.cc:269] 0709 13:10:04.502112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.531000 (+ 28888us) service_pool.cc:224] Handling call
0709 13:10:25.953477 (+21422477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:24.849329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:24.887505 (+ 38176us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:24.887558 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:10:24.887594 (+    36us) tablet.cc:662] Decoding operations
0709 13:10:24.888557 (+   963us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:24.888642 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:24.888669 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:24.889370 (+   701us) tablet.cc:701] Row locks acquired
0709 13:10:24.889425 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:10:24.889596 (+   171us) write_op.cc:270] Start()
0709 13:10:24.889741 (+   145us) write_op.cc:276] Timestamp: P: 1783602624889534 usec, L: 0
0709 13:10:24.889764 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:24.890511 (+   747us) log.cc:844] Serialized 3209 byte log entry
0709 13:10:25.146387 (+255876us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5400168da0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa04501edbe 00007fa045029930 00007fa0450298d8 00007fa045029858 00007fa045029813 00007fa045028a9c 00007fa04af14626 00007fa04af0edd8 00007fa0450657cb 00007fa0450682c0
0709 13:10:25.197983 (+ 51596us) op_driver.cc:464] REPLICATION: finished
0709 13:10:25.254522 (+ 56539us) write_op.cc:301] APPLY: starting
0709 13:10:25.254619 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:25.254870 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:25.254924 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:25.318775 (+ 63851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:25.319137 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:10:25.319181 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:25.319529 (+   348us) log.cc:844] Serialized 58 byte log entry
0709 13:10:25.319723 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:25.319830 (+   107us) write_op.cc:454] Released schema lock
0709 13:10:25.319886 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:25.320353 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:25.320382 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2584501,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":56135,"apply.run_cpu_time_us":3615,"apply.run_wall_time_us":65806,"num_ops":7,"prepare.queue_time_us":64650,"prepare.run_cpu_time_us":15510,"prepare.run_wall_time_us":261858,"raft.queue_time_us":50728,"raft.run_cpu_time_us":6100,"raft.run_wall_time_us":14085,"replication_time_us":307987,"spinlock_wait_cycles":76439296,"thread_start_us":236494,"threads_started":4,"wal-append.queue_time_us":120485}]]}
I20260709 13:10:26.110631 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.106890   827 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.111557   827 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.108719   866 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:26.119460 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.108690   538 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.006611   847 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.063642   799 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.097186   864 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.123992 30305 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.101310   862 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:26.102298   826 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.089216   836 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.102861   476 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.128046   871 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:26.131311   866 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.132424 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.133734 32758 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:26.126250 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 53910.4us
I20260709 13:10:26.129751   410 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.136476   862 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.098256   460 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.122792   831 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:26.155313   800 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.128608   538 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.155215   836 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.157657   703 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.193099   871 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.156448   835 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.152827   827 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.128356   816 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:26.156745   559 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.159238 30403 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.209182 32758 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.183367 30305 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 4, term changed from 4 to 6, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added, now has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.185385   857 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.192379 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 71422us
I20260709 13:10:26.198381 30484 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:26.198917 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.219364 30478 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:26.200769   627 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:26.200941   866 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:26.200855 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68500us
I20260709 13:10:26.203140 30485 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:10:26.205252 30483 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:26.202654   831 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:26.233191   831 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.236773   868 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.237306   868 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.239691 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.210351   871 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.223306   817 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.224229   866 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.224257   721 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.225972   835 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:26.227584   800 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.228065   838 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.232013 30305 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.243005 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.280154 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.287326 30410 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:26.290120 30480 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:26.286412 30408 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:10:26.287766 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44838.8us
I20260709 13:10:26.293280 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.293419 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.287344 30305 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 7, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.294446 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.291795 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.294632 30305 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 6, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.220678   816 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:26.311188 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.234596   798 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.320924 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:26.286114   734 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:26.323647 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.327775   876 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.291010 32750 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.289880   721 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.284963   838 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:26.304242   826 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.332580 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.289575   868 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.311228   815 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:26.311870   842 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:26.244556 32758 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.315516   627 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:26.271871   857 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.285140   836 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:10:26.339167 30305 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.340847 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.333900   820 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.341431 30551 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:26.341208 30305 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:26.344795   857 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.345376   868 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.328811   734 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.346637   734 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.347023 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.288785   866 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.347767   734 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.347875 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.348212   866 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.349150 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:26.359216   863 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.359660   863 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.360075   798 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.360471   863 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.361680   863 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.334937   817 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.364621   858 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:26.338194   803 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:26.370288 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.342571 30305 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 3, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:26.377957 30551 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:26.329473   538 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.331158   847 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.394544 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:26.395375 30450 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.503s (SENT)
I20260709 13:10:26.396354 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:26.368285   831 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:26.441015 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.410451   799 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.411715   803 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.412945   538 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:26.415714 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.417023 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.462157 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:26.419236 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.496061 30560 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:26.423106 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.423888   801 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.503324   801 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.505636   801 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.427037 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.506219 30552 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.506965 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:26.507593 30481 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:26.510506   879 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:26.510968 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:26.511708 30485 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:26.428347 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.512663 30555 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:26.513650 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.514288 30555 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.428910   816 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.337316   842 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:26.435187   883 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:26.436085 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:26.525648 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 89629.8us
I20260709 13:10:26.528142   883 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.528693   883 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.529099   883 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.440851   831 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.409328   627 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:26.438050 30305 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 4 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.398428 30479 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.550355 30552 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:26.366683   460 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:26.379439   815 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:26.458895   862 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.462359 30553 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.418121 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.464370   538 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.465659   803 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.468245 30559 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:26.470820 30483 raft_consensus.cc:1217] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-7.5]   Dedup: 4.3->[5.4-7.5]
I20260709 13:10:26.473031   810 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.631186 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.631942 30559 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:26.475886 30484 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:26.478806 32758 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:26.480336 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:26.488412   830 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.491530 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.492338   847 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:26.494395   838 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.639456 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.640470 30554 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:26.640882 30484 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:26.642097 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.644939   803 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:26.645994 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 154623us
I20260709 13:10:26.648334 30553 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:26.650393 30481 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:26.497525 30486 raft_consensus.cc:606] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.499954   867 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:26.532030 30558 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:26.543179 30551 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:26.614871   817 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.536056 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:26.538719 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.553283   651 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.553551 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:26.555049 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.657377 30485 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.564505 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:26.657773 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.566468 30477 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:26.566119 30305 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.570816 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.659835 30482 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:26.659974 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:26.572158 30560 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:26.660552 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:26.660655 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:26.561546 30450 leader_election.cc:336] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.656s (SENT)
W20260709 13:10:26.588002 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.661870 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:26.626752 30483 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: [2.2-7.5]
I20260709 13:10:26.627241 30556 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:26.620235 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 325690us
I20260709 13:10:26.636032 30555 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:26.661899 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.632721 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.651546 30481 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:26.663739 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:26.664037 30559 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.651882 30486 raft_consensus.cc:614] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:26.539307 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.664961 30484 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:26.535254   835 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:10:26.661443 30552 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
I20260709 13:10:26.663785 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.666815 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.636992   801 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.672399 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 110901us
I20260709 13:10:26.679941 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.680805 30555 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
W20260709 13:10:26.673941 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 134732us
W20260709 13:10:26.682047 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.682750 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.675232 30553 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:26.676743 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.688172 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.689600 30478 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:26.693354 30477 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:26.652720   867 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.615587   871 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:26.721441 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 54713.5us
I20260709 13:10:26.725739 30559 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:26.699589 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:26.727777 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 43972.3us
I20260709 13:10:26.705528 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.722357 30305 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.700241 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.686800   831 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.678293 32750 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.737684 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.728713 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.695111   721 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:26.707047   846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.017s	sys 0.049s
I20260709 13:10:26.692397   801 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.745390 30305 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 2 to 4, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.653332   838 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.684092   810 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.669749   888 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:10:26.698129   876 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.668105   817 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.710637   815 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.764096 30305 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:26.686492   803 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:10:26.765941 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "406b169640e341629c55637d07dd3d47"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:26.782596 30477 raft_consensus.cc:606] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.782972 30477 raft_consensus.cc:614] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:26.694783   887 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.761525   826 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.722761   875 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:10:26.795749   875 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:26.796118   875 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.746423   410 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:26.797031   410 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:26.798275   538 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.799278   862 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.772418   876 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.799991   876 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.800225   801 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.802896   817 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.803776 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.803891 30555 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:26.805348   889 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:26.805773   889 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.806108   889 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.809101 30483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:26.809671 30483 raft_consensus.cc:606] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.810000 30483 raft_consensus.cc:614] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:26.771139   828 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:26.755053   846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.017s	sys 0.052s
I20260709 13:10:26.751698   721 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.812810   721 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.812983   825 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:26.813447   825 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.813598 30483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:26.814401 30483 raft_consensus.cc:606] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.814580   827 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.815053 30483 raft_consensus.cc:614] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:26.815172   827 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.788432   887 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.816582   887 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.816365   827 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.817456   827 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.790010   890 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.783584   836 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:26.792703   858 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:26.794677   627 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.819685   627 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.788199   885 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:26.820482   627 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.821024   885 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.821156   871 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.821491   885 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:26.775797 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76325.2us
I20260709 13:10:26.814324   825 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.749758   847 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:10:26.817212   810 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.792124   838 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:26.785502 30305 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 4 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:26.784480 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 46911.6us
W20260709 13:10:26.767228 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61820.6us
I20260709 13:10:26.790473   865 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.774196   842 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.851826 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:26.861364 30479 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.863654 30486 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:26.864442 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:26.868309 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:26.869098 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.869582 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.872133   847 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:26.872668   847 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.873373 32758 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.874336   838 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:26.834782   826 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:26.874121 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84600.2us
I20260709 13:10:26.875927   826 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:26.877897 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.846962   627 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.878741 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:26.874090 32758 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.879050 30555 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:26.881213 32758 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:26.882462 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.883262   864 raft_consensus.cc:2764] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:26.883728 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.884024   836 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:26.884632   836 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.884804 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.886257 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:26.886935 30551 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:26.889096   846 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:26.888882   875 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.889654   846 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.890244   875 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.890986   803 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.890717   846 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:26.892261   817 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:26.891388   803 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.889318 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.895391   803 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.895776   866 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:26.897454 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:26.902211 30485 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:26.901635 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:26.804719   867 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.826444   802 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.914986 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 232339us
I20260709 13:10:26.851244 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:26.859076   798 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.862948   799 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.920707 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:26.924606 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.905905   825 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:26.902355   810 consensus_queue.cc:1243] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:26.917935 30477 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:26.917042   559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.015s	sys 0.026s
I20260709 13:10:26.910856   538 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:26.935544 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.915676 32758 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:26.938387 30480 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:26.940603 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.942518 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.943027 30551 raft_consensus.cc:2368] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
W20260709 13:10:26.914448 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 197140us
I20260709 13:10:26.940871 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.902626   523 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:26.948539 30479 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
W20260709 13:10:26.937899   559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.016s	sys 0.026s
I20260709 13:10:26.950749   838 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:26.951186   838 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.952028   838 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.953256   838 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.953902 30556 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:26.958865   810 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:26.958986 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:26.960083 30560 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:26.959864   410 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:26.963222   810 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:26.963331 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.963877   559 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.916145 32750 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:10:26.970777 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47414.6us
I20260709 13:10:26.973598 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.977983 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.978168 30486 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:26.974072 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.979496 30485 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:26.939574   538 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.986850 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.986995 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.982250 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.988129 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.982683 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:26.983636 30480 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:26.986016 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.945444   815 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:26.990742 30556 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:26.994336 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58879.3us
I20260709 13:10:26.995347 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.003633 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.004812 30552 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:26.918735   802 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:27.010578 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.012326 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.007468 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:26.964363   559 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.015575   828 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:27.016186   828 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:27.017055   828 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.017320   559 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.020107 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.015451   800 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:27.021627 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:26.970417 32758 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:26.931522   798 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:27.006191   538 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.964287   810 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.050052 30410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53700
I20260709 13:10:27.015187   816 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:27.050688 30410 raft_consensus.cc:606] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:10:27.061168 30410 raft_consensus.cc:614] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:27.051326 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.061990 30404 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.020048   799 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:27.032836   476 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:27.056094 30407 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:10:27.057078 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.057950 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.022598   815 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.034796   831 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:27.055253 30477 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:27.070226 30478 raft_consensus.cc:606] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:27.070686 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 243492us
I20260709 13:10:27.023182   838 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:26.985431   889 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.070915 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.075680 30404 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:27.083274 30403 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:27.083650 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:27.064280 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44238.6us
I20260709 13:10:27.084697 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.077862 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:27.085234 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.085847 30555 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.086058 30402 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.079553 30478 raft_consensus.cc:614] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:27.050470   865 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.081082 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.081312 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.084405 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.100378 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:27.051417   817 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:27.072553   895 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:10:27.106383 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.115249 30403 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:27.115998 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.116628 30405 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:27.050976   834 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:27.103487   460 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:10:27.106369 30555 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:27.108757 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.066936   890 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.112047 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.071055   734 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.058315   858 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.099737   758 raft_consensus.cc:670] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:27.121102 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.079290   816 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.099242   801 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:27.154551   801 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:27.136556 32758 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.155498   801 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.156836   801 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.125267 30402 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:27.158316 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.131604 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:27.159642 30555 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.160414 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:27.160938 30555 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.117846   523 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:10:27.103044   862 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.102804   865 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.181247 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.182035 30402 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:27.182564 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.135603 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.105238   838 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.130762   915 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.132740   842 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.137676 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.137105   864 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.140220 30553 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:27.140270 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.147163 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.198684 30405 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.147563 30403 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 5: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:27.117966   820 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:27.152798   863 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.000s
I20260709 13:10:27.153626   816 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.189718   835 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:27.170480   826 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:27.208184 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.133936 30557 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:27.180281 30555 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:10:27.187526 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52044.6us
I20260709 13:10:27.210283 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:27.138031 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.146036   899 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:27.195143 30376 leader_election.cc:400] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:10:27.217773 30376 leader_election.cc:403] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:10:27.195595 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 217466us
W20260709 13:10:27.184898   883 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.003s
W20260709 13:10:27.170264   905 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:10:27.230665   559 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:27.209146   820 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:27.119033   817 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.205466 30404 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:27.237869 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.238636 30404 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:27.239512 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.123039   831 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.211002 30409 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.243265 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.210956 30555 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 5: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.243960 31153 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.147291   734 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.127175   834 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.253319 30485 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:27.226020 30402 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:27.227644   902 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:27.227263   883 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.235764 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.236443   842 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.207978   826 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.238523   817 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:27.171662   703 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:27.234493 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.136788   815 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.242384 30405 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:27.150686   858 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.249861 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.244933   899 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.258529 30407 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:27.138137   890 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.194468   862 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.287055 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:27.315616 30483 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.200177   799 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.272207 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:27.271517 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.298563 30560 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:10:27.300050 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 199756us
I20260709 13:10:27.243835   769 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.301002 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.305485 30477 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:27.204895   864 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.338589 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 104188us
I20260709 13:10:27.341452 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.341836 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.339143 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.306341 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:27.306902 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 222296us
I20260709 13:10:27.344841 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:27.308986 30484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.028s	sys 0.044s
I20260709 13:10:27.345279   899 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.349278 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.349323   831 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.350790   834 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.350592   847 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.351730   847 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:27.271013   863 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:27.353434 30405 raft_consensus.cc:2368] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:27.311573 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:27.314087 30554 raft_consensus.cc:2368] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:27.270192   476 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:27.320508 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.257854 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.200182   915 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.357808 30402 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:27.311281 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.301093 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.316268   703 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:27.326331   887 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.005s
I20260709 13:10:27.329202   799 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.330392   876 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.001s
W20260709 13:10:27.330541   909 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:27.330852   769 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.333771   826 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.334882   802 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.336479   865 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:27.337357   914 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:27.358806 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.414974   918 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:27.415321 30402 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:27.416342 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.417896 30402 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:10:27.321592 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:27.419309 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97796.2us
I20260709 13:10:27.419821   924 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.360889   734 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.366914   476 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.422264   915 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:27.368360   907 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:10:27.369514   901 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:10:27.370033   721 consensus_meta.cc:287] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.557s	user 0.004s	sys 0.004s
I20260709 13:10:27.315944   798 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.318609   817 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:27.365655   866 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:27.437487 30411 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:27.438162 30406 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:27.390287 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:27.438961   912 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:27.439556   864 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.439891 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.440979 30555 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.393566 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.395720 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.402001 31152 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:27.299163   820 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.404209 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64871.2us
I20260709 13:10:27.372123   913 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.425501 30402 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:27.428310   842 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
W20260709 13:10:27.432518   803 consensus_meta.cc:287] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.537s	user 0.002s	sys 0.009s
I20260709 13:10:27.449358 30411 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:27.407325   890 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.454483 30402 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:27.442193 30404 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:27.436002   918 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:27.457759   830 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.002s
I20260709 13:10:27.403048   876 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.453161   651 consensus_meta.cc:287] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:10:27.449687   800 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.456969   838 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:27.460608 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.470085 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.477746   703 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.453008   913 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.396081   887 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.481853 30558 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:27.483090 30404 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:27.488334 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.484066 30555 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
W20260709 13:10:27.489053 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.442935   721 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.498512 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:27.507299 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:27.517181 30450 leader_election.cc:400] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:27.517741 30450 leader_election.cc:403] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:27.520004 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:27.495939   913 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.487010   846 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.474893   803 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.524398 30404 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:27.527209 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.529112 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.527011   924 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:27.530099 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.495245   838 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.534825 31149 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:27.535431 31151 raft_consensus.cc:2368] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:27.536224   876 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.537173   769 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.537338   867 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:27.542305   885 consensus_meta.cc:287] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.003s
I20260709 13:10:27.487416   800 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.543828 31152 raft_consensus.cc:2368] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:27.509572   834 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:27.522552   931 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.518010   476 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.551632 30410 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:27.598953 30480 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:27.523833   915 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:27.601094 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.544100 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.604876 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.607586 30555 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:27.523734   798 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 4. Current term is 5.
I20260709 13:10:27.533260   883 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.613974 31153 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:27.627019 30409 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:27.628522   932 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:10:27.634928 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 104896us
I20260709 13:10:27.635704   887 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.635797 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:27.543488   846 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.616357   858 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.600716   862 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:27.603843   838 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:27.603351   842 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.486550   918 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.641275 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.650815 30555 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:27.649127 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.655615 30409 raft_consensus.cc:2376] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6. Re-sending same reply.
I20260709 13:10:27.656749 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.657438 30409 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:27.656941 30408 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:27.643014   834 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:27.604928   885 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.665268 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.666635 30409 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:10:27.668591   929 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:27.670390 30409 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:27.653110   842 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:27.678107   933 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:27.679123 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.680888 30555 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:27.670526   887 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.682255 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.687716   846 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:27.688954   930 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:10:27.691457   911 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.491s	user 0.003s	sys 0.000s
I20260709 13:10:27.694124 31146 raft_consensus.cc:2368] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:27.695850   800 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.696750 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.698439 30553 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:10:27.699648   889 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.699844 30553 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:27.700981 30553 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:27.686209 30555 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:27.704346   887 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.706446 31149 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:27.708125   887 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.708406   842 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:27.709270   825 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.005s
I20260709 13:10:27.711270 30553 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260709 13:10:27.711398   538 consensus_meta.cc:287] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.005s
I20260709 13:10:27.711942   538 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.714109   538 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.685376   803 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.714877 30553 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:10:27.715178   875 consensus_meta.cc:287] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.003s
I20260709 13:10:27.716070 30405 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:27.716506 30402 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:27.684232   885 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.716169   919 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:10:27.720281   936 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:27.724961 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.725811 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.726509 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.727144 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.729966 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:27.730234 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.730289 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.730577 31149 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:27.731160 30485 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:27.733017 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.734061 30479 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:27.739171 30485 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:27.740672 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.744997 30409 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:27.734846   800 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.745361 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.744098   810 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:10:27.748698   924 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:27.749130   810 consensus_queue.cc:1243] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:27.749235   924 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.750223   924 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.748329   800 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.741235   825 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.753386 30481 pending_rounds.cc:85] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 4
I20260709 13:10:27.756349 30481 pending_rounds.cc:107] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:10:27.756659 30481 raft_consensus.cc:2889] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.735298   919 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:10:27.761433 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.745471   846 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:27.766799 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.767156 30485 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:27.766978 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:27.767910 30482 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:27.769853 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:27.772344 30479 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:27.756294   825 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.774658   825 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.779202   800 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.782461   721 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.783823 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:27.784477 30558 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:27.785751   924 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.787092   721 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.791159 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:27.785817 30558 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:27.795878 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:27.796591 30558 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:27.803529 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:27.802294 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.806900 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:27.809803 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.811347 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.812119 30402 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:10:27.814968 30357 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0472fa7187444a91b443058ef89fceb9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:27.815572 30357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:10:27.815918 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:10:27.787559   721 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:27.824280 30558 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:27.826474 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.827059 30409 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.828045 30402 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:27.829645 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:27.821615   942 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:27.834793 30558 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:27.869771 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.870573 30406 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.817765   885 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:27.873349 30558 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:10:27.870419 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 74651.3us
I20260709 13:10:27.822616   777 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:10:27.830237   921 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:27.878278   898 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.880193 30558 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:27.883003 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:27.883894 30402 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:27.884366 30409 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:27.867842   827 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.879096   898 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.833957   841 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:27.830595   476 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:10:27.880088   703 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.922232 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:27.879427   816 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:27.922653 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:27.876888   885 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.932080   885 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.932189 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.932781 30402 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:27.879933   899 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:27.923447   906 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:27.936655   906 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:27.937500   906 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.938349   898 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.923861   856 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.925850   924 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:27.931457   890 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:10:27.937516   913 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.942668   913 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:27.920815   777 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:10:27.916133   827 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.947118   827 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.947755   830 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:27.951998 30559 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:27.959018 30402 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:27.880287   799 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:10:27.964311 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:27.965342 30402 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.953285   559 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.919201   410 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:10:27.980494   913 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.981038   913 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:27.983137   913 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:27.994446   941 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:27.974644   559 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.002739   559 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.976428   410 consensus_queue.cc:1243] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:28.012637 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:28.014101 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:28.019080 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.019780 30556 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:28.020109 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:28.020699 30409 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:28.021160 30556 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.021485 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:28.021982 30409 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.022800   825 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.024061 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.024619 30558 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:28.024886   825 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:27.998101   885 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.025918   931 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:28.027812 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.028952 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.029451 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.031996 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:28.032317 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.032845 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.042471 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.043540 30406 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.045511 30556 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:28.045989 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.048518 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.050328 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:28.057849 30402 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:28.045125   913 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:28.059255 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.060647 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:28.051100 30408 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:28.061314 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:28.062649 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.064483 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.064946 30406 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:28.065261 30481 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.044973   877 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:28.065363 30406 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:28.068118 30406 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.039350   828 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.046211   816 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:28.046362   799 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:28.046489   476 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.049017   538 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:28.092027 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1480) took 1033 ms. Trace:
I20260709 13:10:28.110025 30411 rpcz_store.cc:276] 0709 13:10:27.058317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.438271 (+379954us) service_pool.cc:224] Handling call
0709 13:10:27.438598 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.462742 (+ 24144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.091682 (+628940us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54002a5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:28.091951 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24156544}
I20260709 13:10:28.082819   769 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:28.097029 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.084756   862 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:28.061883   410 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:10:28.103016 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.061475   898 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:28.059873   825 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.096576 30408 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:28.048744   925 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:10:28.049392   924 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:10:28.077155   913 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:28.102547 30409 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:28.128127 30481 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:28.060600   931 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:10:28.132982 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.162891 30555 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.163479 30551 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.108397   877 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:28.113085   799 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:28.105114   828 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.140692   827 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.141856 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.135192   769 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:28.113266   476 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:28.149224   949 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:28.150427 30480 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.135630   876 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.152163   703 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:28.153162 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1489) took 1090 ms. Trace:
I20260709 13:10:28.154281 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1686) took 1212 ms. Trace:
I20260709 13:10:28.108305   538 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.161335 30560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1701) took 1161 ms (client timeout 1502 ms). Trace:
I20260709 13:10:28.122812   842 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.112807   816 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:28.193349 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 151714us
I20260709 13:10:28.179590 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:28.192499 30560 rpcz_store.cc:269] 0709 13:10:27.000223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.026536 (+ 26313us) service_pool.cc:224] Handling call
0709 13:10:28.161131 (+1134595us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000ed8d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.161267 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518102912}
W20260709 13:10:28.181217 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 136472us
I20260709 13:10:28.195246 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.182466 30556 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.196859 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.128842   862 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.130453   838 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:28.187984 30479 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:28.189648 30407 rpcz_store.cc:276] 0709 13:10:27.062880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.081005 (+ 18125us) service_pool.cc:224] Handling call
0709 13:10:28.152876 (+1071871us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400285fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.153090 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266802432}
I20260709 13:10:28.179273   898 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:28.191512 30554 rpcz_store.cc:276] 0709 13:10:26.942087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.943464 (+  1377us) service_pool.cc:224] Handling call
0709 13:10:28.154039 (+1210575us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54002b9154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.154209 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797578112}
I20260709 13:10:28.198920 30551 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.202672 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:28.203848 30556 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:28.211234 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.211885 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.212739 30560 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:28.213083 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.214125   847 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:28.213943 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.214735 30560 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.215911 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.216601 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.193789   538 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.193356   703 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.204823   842 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.231935 30560 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.232617   842 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.232944 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.233493 30560 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:28.207274   831 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:28.234539 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.235224   831 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.219148   847 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.204602   825 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:28.237582   825 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:28.238392   825 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.222556   816 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.239708 30560 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:28.242724   831 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.242976   769 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.243592   799 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.206868   862 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.240622 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.256788 30558 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:28.207943   834 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:28.258882 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.265255 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.266033 30482 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.266656 30551 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:28.267439 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.267985 30558 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.271894   898 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.281962   828 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.282954   877 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.283838 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.284672 30477 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.213989   810 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:28.192796   876 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.289495 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.295037 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:28.297708 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 210991us
I20260709 13:10:28.316407 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.247462   885 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:28.319976 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 106957us
I20260709 13:10:28.342296 30477 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:28.342339 30482 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.349458 30551 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:28.351694 30560 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:28.292459   810 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.356319 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.362303 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.366482   842 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:28.366976   842 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.367314   842 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.372530 30406 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:28.356305   901 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:28.380400 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.385859 30406 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.387290 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:28.357529   810 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.258855   913 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.365716   847 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:28.407775 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73442.3us
I20260709 13:10:28.412693 31146 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 6 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:28.417397 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:28.418098 31149 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:28.419363   954 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:28.410890   956 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:28.410732 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 422) took 1165 ms. Trace:
I20260709 13:10:28.372917   834 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:28.397442   410 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.403714   847 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.445650 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:28.444092 30557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1461) took 2103 ms (client timeout 1915 ms). Trace:
W20260709 13:10:28.448490 30557 rpcz_store.cc:269] 0709 13:10:26.340701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.346781 (+  6080us) service_pool.cc:224] Handling call
0709 13:10:28.443870 (+2097089us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003f3c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.444016 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807913728}
I20260709 13:10:28.449645 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.450233 30557 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:28.451364 30557 pending_rounds.cc:85] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 2
I20260709 13:10:28.451658 30557 pending_rounds.cc:107] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:28.451958 30557 raft_consensus.cc:2889] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.452199 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:28.453023   816 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.391623   846 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:10:28.411280   959 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:28.408951   919 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:10:28.447290   827 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.411643   825 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:10:28.453498   847 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.453420   816 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.461215   875 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:28.484663   842 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:28.485774   965 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:10:28.486172   476 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.464397   959 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.423147 31151 rpcz_store.cc:276] 0709 13:10:27.243162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.247962 (+  4800us) service_pool.cc:224] Handling call
0709 13:10:28.393803 (+1145841us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54006a09d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.408250 (+ 14447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323788032}
I20260709 13:10:28.488348   875 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.408752   856 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:28.504609   703 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.489857   816 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.506716   538 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:28.511510 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 210871us
W20260709 13:10:28.516150 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.508249   972 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.507223   875 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.520780   703 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.523075   538 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.490907   559 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.507627   959 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:28.519168   958 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:10:28.530774   559 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.532663   838 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:28.533390 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 423) took 1270 ms. Trace:
W20260709 13:10:28.534878   955 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:10:28.512086   876 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.542654 31153 rpcz_store.cc:276] 0709 13:10:27.263395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.263580 (+   185us) service_pool.cc:224] Handling call
0709 13:10:28.533241 (+1269661us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54006301d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.533339 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610184576}
I20260709 13:10:28.547900   842 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.549067 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.552058   875 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.552785 30558 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.562448 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:28.563125 31153 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.541846   538 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:28.567333 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55343.2us
I20260709 13:10:28.575116 31153 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:28.576469 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.572494 30558 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:28.554665   875 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.560086   838 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.583395   838 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.585626 30556 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:28.520805   972 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.588507   972 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.573287   538 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.590085 30560 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:28.590783   856 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:28.591250   538 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.592823 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1818) took 1486 ms. Trace:
I20260709 13:10:28.593231 30410 rpcz_store.cc:276] 0709 13:10:27.106611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.212228 (+105617us) service_pool.cc:224] Handling call
0709 13:10:28.592660 (+1380432us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54003eec54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.592766 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508536064}
I20260709 13:10:28.594871 30403 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.594980   856 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:28.596191   856 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.557649   862 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.599157 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1495) took 1452 ms. Trace:
I20260709 13:10:28.599351 30553 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:28.599577 30405 rpcz_store.cc:276] 0709 13:10:27.147472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.374307 (+226835us) service_pool.cc:224] Handling call
0709 13:10:28.598979 (+1224672us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002869d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.599099 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610281344}
I20260709 13:10:28.600455   862 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:28.602366 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 218389us
I20260709 13:10:28.578289 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.607661 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:28.612504 30403 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:28.598414   816 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.611236 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:28.609346 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:28.614382 30402 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.617195 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:28.617925 30404 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:28.621201 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:28.625808 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.622939 30411 raft_consensus.cc:2376] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9. Re-sending same reply.
I20260709 13:10:28.632445 30402 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:28.635576 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:28.637066 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.639605 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53700
I20260709 13:10:28.640326 30402 raft_consensus.cc:606] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:10:28.639642 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:28.641230   842 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.621708   800 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:10:28.655714   842 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.657999   842 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.658197   816 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.659871 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.663159 30376 leader_election.cc:400] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:28.663561 30376 leader_election.cc:403] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.634101   973 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:28.616034   931 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:28.615844   919 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:10:28.654074   876 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.654608   875 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.616951   815 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:28.674491 31153 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:28.654064   559 raft_consensus.cc:2764] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:28.668843 30376 leader_election.cc:400] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
I20260709 13:10:28.634346   838 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:28.660744   968 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:28.686785 30376 leader_election.cc:403] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.668843   769 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:28.690892 31153 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:28.666002   977 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.670022   834 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:28.669634   976 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:28.669288   973 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:28.699383   972 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 5. Current term is 6.
W20260709 13:10:28.711040   917 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:10:28.710549   847 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.713840 31152 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:10:28.714668 30483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1758) took 1371 ms (client timeout 1684 ms). Trace:
I20260709 13:10:28.714282 30376 leader_election.cc:400] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
W20260709 13:10:28.717453 30483 rpcz_store.cc:269] 0709 13:10:27.341394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.341545 (+   151us) service_pool.cc:224] Handling call
0709 13:10:28.713012 (+1371467us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000c9754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.713193 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777825024}
I20260709 13:10:28.717878 30376 leader_election.cc:403] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:28.712791   976 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:28.727974   976 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.723932 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:28.731669   810 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.724100 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.734302 30551 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.716566   834 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:10:28.722249 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:28.692515   968 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.735790 30552 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:28.735945 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1685) took 1794 ms (client timeout 1711 ms). Trace:
W20260709 13:10:28.736403 30559 rpcz_store.cc:269] 0709 13:10:26.941794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.942226 (+   432us) service_pool.cc:224] Handling call
0709 13:10:28.735783 (+1793557us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400038ed4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:28.735883 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319518464}
I20260709 13:10:28.677099   876 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.746958 30405 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:28.676240   875 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.712973   769 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:28.717335   973 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.744933 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:28.750792 30556 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:28.751994 31149 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.743027 30376 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.758967 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:28.695748   838 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.759783   842 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:28.761205 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:28.789199 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:28.762818 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:28.764782 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.791628 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.792273 30483 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.771142 30484 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:28.793774 30477 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:28.778766 30551 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:28.779405 30552 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:28.782557 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.795986 30485 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:28.782856 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.783967 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.796578 30479 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:28.785027 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.797628 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.798827 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.745888   972 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:28.803890 30484 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:28.807165 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:28.743264   968 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.812947 30477 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.812815 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.813723 30481 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:28.715540   977 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.820142 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.822403 30483 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:28.823797 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:28.771322   816 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:28.819492 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:28.828826 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:28.810467   800 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:28.815057   815 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:28.830910 31146 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:28.815748   842 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:28.826205   856 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.845134 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:28.846481 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:28.849704 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:28.812417   959 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.835811   966 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:28.869282 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:28.869884   972 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:28.839316   410 raft_consensus.cc:2764] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:28.835892 31151 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 6 LEARNER]: Advancing to term 7
W20260709 13:10:28.873564 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 107214us
I20260709 13:10:28.878376 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:28.879448 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 50084.5us
W20260709 13:10:28.884529 30376 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.711s (SENT)
I20260709 13:10:28.884977 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:28.897351 30558 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:28.871992   810 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:28.836378   816 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.894645   866 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.937098   866 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.937288   875 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:28.937592   866 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:28.938978   986 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:10:28.941339   838 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:28.941972   838 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:28.942567   998 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:28.943008  1000 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:28.847170   769 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.943538  1000 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:28.943660   998 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:28.944044   998 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:28.944483  1000 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.944903   998 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.867336   856 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:28.892323   966 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:10:28.952611   987 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:28.963213 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1866) took 1084 ms. Trace:
I20260709 13:10:28.885452   842 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.948180   998 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.963737 30486 rpcz_store.cc:276] 0709 13:10:27.878857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.601200 (+722343us) service_pool.cc:224] Handling call
0709 13:10:28.601535 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.601897 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.601928 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.608297 (+  6369us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.697140 (+ 88843us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:28.697182 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.697257 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.962986 (+265729us) raft_consensus.cc:1685] finished
0709 13:10:28.963006 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.963151 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2568,"raft.queue_time_us":873,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4341,"thread_start_us":70106,"threads_started":1,"wal-append.queue_time_us":164804}
W20260709 13:10:28.983388   990 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:10:28.983779   966 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:28.985817 30557 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:28.935820   834 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:28.953114   900 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:10:28.993683 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 110812us
W20260709 13:10:29.000346 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44015.6us
I20260709 13:10:29.006736 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:29.008383 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.011349 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.013659   810 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:29.014407   810 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.017277   810 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.019546 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:28.990737   847 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.026324 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:29.027729 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1477) took 1262 ms. Trace:
I20260709 13:10:29.028067 30553 rpcz_store.cc:276] 0709 13:10:27.765743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.765914 (+   171us) service_pool.cc:224] Handling call
0709 13:10:28.161291 (+395377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.599815 (+438524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.600400 (+   585us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000ed8d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:29.027593 (+427193us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54000ed8d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:29.027688 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897459328}
I20260709 13:10:29.005174   876 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.039321 31149 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
W20260709 13:10:29.088527 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 204004us
W20260709 13:10:29.089469 30376 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.711s (SENT)
I20260709 13:10:29.024327   801 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:10:29.104813   977 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.127118   959 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:29.150072 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60637.8us
I20260709 13:10:29.183173   968 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.185907 30483 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:29.200575   816 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.200896 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:29.195775   876 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.201900   876 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.196421   856 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.213099   876 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.215703   976 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:29.229121   960 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.813s	user 0.001s	sys 0.000s
I20260709 13:10:29.236379   866 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.239655   721 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:29.242830 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.247649 31151 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:29.248562 31149 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:29.255975   918 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:29.256546   918 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.257951 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:29.258927 30483 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:29.260423 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55674.3us
I20260709 13:10:29.259810 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1831) took 1309 ms. Trace:
I20260709 13:10:29.279624 30407 rpcz_store.cc:276] 0709 13:10:27.950004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.205664 (+255660us) service_pool.cc:224] Handling call
0709 13:10:28.205963 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.206274 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.206300 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.209930 (+  3630us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.337965 (+128035us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:28.338010 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.338128 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.228447 (+890319us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:29.259189 (+ 30742us) raft_consensus.cc:1685] finished
0709 13:10:29.259219 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.259735 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":463,"raft.queue_time_us":1115,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5487,"spinlock_wait_cycles":19780352,"thread_start_us":110162,"threads_started":1,"wal-append.queue_time_us":161855}
I20260709 13:10:29.296663 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.297801 30407 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:29.309581 30483 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:29.313943 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37990
I20260709 13:10:29.314576 30551 raft_consensus.cc:606] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:10:29.314920 30551 raft_consensus.cc:614] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:29.315050 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:29.313962 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.316910 30403 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:29.261137   846 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.318085 30409 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:29.320011 30406 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:29.331137 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.330368 30406 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:29.332940 30406 pending_rounds.cc:85] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 4
I20260709 13:10:29.333335 30406 pending_rounds.cc:107] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:29.333772 30406 raft_consensus.cc:2889] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.324621 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.258657   918 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.284031   825 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:29.341120 30552 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:29.291221   410 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:29.311743   734 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.351717 30404 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:29.354106 30411 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:29.354722 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.260620   885 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:10:29.312857   978 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.360610 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.361272 30409 raft_consensus.cc:2376] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7. Re-sending same reply.
I20260709 13:10:29.359109 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:29.362187 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.368405 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:29.326359  1003 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.353333   866 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.355837   769 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.373265   810 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:29.372196   973 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:10:29.384064 30411 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:29.375213 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.371323   899 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.398204 30411 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:29.342447   846 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.395005 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.383558 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.374586 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:29.376778   721 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:29.356572   825 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.390409 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.362208   410 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.364298   734 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.413698   899 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.407810 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.395975   769 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.396971   973 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.397148  1000 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:10:29.416917   798 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:29.417739   816 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:29.418780   846 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.412446   956 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:10:29.410997   815 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:29.419397 30407 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:29.393613  1003 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:29.424664 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:29.370559   918 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:29.391228   976 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.363807   978 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.414206 30411 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:29.398947   999 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:29.444064 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:29.586817 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 144160us
I20260709 13:10:29.443257 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:29.441545   734 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.593127   999 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.593696   999 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.593981  1003 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.594640   999 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.596161   999 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.589742 30558 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:29.597985 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:29.598306 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 173744us
I20260709 13:10:29.488090   866 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.612710 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 169514us
I20260709 13:10:29.613445 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.524679   917 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:29.444748   828 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.147s
I20260709 13:10:29.592449   899 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.526934 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1703) took 2525 ms. Trace:
I20260709 13:10:29.593042   769 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.570664   825 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.526180   810 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.598891   956 consensus_queue.cc:1243] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:10:29.600399  1012 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.184s	user 0.004s	sys 0.000s
I20260709 13:10:29.600174   831 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.453783   968 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.559670 30404 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:29.565807  1011 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:10:29.617654 31150 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:29.617522 30555 rpcz_store.cc:276] 0709 13:10:27.001687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.704005 (+702318us) service_pool.cc:224] Handling call
0709 13:10:28.156950 (+452945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.163495 (+  6545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.526713 (+1363218us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54002b9150. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:29.526879 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974153984}
I20260709 13:10:29.491748   981 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.599622  1015 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 13:10:29.456279   410 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.620360   830 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:10:29.622634 31147 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:29.632102 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.618654   871 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:29.616154   866 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.642900 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.608897   924 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.643167 30558 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.643608 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.651916 30552 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:29.658586 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:29.659423 30478 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.641850   925 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.642619   856 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:29.665791 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.669268 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.673448 30552 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:29.673537 30406 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.671681 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.675012 30411 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:29.646589   721 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.676070 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.680316 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.637768   810 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.651103   924 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.621349   917 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.639869   981 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.651705   875 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:10:29.679250   734 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.679111   871 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:29.682760 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.697718 30552 raft_consensus.cc:2368] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:29.683000 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.682586 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.664744   847 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:29.672740   856 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:29.703605 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.693274   883 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:29.703169 30558 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:29.715680 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.718667 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.720563 30411 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.713363 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:29.721894 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.723549 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.716641 30404 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:29.725663 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.723034  1003 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:29.726377   883 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.726816  1003 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.728760   883 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.729687  1003 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:29.731868  1016 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
I20260709 13:10:29.733429 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:29.733760 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.734033 30555 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.735309   973 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.735884   973 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.733470 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:29.741422 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:29.741989 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.742847 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.743408 30483 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:29.743764 30483 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.743898 30485 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:29.742985 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.744256 30406 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:29.744482 30477 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:29.744908 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.745721 30480 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:29.745621 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.748824 30404 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.751538 30552 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:10:29.755805 30402 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:29.763609 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:29.744462 30483 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.765250 30483 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:29.778083 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.779757 30483 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:29.783205 30483 pending_rounds.cc:85] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:10:29.783618 30483 pending_rounds.cc:107] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:29.783967 30483 raft_consensus.cc:2889] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.782615 30411 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:29.780253 30478 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:29.787076 30478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1865) took 1983 ms (client timeout 2228 ms). Trace:
W20260709 13:10:29.787609 30478 rpcz_store.cc:269] 0709 13:10:27.803380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.658262 (+1854882us) service_pool.cc:224] Handling call
0709 13:10:29.787005 (+128743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:29.786458 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.677616   925 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.785267   959 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:29.793792  1026 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.801802   871 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.803339   978 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.808355   830 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.808094 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:29.842160 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:29.813427 30404 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:29.814677   856 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.816274   875 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:29.767138   924 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.719035   734 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.724261   847 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:29.860769   887 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.899s	user 0.014s	sys 0.013s
W20260709 13:10:29.861420   887 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.931s	user 0.014s	sys 0.013s
I20260709 13:10:29.862089   734 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.862246   847 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:29.837786 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 104394us
I20260709 13:10:29.863895 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:29.864073 30409 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:29.864933 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:29.825099   866 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.844661 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.866158 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1509) took 1157 ms. Trace:
I20260709 13:10:29.866649 30559 rpcz_store.cc:276] 0709 13:10:28.708949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.738664 (+ 29715us) service_pool.cc:224] Handling call
0709 13:10:28.740774 (+  2110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.789976 (+ 49202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.790006 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.810961 (+ 20955us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.837138 (+ 26177us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:28.837176 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.865717 (+1028541us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54003093d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:29.865777 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.865821 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:29.865841 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.866093 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":13529,"spinlock_wait_cycles":112359296,"thread_start_us":17545,"threads_started":1,"wal-append.queue_time_us":17964}
I20260709 13:10:29.868018   973 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.868614   973 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:29.869426   973 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.870025 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1499) took 1514 ms. Trace:
I20260709 13:10:29.870484 30556 rpcz_store.cc:276] 0709 13:10:28.355759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.586342 (+230583us) service_pool.cc:224] Handling call
0709 13:10:28.586623 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.752083 (+165460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.869740 (+1117657us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003f2354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:29.869950 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376729472}
I20260709 13:10:29.865898   978 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:29.873080 30552 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:29.874408 31153 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:29.878216 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:29.876878 30404 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:29.837186  1026 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.877789   800 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.896199  1026 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:29.886577  1027 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:29.873764   831 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:29.897589  1027 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.898074   831 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.900228   831 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.900414  1027 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.900797   866 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:29.901389   866 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.876243   883 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:29.859999   875 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.896696   800 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.832237   959 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:29.907354 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 170477us
I20260709 13:10:29.877225   856 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.892829   978 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:29.892623   999 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:29.911774  1019 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:10:29.912140   978 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.903770   924 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.912958   925 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.913784 30410 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:29.916368 30410 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:29.903666   816 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:29.903426   883 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.919085   883 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:29.921082   994 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.978s	user 0.004s	sys 0.000s
I20260709 13:10:29.903486   866 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:29.860206   830 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.908211   875 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:29.944159 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.927183   999 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.945734   999 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:29.946153 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.947394   959 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.948087  1031 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.949739 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.950677  1026 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:29.951182   410 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:29.951685   410 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.951742 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.952873   876 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.953315 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:29.944419   978 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:10:29.955363   800 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:29.955888   800 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:29.955964   931 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:29.958006   931 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:29.952773   410 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:29.977131 30556 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:29.979035 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:29.982146 30553 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:29.958412   931 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:29.986994 30556 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:29.978861  1000 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.981005  1027 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.991061 30553 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:29.984512   410 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.008555 30553 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:30.009749 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.010241 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.010679 30553 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:30.011446 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.011804 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.012753 30553 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:30.013070 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.013659 30555 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:29.991606   883 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.016376 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.017122 30555 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
W20260709 13:10:30.021344  1043 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:29.998287  1000 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.028286  1000 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.035353 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.040292   883 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:30.040073  1000 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:30.042431  1000 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:30.046720   899 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:30.049347 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:30.051290   830 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:30.051905   961 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.552s	user 0.007s	sys 0.005s
I20260709 13:10:30.056380 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:30.062460 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.063614 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:30.075346 31147 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:30.075479   800 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.075919   800 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.076285   800 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.055455   899 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.079630 30558 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:10:30.084617 30558 pending_rounds.cc:85] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 3
I20260709 13:10:30.084977 30558 pending_rounds.cc:107] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:10:30.085275 30558 raft_consensus.cc:2889] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:30.066113   925 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:30.097280 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 706957us
I20260709 13:10:30.098867   959 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:30.103883 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.107061 31152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 245) took 1409 ms. Trace:
I20260709 13:10:30.107445 31152 rpcz_store.cc:276] 0709 13:10:28.697892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.698081 (+   189us) service_pool.cc:224] Handling call
0709 13:10:28.699032 (+   951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.719450 (+ 20418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.106814 (+1387364us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b540069ebd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:30.106993 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33506048}
I20260709 13:10:30.019536   931 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.094905   925 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.094977   810 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.128732   977 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.110733   866 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.107450   899 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.116338   976 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.116541   825 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:30.141733 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.118997  1023 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.122972   925 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.147915 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.131285   977 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.150859 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:30.151598 30552 raft_consensus.cc:2368] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 9. Current term is 10.
I20260709 13:10:30.152549 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.153102 30556 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:30.153764 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:30.152680 31118 leader_election.cc:400] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 9. Current term is 10.
I20260709 13:10:30.157121 31118 leader_election.cc:403] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:30.132138  1021 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:30.175619   559 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:30.190162 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.192689 30403 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:30.196957 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.193962 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:30.203300  1052 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:30.203182 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.160066  1006 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:30.204180  1006 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.204613  1006 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.136886   866 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.204349   847 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:30.207659 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.194794 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.136816   899 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.146757   976 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.146198   825 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.158797   887 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:10:30.207057   973 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.148437  1023 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.259766 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.191421   900 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:10:30.159644   968 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:10:30.270941 30555 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:30.291319 30376 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.645s (SENT) [suppressed 45 similar messages]
W20260709 13:10:30.257642  1039 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:10:30.297350 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 136988us
W20260709 13:10:30.298928 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 90519.6us
W20260709 13:10:30.274538   842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.005s	sys 0.012s
I20260709 13:10:30.217253   800 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.303057 30409 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:30.306615 30552 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:30.310772   899 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.311172   803 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:30.311328  1050 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:10:30.305224   842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.006s	sys 0.012s
I20260709 13:10:30.321949 31151 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:30.324385 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 248) took 1578 ms. Trace:
I20260709 13:10:30.324863 31150 rpcz_store.cc:276] 0709 13:10:28.745596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.746191 (+   595us) service_pool.cc:224] Handling call
0709 13:10:30.324190 (+1577999us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54005a2154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:30.324316 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903337728}
I20260709 13:10:30.332811 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.300094   875 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.308084   956 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.339776 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.340510 31149 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:30.335932 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:30.336829 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.343052 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.311754   803 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.347796  1023 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.347899   976 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.320045   899 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.350485 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:30.354794 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.358448 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.349615   906 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.373600 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 82303.2us
I20260709 13:10:30.376787 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.377090   976 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.377596   976 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.379287 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.379654   866 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.380302 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.380733 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.344817   956 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.381108   875 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:30.396510  1061 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:30.397145   410 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:30.397789   410 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:30.399187   991 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.461s	user 0.000s	sys 0.003s
I20260709 13:10:30.364380   899 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.372434   977 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.400879   410 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:30.382366   906 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.397907   956 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.401911   899 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:30.398669  1010 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.972s	user 0.003s	sys 0.000s
I20260709 13:10:30.403815   925 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.404492   906 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.405095   803 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.405907   925 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.407871   800 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.409365   825 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.355561   830 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:10:30.407995  1013 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.982s	user 0.003s	sys 0.000s
I20260709 13:10:30.363698   856 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:30.397899  1055 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:30.422214 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.425091 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.425573 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.426991 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.428023 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:30.428062 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.428659 30555 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.429512 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:30.430408 30552 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.390555   866 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.438098 30555 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:30.379333   976 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.430208  1006 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.447124 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 416) took 1251 ms. Trace:
I20260709 13:10:30.448524 31149 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:30.447830 30554 rpcz_store.cc:276] 0709 13:10:29.195503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.197448 (+  1945us) service_pool.cc:224] Handling call
0709 13:10:29.197803 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.198148 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.198178 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.198665 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.375051 (+176386us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:29.375093 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.375166 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.407427 (+1032261us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:30.440499 (+ 33072us) raft_consensus.cc:1685] finished
0709 13:10:30.440526 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.447049 (+  6523us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2170,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":17862400,"thread_start_us":175977,"threads_started":1,"wal-append.queue_time_us":226696}
I20260709 13:10:30.456982 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:30.465184 30556 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:30.466622 30552 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:30.477779 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.450351   866 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.481045 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.481439 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.482023 30552 raft_consensus.cc:2376] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10. Re-sending same reply.
I20260709 13:10:30.497396   981 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.500356   866 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.504657   973 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 9. Current term is 10.
W20260709 13:10:30.482963  1054 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.220s	user 0.003s	sys 0.000s
I20260709 13:10:30.506735  1006 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.510671 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.514429 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:30.521555 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.533911 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:30.539995 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:30.541200  1059 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.515385  1006 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:10:30.525797   815 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.550976 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1508) took 1944 ms. Trace:
I20260709 13:10:30.547281 31146 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:30.541926  1027 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:30.552927  1027 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.555322  1027 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:30.556125   816 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:30.556748  1057 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:10:30.556684   816 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.558187   815 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.558943   816 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.560555 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1726) took 1239 ms. Trace:
I20260709 13:10:30.561061 30558 rpcz_store.cc:276] 0709 13:10:29.321252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.715902 (+394650us) service_pool.cc:224] Handling call
0709 13:10:29.720442 (+  4540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.085822 (+365380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.560225 (+474403us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54003381d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:30.560475 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824894720}
I20260709 13:10:30.551553 30405 rpcz_store.cc:276] 0709 13:10:28.606814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.606982 (+   168us) service_pool.cc:224] Handling call
0709 13:10:28.607372 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.747487 (+140115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.550618 (+1803131us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002a67d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:30.550901 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320295296}
I20260709 13:10:30.565408   815 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.568974   800 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:30.571120 31150 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:30.573135 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.575248 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.583037   959 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:30.583683   959 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:30.584858   959 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.599157   981 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.602954   981 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.605350   981 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:30.605876 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.600313   815 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:30.608310 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:30.601868  1027 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:30.617105  1027 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.621697  1027 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:30.615815   800 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.623890   800 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.624504 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.625375 30554 raft_consensus.cc:2368] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:30.626101   800 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.627219 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:30.628871 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.647838   977 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.648411   977 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.648900 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.650532 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.658301 30403 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:30.659112 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:30.656986 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.661514 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.661996 30403 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:30.642156   976 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.650646   977 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.642630   815 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.664435   899 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:30.674403   899 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.676467   899 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:30.680089   931 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.681198 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:30.662446   800 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:30.665669   831 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.662562   816 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:30.685940 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:30.682462   834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.011s
I20260709 13:10:30.664613   956 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:30.664492   410 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:30.700451 30376 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.502s (SENT)
I20260709 13:10:30.714388 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:30.725214 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:30.715306   834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.002s	sys 0.011s
I20260709 13:10:30.741575 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.744501 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:30.745229 30405 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:30.726027 30403 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:30.757741 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.683746   976 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.686414   815 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.779192 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.783375 30409 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:30.795732   981 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.796329   981 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.800608 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:30.724056   977 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:30.721462   410 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.714627   831 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.716359   816 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.849040   976 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:30.850086  1023 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:30.721117   956 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.850777  1023 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:30.704051   800 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:30.853794   917 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:30.890100 30403 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:30.903079 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 237845us
I20260709 13:10:30.904436 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1515) took 1605 ms. Trace:
I20260709 13:10:30.904834 30407 rpcz_store.cc:276] 0709 13:10:29.299476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.300183 (+   707us) service_pool.cc:224] Handling call
0709 13:10:29.309917 (+  9734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.589498 (+279581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.904182 (+1314684us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400398fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:30.904380 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250917760}
I20260709 13:10:30.906492 30407 pending_rounds.cc:85] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 3
I20260709 13:10:30.907323 30407 pending_rounds.cc:107] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:30.907652 30407 raft_consensus.cc:2889] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:30.983927   961 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:10:31.161491 30402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1840) took 1491 ms (client timeout 1699 ms). Trace:
W20260709 13:10:31.162089 30402 rpcz_store.cc:269] 0709 13:10:29.670152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.680102 (+  9950us) service_pool.cc:224] Handling call
0709 13:10:31.161287 (+1481185us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b5400287dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:31.161418 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171225344}
I20260709 13:10:31.201705 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1846) took 1521 ms. Trace:
I20260709 13:10:31.202265 30411 rpcz_store.cc:276] 0709 13:10:29.680026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.843084 (+163058us) service_pool.cc:224] Handling call
0709 13:10:29.874121 (+ 31037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.874291 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.874315 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.874359 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.874392 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.874444 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.201452 (+1327008us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54002873d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:31.201629 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70610432}
I20260709 13:10:31.146639 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 254) took 1275 ms. Trace:
I20260709 13:10:31.206101 31147 rpcz_store.cc:276] 0709 13:10:29.871505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.871918 (+   413us) service_pool.cc:224] Handling call
0709 13:10:29.887794 (+ 15876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.075907 (+188113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.099245 (+1023338us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54006d01d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:31.143711 (+ 44466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423900544}
I20260709 13:10:31.174731   890 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:31.231586   890 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:31.228677   931 consensus_meta.cc:287] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.002s
I20260709 13:10:31.250398   981 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:31.252791 30405 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.009s
W20260709 13:10:31.256129 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 555703us
I20260709 13:10:31.272392 30405 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:31.256646  1000 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:31.268244  1023 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:31.231837  1078 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 13:10:31.282811 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:31.289500 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:31.242002   890 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:31.284490 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 379583us
I20260709 13:10:31.322573 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:31.275650   917 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.275821  1003 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:31.287556   931 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:10:31.327350 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:31.332162   924 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.368673 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 109032us
I20260709 13:10:31.370141 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1507) took 2707 ms. Trace:
I20260709 13:10:31.370642 30560 rpcz_store.cc:276] 0709 13:10:28.662447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.731046 (+ 68599us) service_pool.cc:224] Handling call
0709 13:10:28.731332 (+   286us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:28.731726 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.731764 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:28.732599 (+   835us) log.cc:844] Serialized 78 byte log entry
0709 13:10:28.835058 (+102459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:28.930399 (+ 95341us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.246211 (+315812us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.246393 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.246458 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.334765 (+1088307us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:31.369726 (+1034961us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b2c0003c518. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa043359291 00007fa0433740ca 00007fa0450a24ad 00007fa0450a9f8e 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:31.369834 (+   108us) raft_consensus.cc:1685] finished
0709 13:10:31.369855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.370074 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299216,"prepare.queue_time_us":699934,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":3191,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":4718,"spinlock_wait_cycles":40657536,"thread_start_us":160353,"threads_started":2,"wal-append.queue_time_us":140663}
W20260709 13:10:31.367547  1081 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:10:31.334013  1003 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.334218   917 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:31.476199 30357 auto_rebalancer.cc:893] Removing replace marker failed: Replica 027e191e31da4af2bc83c5ddc0c15d05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:31.476691 30357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:10:31.477011 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:10:31.453404  1000 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.485061 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.485842 30410 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:31.370975   924 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.486603 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:31.487174 30410 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.488461   924 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:31.368083   890 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:31.490015   890 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:31.479339 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 109950us
I20260709 13:10:31.484925  1027 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:31.497331 30410 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:31.503719 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:31.504822 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:31.506302 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 230659us
I20260709 13:10:31.515084 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:31.516055 30410 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:31.530038 30410 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:31.539772 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.540685 30410 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:31.541754 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.544575 30410 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:31.551518 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.552191 30410 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:31.556459 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:31.557224 30449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.006s
W20260709 13:10:31.558243 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50119.5us
W20260709 13:10:31.556725 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 231334us
W20260709 13:10:31.561210 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.562206 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:31.562491 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:31.506134   828 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:31.565982 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 61167.8us
W20260709 13:10:31.558301  1079 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:10:31.564790 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 241073us
I20260709 13:10:31.555397   834 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.520018  1023 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.564095 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:31.573263 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:31.566567  1089 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.599350 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.602632 30409 raft_consensus.cc:2376] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8. Re-sending same reply.
I20260709 13:10:31.603988 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:31.592696 30408 raft_consensus.cc:1217] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:10:31.607015 30408 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:10:31.619207 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 287747us
I20260709 13:10:31.584066   875 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:31.625975 30410 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:31.568764   862 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.594525   800 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:31.570545   828 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.572358   834 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:31.644991 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 71838.3us
I20260709 13:10:31.656775 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:31.579054  1023 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:31.657797 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 88586.4us
W20260709 13:10:31.638679  1086 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:31.593245   866 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:10:31.671504 30410 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:10:31.674631 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 113540us
I20260709 13:10:31.642639  1091 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:31.677772 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 108802us
I20260709 13:10:31.670236  1101 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:31.624207  1089 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.657884   862 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:31.717972 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61282.2us
I20260709 13:10:31.719046 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:31.715086   875 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:31.682866  1098 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:31.689493   800 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:10:31.737654 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59407.4us
I20260709 13:10:31.739836 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:31.741379 30376 leader_election.cc:400] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:31.741742 30376 leader_election.cc:403] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:31.747408 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:31.767683 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 79958.3us
I20260709 13:10:31.786314 30450 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:31.739495   977 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:10:31.823705 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 51848.4us
I20260709 13:10:31.838418  1113 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:31.839111  1113 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.842868   828 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:31.852113  1089 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:31.852887  1089 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:31.853329  1089 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.853768  1089 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:31.856431  1027 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.857018  1027 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.862664   410 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:31.765543  1003 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:31.766364  1108 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:31.916112 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 233070us
I20260709 13:10:31.835758  1091 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:31.792654   999 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:31.881721   828 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:31.864689   866 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.835116  1111 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:31.856479   831 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:31.906365  1110 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:10:31.926896 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 88910.6us
W20260709 13:10:31.948015 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 161821us
I20260709 13:10:31.961086 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:31.961324 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:31.835261  1097 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.834416  1104 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:31.911145   977 consensus_queue.cc:1243] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:31.914593   875 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.939020  1101 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:31.942494  1108 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:31.984452  1097 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.917120  1114 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:10:31.915036   931 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:10:32.058388  1130 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.969264 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:32.059265  1130 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:32.060041 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90873.1us
I20260709 13:10:32.061002 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:31.955642   834 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:31.955964  1111 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:31.983117  1091 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.998871  1125 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.081533  1133 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:32.081350  1125 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.081933  1097 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.082088  1133 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.082618  1114 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:31.999421   831 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.000259  1123 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.001648  1027 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.002198 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:32.002651  1107 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:32.008095  1093 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:10:32.008592  1023 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.009586   816 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.010507  1089 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:32.018630  1096 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.347s	user 0.000s	sys 0.011s
W20260709 13:10:32.026723  1085 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.659s	user 0.000s	sys 0.002s
I20260709 13:10:32.028760 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.031234   956 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.039216   917 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.044286  1102 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.130582  1127 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.130736  1102 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:32.130896  1134 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.980113  1132 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:31.949234   828 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.131152  1127 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.131799 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1541) took 1498 ms. Trace:
I20260709 13:10:32.131916   828 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.132314  1107 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:31.979476  1115 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.132790  1107 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:32.133229  1107 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.133085  1115 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:31.958951  1118 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:32.134032  1118 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.135092  1089 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.062366 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:32.136031 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73726.3us
I20260709 13:10:32.045315  1113 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.136610  1132 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:32.093122 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 91620.7us
I20260709 13:10:32.094498 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.095857 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.088048   831 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.101409 30405 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:32.137645 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:32.138521   956 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:32.088620   913 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.139106   831 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.132236 30407 rpcz_store.cc:276] 0709 13:10:30.632994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.905827 (+272833us) service_pool.cc:224] Handling call
0709 13:10:30.906242 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:31.280386 (+374144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.280427 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:31.281077 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 13:10:31.567705 (+286628us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:31.567749 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.567813 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.131579 (+563766us) raft_consensus.cc:1685] finished
0709 13:10:32.131602 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.131746 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":371928,"raft.queue_time_us":376481,"spinlock_wait_cycles":2235776,"thread_start_us":274337,"threads_started":1,"wal-append.queue_time_us":384865}
W20260709 13:10:32.105008 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.140383  1132 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.106813 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:32.142426  1000 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.001s
I20260709 13:10:31.961498  1098 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:10:32.061756  1120 raft_consensus.cc:2764] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:32.114981 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.124810  1125 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.143837 30482 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:32.144151   913 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.131186  1102 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.115352 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.145936 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.146245   913 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:31.956198   999 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.125545 30481 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:32.061751  1101 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.129997   862 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.131520  1134 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.133391  1127 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.136076  1118 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:31.949532  1124 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:32.063527  1111 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.136509 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 442) took 1338 ms. Trace:
I20260709 13:10:32.183240 30554 rpcz_store.cc:276] 0709 13:10:30.797705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.797850 (+   145us) service_pool.cc:224] Handling call
0709 13:10:30.798162 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.798355 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.798381 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.275445 (+477064us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.551444 (+275999us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:31.551481 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.551551 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.017914 (+466363us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:32.136222 (+118308us) raft_consensus.cc:1685] finished
0709 13:10:32.136241 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.136449 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9878272,"thread_start_us":224703,"threads_started":1,"wal-append.queue_time_us":326167}
I20260709 13:10:32.092658 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.137104 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 261) took 1494 ms. Trace:
I20260709 13:10:32.090775 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.093016  1123 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.114516  1027 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.139030 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:32.146519 30485 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:31.964246   800 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:10:32.147326 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.195772 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.196048 30477 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:32.197055 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.198021 30477 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:32.144780 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.149252  1120 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:32.174825   988 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.156258 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 437261us
I20260709 13:10:32.159158 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.164548 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:32.168684 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 251796us
I20260709 13:10:32.135352  1115 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.179644 30486 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:32.175048 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.188298 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.213866 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.185539 30479 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:32.215375 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.142850  1000 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:32.185933 31149 rpcz_store.cc:276] 0709 13:10:30.642843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.642997 (+   154us) service_pool.cc:224] Handling call
0709 13:10:30.651597 (+  8600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.652012 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.652046 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.652462 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.722040 (+ 69578us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:30.722098 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.722189 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.026007 (+1303818us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:32.136846 (+110839us) raft_consensus.cc:1685] finished
0709 13:10:32.136868 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.137049 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5696,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4154,"spinlock_wait_cycles":7031552,"thread_start_us":69167,"threads_started":1,"wal-append.queue_time_us":670969}
I20260709 13:10:32.201959 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:32.153083  1099 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:10:32.203956 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.205696 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.206875 30407 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:32.207679 30376 leader_election.cc:400] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:32.190012  1064 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.218921 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.263932 30480 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:32.264997 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 54960.6us
W20260709 13:10:32.265400 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 58313.4us
I20260709 13:10:32.265671 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.266209 30483 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:32.217249 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78298.4us
I20260709 13:10:32.261970 30477 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:10:32.268851 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:32.218264 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.270385 30479 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:32.263592 30482 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:32.272387 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.274107 30479 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.276675 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.276791 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.261291 30376 leader_election.cc:403] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.295845 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.297155 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:32.298734 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 91209.6us
I20260709 13:10:32.300443 30485 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:32.306509 30407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53700
I20260709 13:10:32.301646 30477 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:32.310953 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.313316 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.313493 30483 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:32.313992 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 138985us
I20260709 13:10:32.314615 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.315083 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.315919 30483 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:32.262414  1127 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:32.323277 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 54547.8us
I20260709 13:10:32.324220 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:32.202734  1027 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.319607 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.319929 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.319622 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.322386 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.334344 30477 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:32.334565 30483 raft_consensus.cc:2376] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9. Re-sending same reply.
I20260709 13:10:32.321745 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.335247 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.217080  1118 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:10:32.331723 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.335400 30553 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:32.213514   988 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.313935 30558 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:32.342825 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.343364 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.334731 30557 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:32.344897 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.347608 30557 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:32.348205 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 82551.5us
I20260709 13:10:32.339205 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.351254 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:32.326752 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:32.351643 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:32.343521 30553 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:32.349088 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.352065 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.309643   917 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:32.349715 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:32.339742 30479 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:32.354564 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.357822 30409 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:32.358564 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.359189 30408 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:32.359417 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.360006 30409 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:32.360054 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.355165 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:32.356009 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.355141 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.295440  1132 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
W20260709 13:10:32.355733 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 165398us
I20260709 13:10:32.175418  1108 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.356324 30478 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:32.368309 30411 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:32.361470 30405 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 6: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:32.361533 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:32.362584 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:32.341938 30560 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:32.370304 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.276619   800 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:10:32.367163 30483 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:32.364562 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.370920 30405 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:32.371308 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.320200   875 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.336985  1133 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.276160  1089 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:10:32.191314  1124 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.372057 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.274070  1064 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.332348  1063 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:10:32.376336 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:32.773520 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.773311   875 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.457935   999 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.453562  1134 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.410724 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:32.681300 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 354646us
I20260709 13:10:30.602210 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.536000  1107 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.775405 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.876575 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.877919 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.427927 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:32.441983  1144 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:32.405723  1091 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:32.560715  1105 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:32.776372  1064 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.418247 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.382540 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:32.556694 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.898098 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:32.372581   925 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:32.447681   968 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.861172   862 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:32.778577   816 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.779177  1084 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:32.776675 30309 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:32.771366   973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.006s
I20260709 13:10:32.923789 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:32.925566 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:32.398290  1114 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:32.771170 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 409662us
I20260709 13:10:32.765942 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:32.779594 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:32.540567 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 214002us
I20260709 13:10:32.338872  1125 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:32.373682  1000 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:32.862183 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1852) took 1539 ms. Trace:
I20260709 13:10:32.895062  1134 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.374159  1136 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.868734 30410 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:32.456645   890 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.002s
I20260709 13:10:32.374353  1120 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:32.772413   959 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.881448 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:32.920425   973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.011s	sys 0.007s
I20260709 13:10:32.765271  1149 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.962718  1000 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.369814  1129 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:32.963410  1136 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:32.451295  1123 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.404776  1127 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.550594   815 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.423720  1113 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:32.898869 30479 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:32.995782  1027 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:32.894469  1105 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:32.922490   816 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.896687   917 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:32.880769   800 consensus_queue.cc:1243] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:32.904101 30484 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:32.445890   828 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.442148  1102 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:32.808624 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:33.051708 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 243186us
I20260709 13:10:33.052589  1102 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.894330  1091 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.053247  1091 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.951789 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:33.055420  1158 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:10:33.053259 30555 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:32.898451   999 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.056974   999 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.057111 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.057526   999 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.952613 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:33.059813 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.061239 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:33.062254 30480 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:32.972090 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.063030 30554 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.064246  1091 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.066320  1091 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:32.978914 31149 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:10:32.882747 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 506435us
I20260709 13:10:32.900513   925 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:33.067703   925 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.067934  1162 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:33.068553  1162 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:33.068923  1162 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:33.069823  1091 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:33.071137 30485 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:33.071785 30481 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:33.072274   917 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.074272   917 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:32.902608   968 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.074489  1102 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:32.911931  1084 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:32.894277 30482 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:32.922246   862 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:32.898140 30411 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:33.008015  1171 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.008672   988 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:32.901872 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.890623 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.017274  1000 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.080543 31116 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:32.972796  1114 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.097117 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.020244  1136 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.972070  1122 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:10:33.050658   828 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:33.054911  1150 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:10:33.056214 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:32.951472 30402 rpcz_store.cc:276] 0709 13:10:31.323142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.593528 (+270386us) service_pool.cc:224] Handling call
0709 13:10:31.593792 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.593967 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:31.594235 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.773814 (+1179579us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800429520. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a
0709 13:10:32.861834 (+ 88020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.861888 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:32.861931 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.861998 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.862125 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87618,"prepare.queue_time_us":4870,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3276,"raft.queue_time_us":93985,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19129,"spinlock_wait_cycles":9063168,"thread_start_us":42105,"threads_started":1,"wal-append.queue_time_us":83557}
I20260709 13:10:33.110802 30483 raft_consensus.cc:2376] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8. Re-sending same reply.
I20260709 13:10:32.950955  1125 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:33.038146 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.112933 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.080570 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.114022 30411 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:33.081230 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.082557 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.081501 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.082202 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.117202 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.117959 30411 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:33.074887   968 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.080868 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.125870 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.077854   875 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:33.041607 30410 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:10:33.098995 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 193326us
I20260709 13:10:33.034178  1127 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.007766  1134 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:33.074674  1111 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.873s	user 0.007s	sys 0.001s
I20260709 13:10:33.107178 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1540) took 2464 ms. Trace:
I20260709 13:10:33.067996 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:33.181454 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.015360  1149 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.083407 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.184053 30480 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:33.121973 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.077361   862 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.074972  1102 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:33.096851 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:33.175606 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 197044us
I20260709 13:10:33.179113 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.180907 30403 rpcz_store.cc:276] 0709 13:10:30.632687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.891195 (+258508us) service_pool.cc:224] Handling call
0709 13:10:32.766130 (+1874935us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:32.766399 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.813127 (+ 46728us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:32.813172 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.813735 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.902387 (+ 88652us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:32.902433 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.902510 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.078850 (+176340us) raft_consensus.cc:1685] finished
0709 13:10:33.078868 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.097473 (+ 18605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36650,"raft.queue_time_us":94256,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":13545,"spinlock_wait_cycles":34922240,"thread_start_us":88222,"threads_started":1,"wal-append.queue_time_us":216090}
I20260709 13:10:33.198352 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.182865 30404 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:33.181905 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.186936 30410 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:33.020422  1129 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.185676 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.212491 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.187949 30406 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:33.190223 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.217000 30411 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:33.037523  1113 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.207451 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.217628 30406 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:10:33.217975 30402 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:33.124248   973 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:33.120697  1125 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.078199  1171 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.229718 30554 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:10:33.177050   988 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:33.074916   925 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.194993 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.075562  1084 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.227047  1113 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:33.228683   815 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.230821 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:33.224340 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46418.3us
I20260709 13:10:33.231098 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:33.180593  1127 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.246425 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.248342 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.251580 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.252302 30479 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:33.259066  1154 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.259832  1154 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.262684  1154 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.067720  1105 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:33.245620  1165 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
W20260709 13:10:33.281912 30558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.000s	sys 0.023s
I20260709 13:10:33.232661 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.273790 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:33.231287  1118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.014s
W20260709 13:10:33.287731 30558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.000s	sys 0.024s
I20260709 13:10:33.287249 30554 raft_consensus.cc:2376] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8. Re-sending same reply.
I20260709 13:10:33.288095 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:33.188452  1111 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.289939 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.293087 30554 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:33.245196   815 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:33.298894   815 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.298990  1132 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:33.299896  1132 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:33.300437 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:33.289546  1118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.005s	sys 0.015s
I20260709 13:10:33.301745  1122 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.302124  1122 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.302454  1122 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.305224  1181 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.311050 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.312463  1111 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.312664 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:33.314469  1181 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:33.317822  1169 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:10:33.318897  1181 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:33.320959 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:33.311317  1122 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.322043 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.251399   924 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.323118 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.323487   924 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.324019  1094 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:33.324288 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.325433 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.250763  1171 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.325600 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:33.326180 30479 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:33.323096 30554 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.332489 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.267534  1107 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.347903 30479 raft_consensus.cc:2410] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:33.325543   924 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.286921  1084 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:33.383067 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 170673us
I20260709 13:10:33.334576  1171 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.347065  1094 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:33.392254 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.385056 30374 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:33.401083 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 333135us
I20260709 13:10:33.443686 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1555) took 1115 ms. Trace:
I20260709 13:10:33.366263  1105 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.463146 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.463901 31147 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:33.464731 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.409673  1094 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.466125 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.466405  1094 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:33.467958 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.469413  1149 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.467059 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.471001 31152 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:33.447235  1171 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:33.463423  1178 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:33.476130 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.450640 30559 rpcz_store.cc:276] 0709 13:10:32.328121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.328255 (+   134us) service_pool.cc:224] Handling call
0709 13:10:32.358421 (+ 30166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.364343 (+  5922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.364387 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.364908 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.749002 (+384094us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:32.749059 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.749143 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.443405 (+694262us) raft_consensus.cc:1685] finished
0709 13:10:33.443439 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.443608 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6057,"raft.queue_time_us":5647,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":34820,"thread_start_us":323433,"threads_started":1,"wal-append.queue_time_us":486124}
I20260709 13:10:33.483991  1124 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.486188 30479 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:33.285374  1102 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.503364  1102 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.503603 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1558) took 1174 ms. Trace:
I20260709 13:10:33.503863 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1553) took 1176 ms. Trace:
I20260709 13:10:33.504310 30552 rpcz_store.cc:276] 0709 13:10:32.327433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.329761 (+  2328us) service_pool.cc:224] Handling call
0709 13:10:32.330134 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.330396 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:32.750650 (+420254us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.503551 (+752901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.503600 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.503643 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.503710 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.503810 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270801,"prepare.queue_time_us":474239,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4265,"thread_start_us":881848,"threads_started":2,"wal-append.queue_time_us":596738}
I20260709 13:10:33.505904 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:33.506912  1181 consensus_queue.cc:1175] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0472fa7187444a91b443058ef89fceb9" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:33.446480  1122 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.504065 30558 rpcz_store.cc:276] 0709 13:10:32.329016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.350863 (+ 21847us) service_pool.cc:224] Handling call
0709 13:10:32.351267 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.351486 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:32.623146 (+271660us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.503220 (+880074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.503279 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:33.503335 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.503410 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.503542 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214422,"prepare.queue_time_us":507678,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":216480,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":906505,"threads_started":2,"wal-append.queue_time_us":851209}
I20260709 13:10:33.510073 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.514194 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1550) took 1192 ms. Trace:
I20260709 13:10:33.514618 30551 rpcz_store.cc:276] 0709 13:10:32.321715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.322110 (+   395us) service_pool.cc:224] Handling call
0709 13:10:32.340842 (+ 18732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.895547 (+554705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.895576 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.895629 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:32.895664 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.513944 (+618280us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400339ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:33.514000 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.514122 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275195776}
I20260709 13:10:33.516016 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:33.516214   959 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.002s
I20260709 13:10:33.517033 30402 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:33.517413  1134 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.518590 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1552) took 1191 ms. Trace:
I20260709 13:10:33.519013 30555 rpcz_store.cc:276] 0709 13:10:32.327039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.330674 (+  3635us) service_pool.cc:224] Handling call
0709 13:10:32.331023 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.056841 (+725818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.518347 (+461506us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54003f3254. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:33.518528 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660617600}
I20260709 13:10:33.519573 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1554) took 1191 ms. Trace:
I20260709 13:10:33.519733 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.486152 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:33.520176   815 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.522189  1114 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.523358  1129 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.524078  1115 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.525321 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.525949 30405 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:33.526216 30480 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:33.527454   925 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.534584 30407 raft_consensus.cc:606] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:10:33.535048 30407 raft_consensus.cc:614] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:33.452389 30554 raft_consensus.cc:2410] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:33.535701   981 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.536135 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.536213   981 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.492208 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.537413 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:33.538153 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46050.6us
I20260709 13:10:33.538924 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.539793   999 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.540248 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.541253  1153 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.541600   815 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.541733  1153 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.542181  1153 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.542507 30486 raft_consensus.cc:2368] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:33.542816  1131 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:33.543218  1131 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:33.544943 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1920) took 1074 ms. Trace:
I20260709 13:10:33.546754 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1790) took 1457 ms. Trace:
I20260709 13:10:33.546887  1129 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.547345  1129 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.547214 30478 rpcz_store.cc:276] 0709 13:10:32.089748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.089942 (+   194us) service_pool.cc:224] Handling call
0709 13:10:32.090286 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.368576 (+278290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.546461 (+1177885us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54001c6954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:33.546674 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611112832}
I20260709 13:10:33.495689 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.548413  1115 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.548800  1115 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.523355 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1811) took 1373 ms. Trace:
I20260709 13:10:33.549247  1115 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.549458 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1799) took 1454 ms. Trace:
I20260709 13:10:33.497591  1027 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.498237  1157 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.549948 30484 rpcz_store.cc:276] 0709 13:10:32.095056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.095598 (+   542us) service_pool.cc:224] Handling call
0709 13:10:33.549275 (+1453677us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400210cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.549405 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759746816}
I20260709 13:10:33.550608  1157 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.549364 30481 rpcz_store.cc:276] 0709 13:10:32.149718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.348878 (+199160us) service_pool.cc:224] Handling call
0709 13:10:33.523162 (+1174284us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000c9c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.523292 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685828864}
I20260709 13:10:33.545337 30486 rpcz_store.cc:276] 0709 13:10:32.502818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.890320 (+387502us) service_pool.cc:224] Handling call
0709 13:10:33.544670 (+654350us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54000c9754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.544860 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059097984}
I20260709 13:10:33.552558 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1810) took 1403 ms. Trace:
I20260709 13:10:33.552819  1157 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.502288 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.553256  1136 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.554404 30560 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:10:33.534859  1130 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:33.555637  1130 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.520005 30556 rpcz_store.cc:276] 0709 13:10:32.327776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.327939 (+   163us) service_pool.cc:224] Handling call
0709 13:10:32.358985 (+ 31046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.359163 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:32.755779 (+396616us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.519054 (+763275us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.519256 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.519306 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.519352 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.519417 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.519521 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619211,"prepare.queue_time_us":500892,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":599934,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"thread_start_us":470189,"threads_started":2,"wal-append.queue_time_us":339235}
I20260709 13:10:33.556078  1130 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.557137 30556 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:33.502519 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 307) took 1347 ms. Trace:
I20260709 13:10:33.486912 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1563) took 1141 ms. Trace:
I20260709 13:10:33.552939 30485 rpcz_store.cc:276] 0709 13:10:32.149439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.311981 (+162542us) service_pool.cc:224] Handling call
0709 13:10:33.552386 (+1240405us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400390154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.552497 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694585088}
I20260709 13:10:33.520177 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.557621 30482 rpcz_store.cc:276] 0709 13:10:32.154880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.276663 (+121783us) service_pool.cc:224] Handling call
0709 13:10:33.502351 (+1225688us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003449d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.502451 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363141376}
I20260709 13:10:33.493592 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:33.547921  1129 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.554939 30558 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:33.549355 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:33.561823 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.530493 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:33.573760 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.574002 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.575100 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:33.453537 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 68639us
W20260709 13:10:33.566047 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 81006us
I20260709 13:10:33.575979 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.576273 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:33.577132 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.578984 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.584430 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:33.538378 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:33.584813 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.558139 30557 rpcz_store.cc:276] 0709 13:10:32.345675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.353881 (+  8206us) service_pool.cc:224] Handling call
0709 13:10:32.354238 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.354486 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:32.755779 (+401293us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.486373 (+730594us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b180040d320. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:33.486537 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.486587 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.486639 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.486730 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.486850 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59058,"prepare.queue_time_us":504950,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":617123,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":30172544,"thread_start_us":491773,"threads_started":2,"wal-append.queue_time_us":147487}
I20260709 13:10:33.588447 30557 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:33.589126 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:33.590639 30479 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:33.590906  1003 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:33.591312  1003 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:33.592423 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:33.592198  1003 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.593223   956 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.593828   956 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.594312   956 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.595067  1181 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.595508  1181 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:33.595930  1181 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.599466 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.601933 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.602953 30553 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:33.603436 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.591308 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1812) took 1441 ms. Trace:
I20260709 13:10:33.604139 30409 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:33.604233 30479 rpcz_store.cc:276] 0709 13:10:32.149961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.590140 (+1440179us) service_pool.cc:224] Handling call
0709 13:10:33.590410 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.591065 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.591253 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.607885 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.615855 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 299) took 1463 ms. Trace:
I20260709 13:10:33.620954 30480 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:33.621690 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 305) took 1467 ms. Trace:
I20260709 13:10:33.608304 30405 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:33.593278  1003 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.605423 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.624275 30402 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.600744 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:33.608105 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 298) took 1455 ms. Trace:
I20260709 13:10:33.626854 30479 rpcz_store.cc:276] 0709 13:10:32.152618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.607328 (+1454710us) service_pool.cc:224] Handling call
0709 13:10:33.607612 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.607771 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.607794 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.607834 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:33.607865 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.607919 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.608044 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.628813 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 309) took 1457 ms. Trace:
I20260709 13:10:33.628894   410 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.629254 30479 rpcz_store.cc:276] 0709 13:10:32.171352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.627959 (+1456607us) service_pool.cc:224] Handling call
0709 13:10:33.628305 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.628480 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.628506 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.628556 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:33.628593 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.628661 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.628757 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.630221 31148 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:33.631438 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1894) took 1438 ms. Trace:
I20260709 13:10:33.631858 30478 rpcz_store.cc:276] 0709 13:10:32.193017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.630606 (+1437589us) service_pool.cc:224] Handling call
0709 13:10:33.630897 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.631092 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.631123 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.631170 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:33.631213 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.631277 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.631387 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.632586 30409 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.609457 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53700 (request call id 77) took 1303 ms. Trace:
I20260709 13:10:33.616339 30485 rpcz_store.cc:276] 0709 13:10:32.152900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.614956 (+1462056us) service_pool.cc:224] Handling call
0709 13:10:33.615312 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.615518 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.615553 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.615604 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:33.615647 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.615712 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.615805 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.622049 30480 rpcz_store.cc:276] 0709 13:10:32.154358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.620258 (+1465900us) service_pool.cc:224] Handling call
0709 13:10:33.620580 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.621402 (+   822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.621630 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.636503 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 310) took 1462 ms. Trace:
I20260709 13:10:33.636673 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.636690 30480 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:33.637389 30405 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:33.637773 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1900) took 1419 ms. Trace:
I20260709 13:10:33.636906 30479 rpcz_store.cc:276] 0709 13:10:32.173660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.630211 (+1456551us) service_pool.cc:224] Handling call
0709 13:10:33.635973 (+  5762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.636142 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.636171 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.636216 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.636266 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.636337 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.636442 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.638243 30480 rpcz_store.cc:276] 0709 13:10:32.218433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.636156 (+1417723us) service_pool.cc:224] Handling call
0709 13:10:33.636460 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.637474 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.637690 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.642858 30479 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:33.633575 30407 rpcz_store.cc:276] 0709 13:10:32.306200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.306353 (+   153us) service_pool.cc:224] Handling call
0709 13:10:33.609221 (+1302868us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002a5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a3853 00007fa04a07160a 00007fa0435f77d4 00007fa0435f7762 00007fa0435f7691 00007fa0435f760c 00007fa0435f68c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.609350 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822682496}
I20260709 13:10:33.643857 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1901) took 1425 ms. Trace:
I20260709 13:10:33.644578 30479 rpcz_store.cc:276] 0709 13:10:32.218716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.639647 (+1420931us) service_pool.cc:224] Handling call
0709 13:10:33.640127 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.643433 (+  3306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.643786 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72576}
I20260709 13:10:33.645731 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.638350 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.646620 30407 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:33.647580 30480 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:33.651356 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:33.675571   816 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.584029   815 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:33.585597   828 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.657502   862 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:33.693277   875 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:33.633852   925 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.542203   999 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.661669  1094 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:33.804616 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 153797us
I20260709 13:10:33.646132  1105 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:33.550371  1027 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.634264  1113 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:33.713049  1136 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.586648  1114 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.633029  1118 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:33.646293  1125 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.701319  1130 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.582962   890 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:33.791639   800 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:10:33.698472  1153 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:33.583096  1157 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:33.785310 31117 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:33.761101 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.694939  1171 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.698469  1181 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:33.764729 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 187511us
W20260709 13:10:33.768208 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.785372 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.759930 30405 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.780608 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1904) took 1519 ms. Trace:
I20260709 13:10:33.796756   828 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:33.797596  1000 consensus_meta.cc:287] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.006s
I20260709 13:10:33.801462   981 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.797276   862 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:33.798877   875 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:33.717406  1162 consensus_meta.cc:287] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 13:10:33.793118   976 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.799116   959 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.795285   410 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:33.924961  1111 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:33.767307 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.925091  1108 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:33.927390 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 123897us
I20260709 13:10:33.928099 30554 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:33.941715   968 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.004s
I20260709 13:10:33.953622 30402 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
W20260709 13:10:33.930648  1199 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:33.929934 30409 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:33.925665   898 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.942994  1027 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.924980  1105 consensus_queue.cc:1243] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:10:33.970320 30376 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.573s (SENT)
I20260709 13:10:33.970531 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:33.970993   976 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.972287  1181 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:33.973349 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:33.943070  1094 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.984181  1113 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:33.973767 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 188912us
I20260709 13:10:33.986495 30402 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.986785  1113 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:33.981323 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 418779us
I20260709 13:10:33.988787   959 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.989351  1153 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:33.963263   862 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:33.991736  1111 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.992861  1125 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:33.994148 30483 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:33.975275   898 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.995216   898 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.995851 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1821) took 1110 ms. Trace:
I20260709 13:10:33.996243 30483 rpcz_store.cc:276] 0709 13:10:32.885333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.128478 (+243145us) service_pool.cc:224] Handling call
0709 13:10:33.995511 (+867033us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54002bd9d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:33.995726 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819982080}
I20260709 13:10:33.999219 30555 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:33.998849   410 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.000238  1162 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.930872  1180 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.960992   828 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.003016  1180 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.003643   875 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.004878 30408 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:33.982510   976 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:33.932085  1190 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:33.986968 30479 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:33.999352 30485 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:33.947851 30480 rpcz_store.cc:276] 0709 13:10:32.260634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.639665 (+1379031us) service_pool.cc:224] Handling call
0709 13:10:33.647351 (+  7686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.779893 (+132542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.780317 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.985266 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:33.953583  1000 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.017382 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1899) took 1804 ms. Trace:
I20260709 13:10:34.013134 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:33.977006   968 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.066591  1179 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.044586   956 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.070490   976 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.066313   968 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:34.008385  1111 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.074999 30402 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:34.082739 30407 raft_consensus.cc:2410] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:34.053478 30485 rpcz_store.cc:276] 0709 13:10:32.213764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.634301 (+1420537us) service_pool.cc:224] Handling call
0709 13:10:33.999027 (+364726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.016048 (+ 17021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.017120 (+  1072us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54002bd9d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:34.017298 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818195712}
I20260709 13:10:34.054894 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1906) took 1759 ms. Trace:
I20260709 13:10:34.083621 30483 rpcz_store.cc:276] 0709 13:10:32.263350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.997350 (+1734000us) service_pool.cc:224] Handling call
0709 13:10:33.997988 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.998349 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.998376 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.998431 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:33.998498 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.998566 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.998684 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.016310  1120 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:34.047583 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 448025us
I20260709 13:10:34.014300 30374 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:34.010267   410 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.100755 31153 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:34.007613  1063 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.115773  1063 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:34.116237  1063 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.991748   959 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.118523   410 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:34.119350   410 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:34.120838   410 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.124172 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1910) took 1847 ms. Trace:
I20260709 13:10:34.107811   981 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.108057 30478 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.127372 30485 rpcz_store.cc:276] 0709 13:10:32.277212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.093340 (+1816128us) service_pool.cc:224] Handling call
0709 13:10:34.123478 (+ 30138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.123809 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.123837 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.123893 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.123937 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.123991 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.124105 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.113067  1162 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.114804 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1769) took 1196 ms. Trace:
I20260709 13:10:34.011363  1190 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.124343 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1905) took 1861 ms. Trace:
I20260709 13:10:34.125523 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 302) took 1971 ms. Trace:
W20260709 13:10:34.105650 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 132539us
I20260709 13:10:34.128999 30405 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
W20260709 13:10:34.099876  1175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.027s	sys 0.041s
I20260709 13:10:34.129594   898 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.132329 30479 rpcz_store.cc:276] 0709 13:10:32.263025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.646181 (+1383156us) service_pool.cc:224] Handling call
0709 13:10:33.646569 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.012250 (+365681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.124062 (+111812us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003449d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:34.124291 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754138368}
I20260709 13:10:34.139959 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1914) took 1789 ms. Trace:
I20260709 13:10:34.140466 30479 rpcz_store.cc:276] 0709 13:10:32.350450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.138376 (+1787926us) service_pool.cc:224] Handling call
0709 13:10:34.138893 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.139337 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.139367 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.139586 (+   219us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:34.139644 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.139722 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.139862 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.144867 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 183449us
I20260709 13:10:34.146282  1180 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:34.147704  1102 consensus_meta.cc:287] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.011s
I20260709 13:10:34.151304 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.151619 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:34.152963  1120 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.149415 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:34.154836 31148 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.006644  1131 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.156164  1000 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.196771 31148 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:34.446115 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 300) took 2292 ms. Trace:
I20260709 13:10:34.300793  1180 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.198335   956 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.129968 30560 rpcz_store.cc:276] 0709 13:10:32.917754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.555546 (+637792us) service_pool.cc:224] Handling call
0709 13:10:33.555824 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.556163 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.556194 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.556608 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.066053 (+509445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.066156 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.066268 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.114347 (+ 48079us) raft_consensus.cc:1685] finished
0709 13:10:34.114383 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.114571 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":363752,"threads_started":1,"wal-append.queue_time_us":553434}
I20260709 13:10:34.446869 30481 rpcz_store.cc:276] 0709 13:10:32.153163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.617822 (+1464659us) service_pool.cc:224] Handling call
0709 13:10:33.618142 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.799046 (+180904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.799113 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.799179 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.799231 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.445624 (+646393us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000c0154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:34.445676 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.445924 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414261504}
I20260709 13:10:34.239725 30408 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.200374 30405 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:34.174727 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 184831us
I20260709 13:10:34.199532 30485 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.132427 30482 rpcz_store.cc:276] 0709 13:10:32.153643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.619005 (+1465362us) service_pool.cc:224] Handling call
0709 13:10:33.619336 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.800815 (+181479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.800893 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.802074 (+  1181us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.960931 (+158857us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.960995 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.124988 (+163993us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001be9d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:34.125037 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.125105 (+    68us) raft_consensus.cc:1685] finished
0709 13:10:34.125120 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.125342 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1813,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":292,"spinlock_wait_cycles":414930816,"thread_start_us":158320,"threads_started":1,"wal-append.queue_time_us":305655}
I20260709 13:10:34.338267 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:34.449777  1180 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.242777 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:34.237180 30484 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:34.454070 30405 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:34.474226 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1882) took 1163 ms. Trace:
W20260709 13:10:34.165622  1115 consensus_meta.cc:287] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.006s
I20260709 13:10:34.174366 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.471598 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:34.476374 30408 rpcz_store.cc:276] 0709 13:10:33.308379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.238904 (+930525us) service_pool.cc:224] Handling call
0709 13:10:34.239450 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.469554 (+230104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.469815 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.474265 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1911) took 2196 ms. Trace:
I20260709 13:10:34.479485 30485 rpcz_store.cc:276] 0709 13:10:32.277466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.132126 (+1854660us) service_pool.cc:224] Handling call
0709 13:10:34.199166 (+ 67040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.473448 (+274282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.474189 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.182376  1127 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.899s	user 0.010s	sys 0.003s
W20260709 13:10:34.157436  1175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.028s	sys 0.041s
W20260709 13:10:34.197971  1129 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.004s
I20260709 13:10:34.482966 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1885) took 1168 ms. Trace:
I20260709 13:10:34.491365 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1578) took 1236 ms. Trace:
I20260709 13:10:34.476789 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1931) took 1588 ms. Trace:
I20260709 13:10:34.479312 30403 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:34.486680 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 472598us
I20260709 13:10:34.155570  1120 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.157079  1190 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.198372   862 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.245148   898 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.494460 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1575) took 1240 ms. Trace:
I20260709 13:10:34.492780 30409 rpcz_store.cc:276] 0709 13:10:33.314741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.337788 (+1023047us) service_pool.cc:224] Handling call
0709 13:10:34.482902 (+145114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.493573 30411 rpcz_store.cc:276] 0709 13:10:33.255380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.242187 (+986807us) service_pool.cc:224] Handling call
0709 13:10:34.491301 (+249114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.452195  1208 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:34.494079 30484 rpcz_store.cc:276] 0709 13:10:32.888838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.236105 (+1347267us) service_pool.cc:224] Handling call
0709 13:10:34.236646 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.476520 (+239874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.476733 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.393973 30309 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.495347  1127 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:34.514937 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 355399us
I20260709 13:10:34.504559 30403 rpcz_store.cc:276] 0709 13:10:33.254285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.095364 (+841079us) service_pool.cc:224] Handling call
0709 13:10:34.494404 (+399040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.507900 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.485975   981 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:34.526391 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:34.527141 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 84398.8us
W20260709 13:10:34.534668 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 929371us
I20260709 13:10:34.536266 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:34.502220  1129 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.537876 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.540654 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:34.542037 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1895) took 2335 ms. Trace:
I20260709 13:10:34.517244  1208 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:34.528784  1218 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:34.542461 30478 rpcz_store.cc:276] 0709 13:10:32.206333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.633004 (+1426671us) service_pool.cc:224] Handling call
0709 13:10:33.633278 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.131601 (+498323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.541753 (+410152us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54000334d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:34.541976 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060210048}
W20260709 13:10:34.562975 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55232us
I20260709 13:10:34.563076  1216 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:34.564507 30410 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:34.565385 30411 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:34.537818  1206 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.593s	user 0.004s	sys 0.000s
I20260709 13:10:34.533370 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.568344  1118 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:34.568976 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.490387  1115 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.573503 30405 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:34.580040 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.574849  1127 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.575845 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:34.573511  1135 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.578791 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1771) took 1660 ms. Trace:
I20260709 13:10:34.582163 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1581) took 1316 ms. Trace:
I20260709 13:10:34.503264   828 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.584543 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1883) took 1270 ms. Trace:
I20260709 13:10:34.584230 30410 rpcz_store.cc:276] 0709 13:10:33.256264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.563621 (+1307357us) service_pool.cc:224] Handling call
0709 13:10:34.564098 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.572976 (+  8878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.573110 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.547621   862 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:34.586086 30411 rpcz_store.cc:276] 0709 13:10:33.313694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.521189 (+1207495us) service_pool.cc:224] Handling call
0709 13:10:34.565151 (+ 43962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.578967 (+ 13816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.579144 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.544057   898 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.585309 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1579) took 1269 ms. Trace:
I20260709 13:10:34.608832 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:34.609098  1180 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.609596 31148 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.610042 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:34.610889  1219 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.612277 30477 raft_consensus.cc:2368] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:34.613052 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:34.615715   828 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.617244 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.619597 30555 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:34.566076  1208 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.597931 30560 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:34.629752 30376 leader_election.cc:336] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.631s (SENT)
I20260709 13:10:34.633442 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.633709 30559 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.570053  1216 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:34.634660 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1589) took 1068 ms. Trace:
I20260709 13:10:34.581387  1105 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.622843 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 464) took 1291 ms. Trace:
I20260709 13:10:34.624097 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 463) took 1292 ms. Trace:
I20260709 13:10:34.636696 30402 rpcz_store.cc:276] 0709 13:10:33.553940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.579590 (+1025650us) service_pool.cc:224] Handling call
0709 13:10:34.621919 (+ 42329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.639329 30409 rpcz_store.cc:276] 0709 13:10:33.331563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.523279 (+1191716us) service_pool.cc:224] Handling call
0709 13:10:34.580862 (+ 57583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.588305 (+  7443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.588319 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.623757 (+ 35438us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.623811 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.623897 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.624031 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.639221 30403 rpcz_store.cc:276] 0709 13:10:33.331861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.525086 (+1193225us) service_pool.cc:224] Handling call
0709 13:10:34.571777 (+ 46691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.588197 (+ 16420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.588214 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.622488 (+ 34274us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.622540 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.622618 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.622774 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.638072 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.618852 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.583498 30552 rpcz_store.cc:276] 0709 13:10:32.918329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.561512 (+643183us) service_pool.cc:224] Handling call
0709 13:10:33.561866 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.583678 (+ 21812us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:33.653565 (+ 69887us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.107859 (+454294us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.108785 (+   926us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.109083 (+   298us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.109427 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.109650 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.109783 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.333410 (+223627us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b1800447640. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:34.339622 (+  6212us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800447640. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:34.578444 (+238822us) raft_consensus.cc:1685] finished
0709 13:10:34.578468 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.578608 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21416,"prepare.queue_time_us":292341,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":76,"raft.queue_time_us":41117,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":58094,"spinlock_wait_cycles":129408768,"thread_start_us":312723,"threads_started":1,"wal-append.queue_time_us":353250}
I20260709 13:10:34.644570 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:34.645709 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 126312us
I20260709 13:10:34.643026 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.571403   981 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.641732  1105 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.603755  1131 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.638432  1216 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.642982   828 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:34.611686  1219 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.642073  1118 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.660745 30374 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:34.663947 30405 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.661482  1000 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:34.655650  1105 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.648483  1135 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.668851  1179 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.669695 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:34.671162 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 102354us
I20260709 13:10:34.673501 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 469) took 1295 ms. Trace:
I20260709 13:10:34.661823  1180 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.675907 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.675542 30409 rpcz_store.cc:276] 0709 13:10:33.373386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.643823 (+1270437us) service_pool.cc:224] Handling call
0709 13:10:34.665174 (+ 21351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.665324 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.665338 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.668185 (+  2847us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.668227 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.668288 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.668401 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.678637 31150 raft_consensus.cc:2368] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9.
W20260709 13:10:34.673305  1113 consensus_meta.cc:287] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
W20260709 13:10:34.683931 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 108368us
I20260709 13:10:34.674732  1000 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:34.690287 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.679147  1180 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:34.696091 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 110162us
I20260709 13:10:34.687835  1127 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:34.699169 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 470) took 1321 ms. Trace:
I20260709 13:10:34.699630 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.703219 30403 rpcz_store.cc:276] 0709 13:10:33.373669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.643222 (+1269553us) service_pool.cc:224] Handling call
0709 13:10:34.663639 (+ 20417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.694791 (+ 31152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.694841 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.694902 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.694958 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.695029 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.695129 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.693933  1179 raft_consensus.cc:2764] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:10:34.705066 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.698757  1180 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.687320  1113 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.725050  1006 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:34.727699 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 468) took 1376 ms. Trace:
I20260709 13:10:34.728142 30402 rpcz_store.cc:276] 0709 13:10:33.351114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.643116 (+1292002us) service_pool.cc:224] Handling call
0709 13:10:34.684338 (+ 41222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.727322 (+ 42984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.727361 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.727409 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.727446 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.727516 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.727645 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.733584 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 75765.6us
I20260709 13:10:34.706831  1115 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:34.711994  1127 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:34.711405   956 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:34.742025 30405 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:34.744518 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.748009 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 471) took 1374 ms. Trace:
I20260709 13:10:34.748514 30409 rpcz_store.cc:276] 0709 13:10:33.378051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.680648 (+1302597us) service_pool.cc:224] Handling call
0709 13:10:34.702782 (+ 22134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.741810 (+ 39028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.741850 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.747671 (+  5821us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.747726 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.747804 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.747939 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:34.738054 30376 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.643s (SENT)
I20260709 13:10:34.751092 31151 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:34.751452   981 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:34.750957 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.750144 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.745652 30405 pending_rounds.cc:85] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 4
I20260709 13:10:34.732832  1118 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:34.760842 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70950.5us
I20260709 13:10:34.754923 30405 pending_rounds.cc:107] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:34.761965 30405 raft_consensus.cc:2889] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.775255 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1582) took 1518 ms. Trace:
I20260709 13:10:34.776059 30405 rpcz_store.cc:276] 0709 13:10:33.256547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.174202 (+917655us) service_pool.cc:224] Handling call
0709 13:10:34.200138 (+ 25936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.774946 (+574808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.775188 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.786394 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.789212 31152 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:34.789387 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.794840 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 474) took 1048 ms. Trace:
I20260709 13:10:34.768422   981 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:34.778751  1219 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.795534 30405 rpcz_store.cc:276] 0709 13:10:33.746711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.777112 (+1030401us) service_pool.cc:224] Handling call
0709 13:10:34.777480 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.785935 (+  8455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.785975 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.792091 (+  6116us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.792198 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.794640 (+  2442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.794780 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.796558 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.782822  1135 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:34.794766  1226 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:34.793313  1179 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:34.799888 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 473) took 1242 ms. Trace:
I20260709 13:10:34.803905 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1917) took 2374 ms. Trace:
I20260709 13:10:34.805672 30409 rpcz_store.cc:276] 0709 13:10:33.557455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.749659 (+1192204us) service_pool.cc:224] Handling call
0709 13:10:34.783729 (+ 34070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.796009 (+ 12280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.796039 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.799486 (+  3447us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.799521 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.799577 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.799839 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.806371 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:34.807935 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.808367 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.804657  1063 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.004s
I20260709 13:10:34.811654   981 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.814251   981 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:34.779117  1000 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.805721 30479 rpcz_store.cc:276] 0709 13:10:32.429918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.141573 (+1711655us) service_pool.cc:224] Handling call
0709 13:10:34.142057 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.142598 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.142632 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.256741 (+114109us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.520877 (+264136us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:34.798773 (+277896us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.803634 (+  4861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.803701 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.803737 (+    36us) raft_consensus.cc:1685] finished
0709 13:10:34.803747 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.803855 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1153,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":365063,"threads_started":2,"wal-append.queue_time_us":257903}
I20260709 13:10:34.816841 30480 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:34.819183 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:34.819837 31148 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
W20260709 13:10:34.820605 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 82607.4us
I20260709 13:10:34.822947 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 476) took 1075 ms. Trace:
I20260709 13:10:34.823333 30409 rpcz_store.cc:276] 0709 13:10:33.747779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.807066 (+1059287us) service_pool.cc:224] Handling call
0709 13:10:34.820404 (+ 13338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.822597 (+  2193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.822621 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.822663 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:34.822724 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.822787 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.822897 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.824339 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:34.825557 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1593) took 1053 ms. Trace:
I20260709 13:10:34.826073 30409 rpcz_store.cc:276] 0709 13:10:33.772171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.824066 (+1051895us) service_pool.cc:224] Handling call
0709 13:10:34.824611 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.824922 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.825045 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.825128 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.825189 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.825273 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.825449 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.820873 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.815016  1118 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.829113  1135 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:34.818820   410 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.833451  1219 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:34.840397 30523 leader_election.cc:400] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:34.840767 30523 leader_election.cc:403] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.842819 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:34.844373 30376 leader_election.cc:336] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.669s (SENT)
I20260709 13:10:34.846331 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.851820 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.832765  1118 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:34.853377 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 475) took 1106 ms. Trace:
I20260709 13:10:34.816354  1063 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.831908  1115 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.856045 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:34.855773 30405 rpcz_store.cc:276] 0709 13:10:33.747343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.799577 (+1052234us) service_pool.cc:224] Handling call
0709 13:10:34.821144 (+ 21567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.847503 (+ 26359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.847536 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.853035 (+  5499us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.853101 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.853182 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.853313 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:34.856406 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:34.862211 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55701us
I20260709 13:10:34.856695  1118 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.830116  1127 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:34.858183  1006 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:34.859372  1115 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:34.857924   410 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:34.870863   862 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.884311 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:34.876356  1115 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:34.881444  1223 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.350s	user 0.000s	sys 0.004s
I20260709 13:10:34.888057 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:34.895983 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60252.5us
I20260709 13:10:34.928381 30560 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:34.949188 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1584) took 1612 ms. Trace:
W20260709 13:10:34.948761 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 185303us
I20260709 13:10:34.921593   981 raft_consensus.cc:2764] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:10:34.920617  1006 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.951983 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:34.889264  1190 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:10:34.960582 31146 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:34.960768 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76502.6us
I20260709 13:10:34.949700 30410 rpcz_store.cc:276] 0709 13:10:33.334457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.586617 (+1252160us) service_pool.cc:224] Handling call
0709 13:10:34.654534 (+ 67917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.677412 (+ 22878us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:34.697589 (+ 20177us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.946560 (+248971us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.946812 (+   252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.946876 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.946934 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.947024 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.947175 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13695,"prepare.queue_time_us":13022,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4743,"raft.queue_time_us":8641,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":12527,"thread_start_us":220912,"threads_started":2}
I20260709 13:10:34.988025 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:34.992219  1230 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:10:34.994652  1232 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:10:34.997947 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 1884) took 1683 ms. Trace:
I20260709 13:10:34.998867 30408 rpcz_store.cc:276] 0709 13:10:33.314283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.507379 (+1193096us) service_pool.cc:224] Handling call
0709 13:10:34.508008 (+   629us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:34.508712 (+   704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.508765 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:34.509703 (+   938us) log.cc:844] Serialized 52 byte log entry
0709 13:10:34.795632 (+285929us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.803667 (+  8035us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.803865 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.803933 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.997269 (+193336us) raft_consensus.cc:1685] finished
0709 13:10:34.997318 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.997859 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10384,"prepare.queue_time_us":7838,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":937,"raft.queue_time_us":16151,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9845,"thread_start_us":285388,"threads_started":1,"wal-append.queue_time_us":317930}
W20260709 13:10:35.005513  1233 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:10:35.005818 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 120055us
I20260709 13:10:34.607635 30404 rpcz_store.cc:276] 0709 13:10:33.255689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.342428 (+1086739us) service_pool.cc:224] Handling call
0709 13:10:34.343034 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.343475 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:34.343903 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.524573 (+180670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.524625 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.524672 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.524742 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.524853 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23088,"prepare.queue_time_us":13566,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":12025,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14064,"thread_start_us":171859,"threads_started":1}
I20260709 13:10:35.007050 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 467) took 1663 ms. Trace:
I20260709 13:10:35.007427 30411 rpcz_store.cc:276] 0709 13:10:33.343841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.587732 (+1243891us) service_pool.cc:224] Handling call
0709 13:10:34.618229 (+ 30497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.659952 (+ 41723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.659991 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.672138 (+ 12147us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.861221 (+189083us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.861259 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.861330 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.006818 (+145488us) raft_consensus.cc:1685] finished
0709 13:10:35.006838 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.006992 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45623,"raft.queue_time_us":37034,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":3795,"thread_start_us":168287,"threads_started":1,"wal-append.queue_time_us":224074}
I20260709 13:10:35.011821  1177 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.012459  1177 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.014830 30403 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:35.020414  1222 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.010392  1179 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:35.036900 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 48987.8us
I20260709 13:10:35.042150 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.041378 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.044360  1247 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.044941  1248 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.044967  1247 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.045657  1248 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.046209  1247 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.049208  1129 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:35.049890  1129 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.052546  1063 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.054414 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1571) took 1553 ms. Trace:
I20260709 13:10:35.054944 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.055744  1175 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.056713 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 264) took 1946 ms. Trace:
I20260709 13:10:35.057076 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.058141  1175 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.059008   410 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:35.062887 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1583) took 1732 ms. Trace:
I20260709 13:10:35.063971 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.063417 30406 rpcz_store.cc:276] 0709 13:10:33.304640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.177179 (+872539us) service_pool.cc:224] Handling call
0709 13:10:34.364463 (+187284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.492093 (+127630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.492139 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.521969 (+ 29830us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.804021 (+282052us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.823175 (+ 19154us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.832156 (+  8981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.832233 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.036518 (+204285us) raft_consensus.cc:1685] finished
0709 13:10:35.036540 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.036681 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14865,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":25139,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":17056,"thread_start_us":219357,"threads_started":1,"wal-append.queue_time_us":304083}
I20260709 13:10:35.064828 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
W20260709 13:10:35.067793 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.054780 30559 rpcz_store.cc:276] 0709 13:10:33.501279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.583751 (+ 82472us) service_pool.cc:224] Handling call
0709 13:10:33.648181 (+ 64430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.637951 (+989770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.054167 (+416216us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54000384d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:35.054346 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241446656}
I20260709 13:10:35.051231 30486 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:10:35.057072 31153 rpcz_store.cc:276] 0709 13:10:33.110349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.110467 (+   118us) service_pool.cc:224] Handling call
0709 13:10:33.110771 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.107489 (+996718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.056425 (+948936us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54004461d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:35.056616 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208202112}
I20260709 13:10:35.075430 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.078020 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.074391 30486 pending_rounds.cc:85] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 6
I20260709 13:10:35.079103 30486 pending_rounds.cc:107] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:35.079464 30486 raft_consensus.cc:2889] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.079968 30560 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:35.039464  1000 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.040383  1237 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.084314 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:35.075695  1239 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:10:35.019258  1135 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:10:35.089001 30552 raft_consensus.cc:2368] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9.
W20260709 13:10:35.089138 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 100603us
I20260709 13:10:35.089301 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:35.090046 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51619.4us
I20260709 13:10:35.090435 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:35.092109  1113 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:35.093621 30477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 1918) took 2655 ms (client timeout 1597 ms). Trace:
I20260709 13:10:35.095041 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1592) took 1540 ms. Trace:
I20260709 13:10:35.118845 30402 rpcz_store.cc:276] 0709 13:10:33.554736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.728817 (+1174081us) service_pool.cc:224] Handling call
0709 13:10:34.747295 (+ 18478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.768124 (+ 20829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.768165 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.797424 (+ 29259us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.906468 (+109044us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:35.007338 (+100870us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.007661 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.007738 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.094820 (+ 87082us) raft_consensus.cc:1685] finished
0709 13:10:35.094840 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.094966 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48485,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":15610,"raft.queue_time_us":105,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9097,"thread_start_us":143872,"threads_started":2,"wal-append.queue_time_us":146079}
I20260709 13:10:35.094887  1237 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.097882  1248 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.101497 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.101727 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.124567 30411 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.102340 30410 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:35.102509 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:35.118769 30477 rpcz_store.cc:269] 0709 13:10:32.438016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.773259 (+335243us) service_pool.cc:224] Handling call
0709 13:10:35.093378 (+2320119us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400032ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:35.093523 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4020696832}
I20260709 13:10:35.103778 30406 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:35.105106 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.103821 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.126471 30555 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.107086  1177 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.109597   828 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.109313  1118 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.123597  1222 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.122774 30551 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.122539 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:35.126940 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 175015us
I20260709 13:10:35.120959  1063 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.140765 30408 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
W20260709 13:10:35.141278 30357 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0472fa7187444a91b443058ef89fceb9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:35.141789 30357 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:10:35.142069 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:10:35.142282 30408 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:35.140779  1113 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:35.143672  1113 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.144668  1113 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.146391  1237 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.146564  1118 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:35.149916  1115 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.150331 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.117633  1000 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.132359 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.150739 30404 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:35.152359 30402 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:35.124585 31144 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:35.128813   956 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.131636   828 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.155172  1216 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.155658   956 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.155956   828 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.157038   828 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.157358  1216 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:35.151625  1208 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.008s
I20260709 13:10:35.160538  1000 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.161759  1180 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.163618 30409 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:35.152684 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:35.167683  1224 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.628s	user 0.010s	sys 0.003s
I20260709 13:10:35.167810 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.168414 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 1907) took 2904 ms. Trace:
I20260709 13:10:35.168713  1179 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.169270 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.167825 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1586) took 1692 ms. Trace:
W20260709 13:10:35.114250 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.168867 30480 rpcz_store.cc:276] 0709 13:10:32.263627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.046641 (+1783014us) service_pool.cc:224] Handling call
0709 13:10:34.127006 (+ 80365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.817245 (+690239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.168172 (+350927us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400390154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:35.168327 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586055936}
I20260709 13:10:35.169947 30403 rpcz_store.cc:276] 0709 13:10:33.475821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.704684 (+1228863us) service_pool.cc:224] Handling call
0709 13:10:35.007153 (+302469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.018228 (+ 11075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.167631 (+149403us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540039a8d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:35.167765 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634363264}
I20260709 13:10:35.170712  1190 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.172492 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:35.172858 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:35.172523   981 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:35.174548   981 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.175033   981 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.175702  1115 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:35.174134 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:35.177136   981 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.177654  1175 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.179780 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:35.180127  1175 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:35.181051 30374 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.181228  1175 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.182047  1132 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.160238  1208 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.182897 30309 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 5 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.184378  1208 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:35.185055  1175 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.185527 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 308) took 3021 ms. Trace:
I20260709 13:10:35.185180 30309 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:35.185891 30486 rpcz_store.cc:276] 0709 13:10:32.164290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.623464 (+1459174us) service_pool.cc:224] Handling call
0709 13:10:33.623727 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.084019 (+1460292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.185272 (+101253us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400158e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:35.185473 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223814912}
I20260709 13:10:35.186681 30309 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 6, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.191438   862 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:35.192045 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1574) took 1942 ms. Trace:
I20260709 13:10:35.192483 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.193531 30486 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:35.192416 30407 rpcz_store.cc:276] 0709 13:10:33.250055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.583336 (+1333281us) service_pool.cc:224] Handling call
0709 13:10:34.657108 (+ 73772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.678434 (+ 21326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.678463 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.692703 (+ 14240us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.877186 (+184483us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:34.897524 (+ 20338us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.897799 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.897897 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.182787 (+284890us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b180002d520. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:35.189872 (+  7085us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b180002d520. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:35.191830 (+  1958us) raft_consensus.cc:1685] finished
0709 13:10:35.191851 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.191987 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13492,"prepare.queue_time_us":19948,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":9518,"raft.queue_time_us":22099,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":5275,"spinlock_wait_cycles":17583232,"thread_start_us":149283,"threads_started":1,"wal-append.queue_time_us":243275}
I20260709 13:10:35.195390 30376 leader_election.cc:400] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9.
I20260709 13:10:35.195770 30376 leader_election.cc:403] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.196363  1120 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.197714  1155 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:35.198024  1190 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.165608  1180 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.198941 31118 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:35.208915 30551 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
W20260709 13:10:35.242280 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.243063 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.245745 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 232497us
W20260709 13:10:35.246430 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 101895us
I20260709 13:10:35.248948  1258 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:35.250751  1258 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:35.252475 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:35.181298 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:35.254891 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 114096us
I20260709 13:10:35.139192  1222 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.255785 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.260311 30559 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:35.238193  1063 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.251202  1258 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.150421  1105 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:35.275125 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 94154.4us
I20260709 13:10:35.276665 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.267774  1000 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:35.281136 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.285454 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.274477  1173 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:35.289232 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.293711 30407 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:35.294812 30410 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.297139  1105 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.297478  1113 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.302853  1105 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.304577  1127 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.305516  1127 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:35.305843  1127 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.306293  1222 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.307610  1222 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.288964  1173 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:35.310923  1127 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.311851  1118 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.312284  1118 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.312563  1127 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.313192  1118 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.291909  1006 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:35.311487  1173 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.307647  1132 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:35.314674  1118 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.319473 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.320210 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.320734 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.321189 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.322448 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.322572 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.322878 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.323604 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.324177 30403 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.293581  1000 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.326830 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.327579 30486 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:35.327611 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.328620 30409 raft_consensus.cc:2410] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:35.332684  1120 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9.
I20260709 13:10:35.335016  1173 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.321871 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.346164 30403 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:35.352473 30404 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
W20260709 13:10:35.354996 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116223us
W20260709 13:10:35.356510 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73386.9us
I20260709 13:10:35.361151 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:35.362969 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 92125.7us
I20260709 13:10:35.346123  1247 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:35.364748 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:35.365574 31151 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:35.365147  1247 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.366366 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:35.367070 31146 raft_consensus.cc:2368] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:35.366995 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.368345 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.370916  1258 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.371429  1175 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.372135  1258 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.368681 30309 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.376318 30309 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:35.377379 30376 leader_election.cc:400] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:35.378902 30376 leader_election.cc:403] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.379983  1175 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.370517 31144 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:35.359923  1105 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.386188 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 137879us
I20260709 13:10:35.378064 30309 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.385272 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.389998  1000 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.390390 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.390653  1105 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.391898 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.392203 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.392786 30411 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.392877  1105 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.395339  1247 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.399376 30409 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:10:35.399659 30411 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:35.400090 30410 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:35.401530 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.402230 30411 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.403265 30407 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:35.404183 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.404748 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.406251  1250 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.406904  1250 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.406195 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.406589 30309 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 7, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:10:35.408349 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43889.2us
I20260709 13:10:35.406095  1253 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.409960 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47248.6us
I20260709 13:10:35.410331 30486 raft_consensus.cc:2368] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:35.411634 30480 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:35.415287 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.385649  1063 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:35.418792 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:35.421314 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 164774us
I20260709 13:10:35.418898 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.423977 30407 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:35.423863 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.425997 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.412196  1248 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.440935 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.423352   828 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:35.442049 30404 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:35.442202   828 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.442566   828 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.443449   828 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.431030 30406 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:35.433363  1250 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:35.433250  1129 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:35.421641  1253 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.434199 30480 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:35.446151  1129 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:35.446511  1129 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:35.446621  1260 consensus_queue.cc:1175] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce312b0d7a1747c8898a748f8d76df81" responder_term: 8 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:35.434962 30523 leader_election.cc:400] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:35.447698  1253 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.447997 30523 leader_election.cc:403] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.447539  1129 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.439178 30309 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:35.439222  1063 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.440946  1248 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.429162 30409 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:35.439617 30411 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:35.454927 30479 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:35.448961  1129 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.455940 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:35.459017 30305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 189) took 17022 ms (client timeout 15000 ms). Trace:
I20260709 13:10:35.466742 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.468003 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.469498 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.470028 30411 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:10:35.470803 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54987.4us
I20260709 13:10:35.455353  1253 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:35.460893  1248 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.473835  1253 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:35.474229  1253 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.474318  1113 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:10:35.453799  1132 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.459388 30309 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:35.457095  1135 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.471529 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.486545 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.487368 30409 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:35.475538  1253 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.457497  1263 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.490425 31117 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.495703 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.496333 30479 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:35.497308  1006 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.497556  1251 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:35.497923  1006 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:10:35.498848 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.497349 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:35.498879  1006 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.476879  1250 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:35.485579   828 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.462857  1127 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:35.491186  1259 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.513411  1253 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.511314 30309 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 5 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:35.467113  1118 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:10:35.531910 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.531322 30309 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 5 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.533943  1237 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.534956 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.506299  1250 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:35.535898 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64102.7us
I20260709 13:10:35.537086 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.537086 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:35.536259 30451 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.824s (SENT) [suppressed 30 similar messages]
I20260709 13:10:35.542917 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.539803 30408 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.547235 30411 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.548202  1251 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:35.546540 30309 catalog_manager.cc:5697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 6, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.551507 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.552817 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.553911 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.556286 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.540752  1250 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.534484  1237 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.560103 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.561566 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.545176  1118 consensus_queue.cc:1243] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:35.556887 30557 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:35.555428 30309 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 8 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.548748  1000 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:35.569693 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.571503 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.572741 30479 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:35.561807 30559 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.550258  1251 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:35.553520  1132 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.570544 30309 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 4, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 4 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.579262 30555 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:35.579764 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.581785  1256 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:35.577579  1251 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.583382 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.584873 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.585000  1258 raft_consensus.cc:2764] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:35.573854  1113 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:10:35.586990 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.586534 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.589388 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.572021  1260 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:35.574033  1175 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:35.571508  1000 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:35.595275  1000 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:35.598150  1271 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:10:35.467568 30305 rpcz_store.cc:269] 0709 13:10:18.436643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.436849 (+   206us) service_pool.cc:224] Handling call
0709 13:10:35.458643 (+17021794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:27.126479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:27.302990 (+176511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:27.305637 (+  2647us) write_op.cc:435] Acquired schema lock
0709 13:10:27.310952 (+  5315us) tablet.cc:662] Decoding operations
0709 13:10:27.416586 (+105634us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:27.416652 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:27.416681 (+    29us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:10:27.418038 (+  1357us) tablet.cc:701] Row locks acquired
0709 13:10:27.418061 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:10:27.418221 (+   160us) write_op.cc:270] Start()
0709 13:10:27.418339 (+   118us) write_op.cc:276] Timestamp: P: 1783602627418173 usec, L: 0
0709 13:10:27.418361 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:27.485526 (+ 67165us) log.cc:844] Serialized 7372 byte log entry
0709 13:10:27.835039 (+349513us) op_driver.cc:464] REPLICATION: finished
0709 13:10:28.151450 (+316411us) write_op.cc:301] APPLY: starting
0709 13:10:28.151554 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:28.152028 (+   474us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:28.152191 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:28.154353 (+  2162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:28.174497 (+ 20144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:10:28.180176 (+  5679us) write_op.cc:312] APPLY: finished
0709 13:10:28.286754 (+106578us) log.cc:844] Serialized 125 byte log entry
0709 13:10:28.332621 (+ 45867us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.353957 (+ 21336us) write_op.cc:454] Released schema lock
0709 13:10:28.360174 (+  6217us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:28.411959 (+ 51785us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.414475 (+  2516us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":174876,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":286219,"apply.run_cpu_time_us":5573,"apply.run_wall_time_us":241405,"num_ops":18,"prepare.queue_time_us":185387,"prepare.run_cpu_time_us":16286,"prepare.run_wall_time_us":410607,"raft.queue_time_us":50324,"raft.run_cpu_time_us":63039,"raft.run_wall_time_us":303199,"replication_time_us":402898,"thread_start_us":387493,"threads_started":4,"wal-append.queue_time_us":153902,"wal-append.run_cpu_time_us":23548,"wal-append.run_wall_time_us":1734036}]]}
I20260709 13:10:35.599830 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.600212 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.600433 30408 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.592573  1260 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.602974 30309 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 1 to 7, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 7 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.605396 30309 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 6, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.606925 30406 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:35.611743 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.615273 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.618676 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.619719 30555 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:35.619676 30402 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:35.608011 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:35.623348 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 43637.7us
W20260709 13:10:35.625160 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.591958  1258 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.631296 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.632380 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.642827 30483 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:10:35.643385 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56928.2us
I20260709 13:10:35.643939 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.645251 30411 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:35.645500 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:35.647058 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.647310 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.615705  1120 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.652177 30480 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:35.649801 30374 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.647965 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:35.667816 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:35.668740 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.619428  1256 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.669854 30481 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:35.673393 30555 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:35.675439 30403 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.635241  1247 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.680992 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:35.631928  1260 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.686964 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.691275 30553 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:35.695222 30557 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:35.696436 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.697263 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.700621 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.679319  1245 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:10:35.704377  1118 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:35.704891  1118 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.705492  1251 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.705791  1118 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.706822 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.712265  1251 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:35.714054 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.716344  1257 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:35.716495 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.716789  1257 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.717940 30484 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:35.717664  1257 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.720440  1132 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.721231  1132 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.672295  1115 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:35.722867  1115 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:35.723275  1115 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.723599  1132 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.724138  1115 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.679293   875 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:35.726787   875 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.727906   875 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.729122 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.732470 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.733126  1190 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:35.734122  1000 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.735006 30376 leader_election.cc:400] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9.
I20260709 13:10:35.738608  1120 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:35.739773  1237 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:35.740746  1127 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.713075 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:35.755300 30555 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:35.755328 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55526.2us
W20260709 13:10:35.769307  1275 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:10:35.759819  1115 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:35.771059 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 146909us
I20260709 13:10:35.758455 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.691717  1256 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.792631 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.791560 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.793660 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:35.795002 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 156646us
I20260709 13:10:35.797003 30556 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.801970 30552 raft_consensus.cc:2410] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:35.802306 30477 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:35.803561 30555 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
W20260709 13:10:35.804987 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46617us
I20260709 13:10:35.807179 30450 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.775063 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.810050 30554 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:35.814569 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:35.815624 30411 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:35.825238 30404 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:35.832615 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.833400 30556 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:35.824797 30450 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.836186 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.837164 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.838404 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.811466  1257 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:35.833920  1129 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:35.816282  1190 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:35.843879 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52418.4us
I20260709 13:10:35.845646 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.823220  1120 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.847100 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:35.824510   956 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:35.761389  1254 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:10:35.847776 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.848356 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.849541 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.851425 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:35.840106  1274 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260709 13:10:35.857517 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.858069 30553 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:35.858879 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:35.861258 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 212176us
I20260709 13:10:35.861356 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:35.861915 30551 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.848053  1245 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:35.867502 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.847884  1248 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.868151 30554 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.864887 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.834190  1247 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:10:35.854802   956 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.878362 31146 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:35.854477  1129 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.862809  1175 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:35.883931 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:35.887077 30554 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:35.871110  1245 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.885366   828 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:35.891099  1245 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:35.891676   828 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:35.892037   828 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:35.892832   828 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:35.894101   828 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.885957  1256 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:35.895095 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:35.896263 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:35.878576   956 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:35.951819 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:36.099386 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 252320us
I20260709 13:10:36.098932 30558 raft_consensus.cc:2376] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9. Re-sending same reply.
I20260709 13:10:35.886152  1248 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:36.108877 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.112007 30551 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:35.947717  1135 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:36.118903 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.126269 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.127095 30555 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:10:36.129173 30559 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.002s
I20260709 13:10:36.129525 30559 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:36.132087 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.133456 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:36.136724 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.115279  1290 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.143829 30557 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:36.111546  1105 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:36.148208 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:36.150036 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:36.134259  1258 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:36.150038 30477 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:36.155118   862 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:36.168493   862 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:36.146296  1135 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:36.171334  1282 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:36.172672  1248 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.146481  1284 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:36.145282  1250 consensus_meta.cc:287] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
I20260709 13:10:36.175341  1250 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.176542 30483 raft_consensus.cc:2368] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8.
I20260709 13:10:36.177459  1250 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:36.144822  1247 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:36.147806  1290 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:36.160394  1253 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.010s
W20260709 13:10:36.163668  1278 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 13:10:36.198868  1285 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:10:36.204998 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59908.1us
I20260709 13:10:36.191632  1284 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:36.208001 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:36.210371 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.198525  1290 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.214883 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:36.218997 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 335104us
I20260709 13:10:36.224067 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.224874 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:36.199921  1258 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.225643 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:36.229676 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.217711  1118 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.232563 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:36.236654 30407 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:36.238469 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 342342us
I20260709 13:10:36.239573  1297 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.240481  1297 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:36.235569 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:36.241570 30486 raft_consensus.cc:606] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:36.222652  1129 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:36.248730  1302 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.249258  1302 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.249650  1302 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.226836   875 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.229753  1135 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.252108 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.254922  1298 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:36.258354  1284 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.258778  1250 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.260097  1250 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:36.260481  1250 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:36.262796 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.261341  1250 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.266223  1250 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.269482 30556 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
W20260709 13:10:36.270051  1281 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:10:36.270120 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 169966us
I20260709 13:10:36.271039 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.271039  1298 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:36.272365 30374 leader_election.cc:400] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:36.272660 30374 leader_election.cc:403] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:36.276577 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 143233us
I20260709 13:10:36.277894 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:36.264775  1279 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.525s	user 0.001s	sys 0.003s
I20260709 13:10:36.279834 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.283468 30451 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.279294  1132 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.286209 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:36.287029  1175 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.287493  1292 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:36.287854  1175 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:36.287933  1292 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:36.292904 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.288868  1129 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:10:36.286209  1245 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.275774  1115 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.263857   956 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.314405 30523 leader_election.cc:400] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8.
I20260709 13:10:36.314950 30523 leader_election.cc:403] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.310717 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.302599 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:36.276772 30357 placement_policy_util.cc:248] tablet 2e1b5d40df944767ab310e2bd822d5b0: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:10:36.310446   956 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.308753  1245 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.319726  1237 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:36.320091  1237 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:36.320894  1237 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.310892  1180 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:36.323395  1180 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:36.323779  1180 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.299515  1127 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:36.325714  1127 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.299754  1300 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.302759  1000 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:36.307662  1291 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.327847  1291 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.329952  1291 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.310117  1132 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.295722  1190 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.337637  1190 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:36.338050  1190 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.339250  1292 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:36.340288  1283 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.480s	user 0.002s	sys 0.000s
I20260709 13:10:36.343603 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.345651 30554 raft_consensus.cc:2410] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:10:36.346276  1280 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:10:36.296898  1113 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.347431 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:36.333571 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:36.348445 30484 raft_consensus.cc:606] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.348788 30484 raft_consensus.cc:614] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:36.349048  1258 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:36.311154  1118 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:36.349757  1118 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:36.350970  1132 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.350665  1118 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.351627  1132 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.352587  1132 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.353207  1132 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:36.353958  1175 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:36.336848  1129 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.354384  1175 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:36.355295  1175 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.356585  1175 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.360666 30407 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:36.361488  1237 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.365051  1292 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:36.367169 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64701.7us
I20260709 13:10:36.367760  1247 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:36.369346  1247 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:36.369745  1247 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.371179  1260 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.375860 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.377270  1254 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.379222  1132 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:36.380235  1132 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.383599 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.376492  1127 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.368727  1000 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:36.339756 30559 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:36.379339 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:36.387719 30484 raft_consensus.cc:606] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.388204 30484 raft_consensus.cc:614] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:36.393380 30405 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:36.401661  1257 consensus_meta.cc:287] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.004s
I20260709 13:10:36.404213  1290 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.406433  1290 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.399564  1298 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:10:36.432236 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48715.2us
I20260709 13:10:36.441782 30486 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:10:36.446863 30552 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:36.445593 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 210748us
I20260709 13:10:36.451014 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.393131  1000 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:36.461794 30560 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:36.465202 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:36.471993 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 175128us
I20260709 13:10:36.473341 30483 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:36.473668 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.431902  1250 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.490876 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.472999 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:36.406378  1180 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.447728  1127 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:36.493409 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.498081 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:36.498665 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.507004 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:36.517740 30523 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.520071 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.521646 30402 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.431581  1302 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.494861  1216 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.523267 30405 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.472591  1254 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:10:36.472893  1258 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:36.531818 30403 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:36.532676 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:36.536144 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 188778us
I20260709 13:10:36.506925   875 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:36.517079  1291 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:36.543072 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:36.543749 30481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:36.546511 30482 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:36.546993 30481 raft_consensus.cc:606] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:36.547416 30481 raft_consensus.cc:614] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:36.521418  1115 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:36.550164 30405 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:36.556700 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.507125  1127 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.560357 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.538417  1248 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:36.568444 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71247.9us
I20260709 13:10:36.539484  1290 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.540781  1132 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.542868   875 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:36.572716 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.563488  1120 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.562130  1291 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:36.626231 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.577399  1190 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:36.616586 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65482.4us
W20260709 13:10:36.617105 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45694us
W20260709 13:10:36.605367  1309 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:10:36.578239  1265 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.208s
I20260709 13:10:36.622442  1310 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:36.622941  1305 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:36.620481  1105 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:36.624188  1129 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8.
I20260709 13:10:36.624686 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:36.638736 30478 raft_consensus.cc:606] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.539746  1000 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:36.626777 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57010.3us
I20260709 13:10:36.582824  1132 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.602231   875 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.637198 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:36.570948  1268 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:10:36.598870  1258 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:36.643639  1132 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.660226  1105 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.656941  1313 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.663043  1313 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:36.663554  1313 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.627995  1120 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.668485  1120 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.627748  1256 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:36.669622  1180 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:36.658068  1302 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.635983  1305 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:36.670539  1155 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:36.671377 30481 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:36.671512  1305 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.659394  1291 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.674862  1113 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.677587  1127 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:36.678653  1113 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:36.683120 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:36.684634  1000 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.684909 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:36.684857  1190 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:36.689049  1315 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:36.694798  1288 raft_consensus.cc:993] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:10:36.710613 30482 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:36.722007 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.712872 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet 0d1e11d913434fda8959a45d48772c1f: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:36.644414   898 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:10:36.699743  1290 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.754215 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58789us
W20260709 13:10:36.772567 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 140803us
I20260709 13:10:36.772858  1317 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.773567 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.773840  1277 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.773959  1266 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:10:36.774362  1277 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.774852  1269 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:36.775375  1269 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.776628  1277 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.777360  1269 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.778098  1277 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:36.737269  1254 raft_consensus.cc:1081] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:10:36.781227 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.786768 30410 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:36.787976 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.788720 30554 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:36.743233  1256 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.791576 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.731153  1175 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:36.794934 30554 raft_consensus.cc:2376] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8. Re-sending same reply.
I20260709 13:10:36.802091 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.802944 30552 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
W20260709 13:10:36.808490 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 238668us
W20260709 13:10:36.809417 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.811077 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.811709 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.812299 30554 raft_consensus.cc:2376] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8. Re-sending same reply.
I20260709 13:10:36.816172 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.840548 30478 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:36.836651 30554 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:36.839751 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:36.789295  1253 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.841748 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.841882  1127 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:36.836218 30559 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:36.843869 31144 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:36.845095 31146 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.846380 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:36.846308  1247 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:36.847071 31153 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:36.847237  1308 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:36.849707  1105 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:36.850620 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:36.850497  1132 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.850936 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.851300 31148 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:36.851861  1113 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.852536  1132 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:36.852372  1113 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.764020  1290 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:36.854931  1289 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:36.855070  1290 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:36.859122 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.859541 30557 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:36.859987 30557 pending_rounds.cc:85] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:10:36.860257 30557 pending_rounds.cc:107] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:36.860328 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.860642 30557 raft_consensus.cc:2889] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.861127 30555 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:36.861937 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.862087 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.804932  1256 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.867205 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.801375  1118 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:10:36.869875 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54468.3us
I20260709 13:10:36.870359 30479 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:36.871690 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:36.843261 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.873929 30559 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:36.862569 30555 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:36.885251 30558 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:36.886976 30481 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:36.854377  1113 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:36.889786 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.894527 30557 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.890599 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:36.900787 30551 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:36.903236 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.905581 30558 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:36.907254 30558 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.915980 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.925230 30411 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:36.866567  1250 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.928685 30555 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:36.922922  1180 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.930441  1180 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:36.930554  1129 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.932500  1063 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.934753 30408 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:10:36.940236 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 366507us
I20260709 13:10:36.941246 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:36.942024 30403 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:36.946857 30557 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:36.947429 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.947846 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:36.947966 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:36.948212 30551 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.940124 30559 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:36.954012 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet 1640dd5756f749fd8546ca110299cc59: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:36.954041 30557 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:36.954783 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:36.908468  1006 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:36.958062 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.960007 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:36.917938  1175 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:36.961655 30403 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:36.962266 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:36.969218 31153 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:36.969511 30411 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:36.958379 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67885.5us
I20260709 13:10:36.971428 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:36.972252 30557 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:36.923668  1247 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:36.975345 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 51017us
I20260709 13:10:36.976320 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:36.976666 30551 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:36.977356 30559 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:36.973585 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:36.992913 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:36.963680 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:36.999006 30555 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:36.999781  1287 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.999564 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.002255  1321 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:37.003337  1135 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.967949  1006 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.015650 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.012015 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:36.957099  1256 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.030264 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.036398 30403 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:37.031026 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.032733 30411 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:37.034332 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 60832.5us
I20260709 13:10:37.035159 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.053447 30482 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:36.989295  1175 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:37.053974 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:37.059775 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 83563.3us
I20260709 13:10:37.033493  1247 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:37.033273  1006 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.030184  1321 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.073083  1321 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.041404  1132 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:37.064268  1250 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:37.065059  1313 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.065989  1334 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.066953  1253 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:37.068204 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.041356   862 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.069509   875 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:37.076231 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.078276 30411 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:37.078663 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:37.080443 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.074074  1132 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.084120 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:37.060654  1310 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.087833 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:37.088498 30410 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:37.031203  1287 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.092331 30409 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:37.081038  1259 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.089011  1290 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.092552  1216 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:37.114344  1290 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:37.114804  1216 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:37.092365  1292 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:10:37.115823  1216 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.116812  1216 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.097678   875 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.119062   875 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.104773  1006 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.106786 30404 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:37.119513   875 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.121670   875 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.121790 30404 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:37.122195   875 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.111123 30403 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:37.085311   862 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.123155   862 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.114339  1259 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.123703  1313 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.076933  1237 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:37.083741  1334 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.114933  1290 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.124890 30556 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:37.128859 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.129596 30486 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:37.104954 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.132272 30484 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:37.132534  1263 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:37.132689  1259 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.132970  1263 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:37.133944  1263 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.131170   875 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.143813  1132 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.144922 30552 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:37.150565 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.145066 30560 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.143848 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:37.146345 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 115401us
I20260709 13:10:37.082942  1247 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.146988 30477 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:37.148998 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:37.166895 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.173990 30486 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:37.174641 30485 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:37.177175 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.178755 30485 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.179412 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.180962 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.188455 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.189546 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.184257 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.189980 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.151671  1251 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.168020 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:10:37.122272  1175 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.196996 30559 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:37.202812 30559 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.198027 30485 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:37.199384 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.205475  1302 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:37.205883 30477 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:37.206596  1287 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.188337  1135 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:10:37.207127  1127 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.207494  1247 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.207926  1127 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:37.208329 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.209049  1321 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:37.209357  1298 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:37.210309  1222 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.210760  1222 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.211113  1222 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.211333  1248 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:37.211694  1248 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.211854  1334 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.193665  1341 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:37.212598  1245 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:37.212896 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.213027  1245 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.213312  1341 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:37.213732  1341 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:37.214020  1297 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.214157  1302 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:37.205735 30552 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:37.175587  1000 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:10:37.176571  1292 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:10:37.185935   828 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.183527  1253 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:37.226779 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.265807 30559 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.187853  1268 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.274365 30555 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.183729  1291 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:10:37.275934  1006 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.266623   828 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.286000   875 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.188172  1288 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:37.198808  1263 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.305011 31153 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:37.305418 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:37.306170 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:37.306326  1288 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.307267  1288 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.310078  1222 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.199105  1250 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:37.312680  1250 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.313640  1250 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.315004   828 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.318781 30553 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:37.214612  1341 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.298908  1253 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.319813 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.320393 30553 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:37.320561 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:37.321190 30560 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.219833  1251 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.326615 30450 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:37.214596  1302 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.333731 30410 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:37.312070 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.336419 30556 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:37.337304 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.338056 30556 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:37.339323 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:37.333073 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:37.328161 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:37.214767  1330 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:10:37.344652 30410 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:37.347548 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:37.348179 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:37.349745 30406 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:37.351065 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:37.353493 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.354038 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:37.354964 31153 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.354290 30406 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:37.357292 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.357810 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.358408 30560 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:37.328513 30559 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:37.370870  1190 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.371575  1302 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.372680  1222 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.376266  1313 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:37.334870  1254 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:37.334729  1237 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:37.377853  1290 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.378504 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.378763   875 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.380729  1305 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:37.342869  1292 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.214582  1297 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.362723 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:37.428623 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50292.1us
W20260709 13:10:37.429188 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66562.9us
I20260709 13:10:37.352710  1259 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.387709 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:37.434221 30411 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.386245 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:37.434955 30406 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:37.435058 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48889.1us
I20260709 13:10:37.349619  1288 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.353629  1006 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.399019 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.436277  1291 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.437331  1344 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.434016 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:37.439393 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.440177 30559 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:37.441375 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:37.442143 30559 raft_consensus.cc:2368] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:37.320346  1253 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.378795  1250 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:37.293727  1268 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.429500 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.388238  1190 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:37.422050 31153 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:37.395732  1257 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:37.468180 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.471745 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:37.474057 30560 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:37.438714  1259 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.433336  1222 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:37.438879  1288 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.485039  1288 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.446943  1302 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.446631   828 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.438540  1006 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:37.493392   828 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.447470  1276 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:37.433562  1317 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.516256  1317 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.518886  1276 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:37.519915  1276 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.522874 30556 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:37.505861  1259 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.524681  1291 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.528764 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.529407 30480 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:37.533012  1350 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:10:37.535422  1353 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:37.539767  1175 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:37.540752  1175 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:37.541527  1175 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.542946  1190 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.544220  1190 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.446468  1105 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.491706  1006 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.473268  1251 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.510214  1129 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:37.549993  1129 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:37.550958  1129 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.505414 30411 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:37.509266 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.513334 31151 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:37.433957  1292 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.555179  1292 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.474087  1310 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:37.562806 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.563992 30559 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:37.567276 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 164418us
I20260709 13:10:37.539842  1290 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:37.580583 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.563164  1317 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.431710   875 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.573787  1310 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:37.558262  1257 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:37.599929 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 160668us
I20260709 13:10:37.584755  1344 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.586651  1334 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.588030  1237 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.615722  1105 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:10:37.621549  1356 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:10:37.637454 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.612402  1298 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:10:37.617851  1334 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.630780  1361 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:10:37.623351  1237 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.635360  1297 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.627787  1000 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:10:37.650748 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64509.9us
I20260709 13:10:37.629453  1254 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:37.655460  1257 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.672286 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.673019 30408 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:37.649891  1268 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:37.673081   862 consensus_meta.cc:287] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.006s
I20260709 13:10:37.694315 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:37.647842  1288 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.666678   875 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.697268   862 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:37.699422  1359 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:37.716277 30552 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:10:37.750211 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.650290  1310 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.757368 30480 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:37.764708  1180 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:37.770283 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.769652  1362 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.786103  1362 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.786468  1362 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.791819  1288 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:37.775740  1237 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.772327   862 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:37.823700  1245 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.824793  1245 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.808084  1292 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:37.836632  1006 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.842412  1341 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:37.845979 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.846887 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.847990 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:37.854849 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 281489us
W20260709 13:10:37.857450 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 278149us
I20260709 13:10:37.860220 30554 raft_consensus.cc:2410] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:37.863013 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1620) took 1022 ms. Trace:
I20260709 13:10:37.825718  1334 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:37.904385 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.933408 30486 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.935218 30479 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.935705 30479 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:37.935513 30485 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:37.933589 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:37.940028 30482 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.947839 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.953501 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.955469 30477 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:10:37.931042 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.963068 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:37.958851 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:37.853519  1063 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:37.904106  1247 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.968367 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:37.966553 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:37.936355 30558 rpcz_store.cc:276] 0709 13:10:36.840454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.908114 (+ 67660us) service_pool.cc:224] Handling call
0709 13:10:36.937374 (+ 29260us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:36.957599 (+ 20225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.957628 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:37.316373 (+358745us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b18001910e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a
0709 13:10:37.316777 (+   404us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:37.317308 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:10:37.475085 (+157777us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.567325 (+ 92240us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.567714 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.850492 (+282778us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18001910e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:37.850652 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.862712 (+ 12060us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.862832 (+   120us) raft_consensus.cc:1685] finished
0709 13:10:37.862842 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.862960 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317956,"prepare.queue_time_us":154015,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2859,"raft.queue_time_us":286665,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":32648,"spinlock_wait_cycles":29303296,"thread_start_us":157384,"threads_started":1,"wal-append.queue_time_us":229460}
W20260709 13:10:38.026072 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 82713.8us
I20260709 13:10:37.967361 30479 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:37.931622  1256 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:38.093422 30479 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.026995 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:38.034590  1374 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:38.025096 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:38.039969 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 69609.1us
I20260709 13:10:37.969309  1129 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:38.044401  1006 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.040024  1258 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.094141 30404 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.100580 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.027226  1305 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.095150 30485 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:38.096485 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:37.956132  1175 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.126876 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:38.128062  1175 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.128358 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.130347 30405 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:38.131170 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.131891 30485 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:38.132261  1118 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.133246  1258 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.135547  1258 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.136365 30408 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:38.136757  1305 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:38.139496  1292 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:38.140486 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.142264  1248 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.143461  1248 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.114409   828 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.144593   828 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.137912  1305 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.147503 30405 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:10:38.150322  1370 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.439s	user 0.003s	sys 0.000s
W20260709 13:10:38.151547  1344 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.007s
I20260709 13:10:38.151957  1344 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:38.152251 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:38.153475 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.154515 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:38.155049 30408 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.157783 30482 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:38.115209 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:38.103722  1259 consensus_meta.cc:287] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.012s
I20260709 13:10:38.106575  1256 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.119874  1362 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:38.132956 30485 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:37.708976 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:38.169950 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 1853) took 1141 ms. Trace:
I20260709 13:10:38.246994 30478 rpcz_store.cc:276] 0709 13:10:37.028920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.029056 (+   136us) service_pool.cc:224] Handling call
0709 13:10:38.169740 (+1140684us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001bdfd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:38.169863 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813585664}
I20260709 13:10:38.170984  1175 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.171463 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1631) took 1021 ms. Trace:
W20260709 13:10:38.171375 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74994us
I20260709 13:10:38.171600 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.173995 30408 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:38.266547 30405 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:38.114413 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.176234 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.179955 30404 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:38.266583 30376 leader_election.cc:400] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:38.187657 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.146588   828 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:38.197757 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.200044 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.201556 31144 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:38.241219 30486 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
W20260709 13:10:38.260047 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.260478  1256 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.273590  1248 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:38.262338  1362 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.274284  1248 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.266109 30552 rpcz_store.cc:276] 0709 13:10:37.150242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.264359 (+114117us) service_pool.cc:224] Handling call
0709 13:10:37.291689 (+ 27330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.727148 (+435459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.171216 (+444068us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54001d92d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:38.171401 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975891328}
W20260709 13:10:38.180258 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1615) took 1341 ms (client timeout 1732 ms). Trace:
I20260709 13:10:38.277674 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.269603 30376 leader_election.cc:403] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:38.282531 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:38.283499 30404 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:38.277635 30554 rpcz_store.cc:269] 0709 13:10:36.838552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.841519 (+  2967us) service_pool.cc:224] Handling call
0709 13:10:38.179974 (+1338455us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400186854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:38.180142 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340368128}
I20260709 13:10:38.292387 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.300309 30479 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:38.325515 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:38.326704 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:38.331398 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.314397 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 346111us
I20260709 13:10:38.103523  1247 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.333032 30477 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:38.276670  1175 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.335865 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.339291 30403 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:38.344990  1288 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:38.347169 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.349166 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:38.303761  1321 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.351090  1321 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.351291 31151 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:38.350600  1288 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:38.308810  1313 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:38.351848  1288 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:38.352955  1288 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.354934  1265 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.351526  1321 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.355417  1265 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:38.357605  1265 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.354394  1288 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.291162  1180 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:38.319445  1190 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.362350 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.267244  1259 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:38.343457  1248 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.361289  1175 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.301178  1245 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:38.302685  1253 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:38.364442   862 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.394080 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:38.389436 31151 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.316434  1291 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:38.381479  1310 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.382108  1190 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:38.364302   828 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:38.372120  1129 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:38.400913  1190 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.383226  1180 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.396615   862 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.411280 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:38.412029 31151 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:38.417975 31153 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:38.422605 30554 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.424402 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:38.425681 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:38.426306 30556 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.428331 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.438463 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.497682 30558 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.414378   862 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.436766  1334 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:38.499169 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 66960.1us
I20260709 13:10:38.507732 30477 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.402426  1310 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:38.509907 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 147605us
I20260709 13:10:38.513592 30556 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:38.515969 30484 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:38.508107 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:38.520457 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.523692 30552 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:38.525642  1260 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.526115  1260 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.528200  1260 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.516034  1250 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:38.529414  1250 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:38.532943  1245 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:38.537022  1245 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.537405 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.538054 30485 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:38.539386  1245 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.533442  1358 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.540241  1155 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:38.540477 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.541122 30485 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:38.530545 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.530203  1250 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.515967  1385 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:38.547794 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:38.509917  1248 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:38.548465 30556 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.551608 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.522272   828 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:38.554883 30554 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:38.517922  1247 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.560734 30482 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:38.509620  1292 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:10:38.542038  1388 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:38.547226  1358 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.562608 30552 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:38.564862 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.547148  1385 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:38.549966  1251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.024s
I20260709 13:10:38.550027  1256 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.583360 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:38.575531 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 227361us
I20260709 13:10:38.550858  1248 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:38.555282  1250 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.591848 30485 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:38.593892 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:38.605655  1216 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.606187  1216 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.607648  1305 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:38.608274  1216 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:38.591414  1251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.006s	sys 0.024s
I20260709 13:10:38.610487 30554 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:38.617516 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:38.611243 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:38.618453 30559 raft_consensus.cc:2368] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
I20260709 13:10:38.575539  1387 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.615990 30553 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:38.624449 30556 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:38.620452  1259 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.629490 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:38.630873 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 113844us
I20260709 13:10:38.631060 30555 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:10:38.634274 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:38.622215  1105 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:38.635713 30553 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:38.608975  1291 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:38.609333   828 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:38.627957 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.625494 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.638276 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:38.639117 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131326us
I20260709 13:10:38.626251 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:38.615733  1129 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.585755  1388 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.689437 30485 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.698848 30555 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:38.700745 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:38.701463 30555 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.701776  1317 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:38.705094 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:38.706073  1317 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:38.706552  1317 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:38.707034  1317 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:38.708815 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:38.587139  1358 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.709724 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:38.713415 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 88004.1us
I20260709 13:10:38.715207 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.618469  1321 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.686393  1105 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.718528 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:38.630362  1368 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 13:10:38.801295 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 161115us
W20260709 13:10:38.800343 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 172413us
W20260709 13:10:38.809850 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91376.1us
I20260709 13:10:38.811103 30555 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:38.633637  1251 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.687731  1343 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:10:38.809628 30556 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:38.721338  1297 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:38.832679 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 123110us
I20260709 13:10:38.834947 30553 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.756477  1334 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:38.637117  1387 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:38.840456 31144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 288) took 1535 ms (client timeout 1822 ms). Trace:
I20260709 13:10:38.854386 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:38.767030  1180 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.777011  1260 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.851186  1401 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:38.645093  1132 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:38.853138   828 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.809417  1269 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:38.847128 30485 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:38.836936  1257 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.831293  1268 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.835834  1253 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.821225  1105 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.888855 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.849718  1297 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.848409  1115 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:38.914353  1115 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:38.849138  1376 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.697327  1129 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.916997  1115 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:38.916944  1376 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.693250  1385 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.918286  1321 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.918851  1385 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.919070  1321 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.919729  1321 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.890489 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:38.923400 30556 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:38.896767  1132 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:38.856626 31144 rpcz_store.cc:269] 0709 13:10:37.304776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.305926 (+  1150us) service_pool.cc:224] Handling call
0709 13:10:38.840234 (+1534308us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400417154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:38.840368 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035349376}
I20260709 13:10:38.883411  1257 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.900461  1344 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:38.900885  1253 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.885085  1180 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:38.882107  1173 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.907379 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43246 (request call id 6) took 1001 ms. Trace:
I20260709 13:10:38.938709 30480 rpcz_store.cc:276] 0709 13:10:37.905758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.949522 (+ 43764us) service_pool.cc:224] Handling call
0709 13:10:38.907121 (+957599us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003d7554. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450af735 00007fa04a06fd29 00007fa0435ee1d4 00007fa0435ee162 00007fa0435ee091 00007fa0435ee00c 00007fa0435ed2c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:38.907293 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026737408}
W20260709 13:10:38.907850  1190 consensus_meta.cc:287] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:10:38.907629  1317 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.909003  1245 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.909478  1390 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:10:38.896313  1269 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:38.847339  1251 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.910845 30481 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:38.867730  1310 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.871692  1260 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.977643  1260 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.917280 30554 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:38.893736 30485 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:38.901587  1297 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:38.925786  1382 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:10:38.895995  1268 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:38.957458 30410 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:38.919024  1376 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.957083 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:38.934950  1257 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.970651  1269 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:38.970778  1394 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:10:38.971241  1397 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:10:38.976174  1132 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:38.976254  1251 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.910595  1401 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.009325 30479 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:39.015794 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.958886  1180 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:38.982134  1173 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:39.058645  1173 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.059880  1401 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.062930  1401 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.060644 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1653) took 1196 ms. Trace:
I20260709 13:10:39.065953 30407 rpcz_store.cc:276] 0709 13:10:37.863895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.864088 (+   193us) service_pool.cc:224] Handling call
0709 13:10:37.941979 (+ 77891us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:37.960160 (+ 18181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.960207 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:37.973353 (+ 13146us) log.cc:844] Serialized 52 byte log entry
0709 13:10:38.647563 (+674210us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:38.712885 (+ 65322us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.713097 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.713195 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.060391 (+347196us) raft_consensus.cc:1685] finished
0709 13:10:39.060409 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.060559 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48918,"prepare.queue_time_us":65909,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":10935,"raft.queue_time_us":147250,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":12804,"spinlock_wait_cycles":1510144,"thread_start_us":429653,"threads_started":1,"wal-append.queue_time_us":691888}
I20260709 13:10:38.962396  1245 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.072770  1245 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.075881  1388 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:39.076915  1389 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.299s	user 0.000s	sys 0.000s
I20260709 13:10:39.079012  1268 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:38.945395  1344 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:38.954089  1190 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.085144  1190 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.087724  1401 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.088646  1401 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.089643  1344 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.090818  1132 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.052426  1358 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.091305  1132 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.078459  1248 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.093112  1248 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:39.093149  1380 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.817s	user 0.003s	sys 0.000s
I20260709 13:10:39.093397  1132 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.090548  1401 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.094825 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1651) took 1256 ms. Trace:
I20260709 13:10:39.095268 30409 rpcz_store.cc:276] 0709 13:10:37.838289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.838477 (+   188us) service_pool.cc:224] Handling call
0709 13:10:37.838841 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.839216 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:37.839246 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.839701 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.045421 (+205720us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:38.045459 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.045525 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.092459 (+1046934us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:39.094452 (+  1993us) raft_consensus.cc:1685] finished
0709 13:10:39.094480 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.094752 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":956,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":37322496,"thread_start_us":205342,"threads_started":1,"wal-append.queue_time_us":435564}
W20260709 13:10:38.972733  1175 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
W20260709 13:10:38.983870  1384 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:10:38.974040  1321 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.108282 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:39.114048 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.118605 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.118736 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.134881  1237 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:39.135488  1237 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:39.136505  1237 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.138132  1237 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.129379 30410 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:39.139293 30559 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:39.130012 30406 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:39.123528 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.125736 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.126679 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.045601  1129 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.143177 30407 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:39.144002 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.171078 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.204020 30481 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:39.202826 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:39.213749 30477 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.214586 30485 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:10:39.243569 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.250418 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.253535 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.254501 30479 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:39.010373  1334 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.142884  1358 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.259727 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.261605 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
W20260709 13:10:39.263002 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet b32c699f55944c90a3ffe996af3951b7: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:39.145643  1190 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:39.237672  1288 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 13:10:39.267937 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.284176 30409 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:39.272837 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.286382 30480 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:39.285395 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.273795 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:39.127879  1175 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.277694 30405 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:39.310290 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.285043  1343 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.312186  1343 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.313962 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.282989 30477 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:39.315663  1257 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.338805 30555 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:10:39.339239  1250 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260709 13:10:39.288164  1190 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.350912 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1654) took 1445 ms. Trace:
I20260709 13:10:39.343528 30411 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:39.343401 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.013s
W20260709 13:10:39.354179 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.011s	sys 0.013s
W20260709 13:10:39.386457 30451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.019s	sys 0.022s
W20260709 13:10:39.387857 30451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.020s	sys 0.023s
I20260709 13:10:39.351428 30402 rpcz_store.cc:276] 0709 13:10:37.905364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.949531 (+ 44167us) service_pool.cc:224] Handling call
0709 13:10:37.958751 (+  9220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.959096 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.959129 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.971954 (+ 12825us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.408037 (+436083us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:38.408098 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.408191 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.350630 (+942439us) raft_consensus.cc:1685] finished
0709 13:10:39.350658 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.350841 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":57154,"thread_start_us":373257,"threads_started":1,"wal-append.queue_time_us":534784}
W20260709 13:10:39.409471 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.284777  1401 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.284747  1344 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:39.344847  1375 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.273s	user 0.007s	sys 0.000s
I20260709 13:10:39.339289  1257 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.386423  1129 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.342636  1190 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.442114  1387 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.308738  1180 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.442252  1401 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.475457  1344 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.483218 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:39.562655 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 79555.5us
I20260709 13:10:39.564422   828 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:39.564806   828 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.564976  1385 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.565186   828 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.565481  1385 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.483505  1317 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.488524  1417 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.568034  1417 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.494273  1129 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.571938  1129 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:39.505249  1404 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:10:39.573462  1385 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.511000  1257 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:39.519337  1115 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.525758 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.543227 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:39.498584 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.538847 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet ba4c05796efa42489d11c8a49ba476ad: Illegal state: Replica 0472fa7187444a91b443058ef89fceb9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:39.586781 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.590335 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:39.590553  1175 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.591118  1175 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.545621  1313 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:10:39.591616  1175 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.585420  1115 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.593665  1175 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.546161  1419 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.599175  1419 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.482383  1358 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.481894  1291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.002s	sys 0.017s
I20260709 13:10:39.609349 30485 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:39.609597 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:39.604492  1269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.016s	sys 0.046s
I20260709 13:10:39.611673 30477 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:39.541592  1190 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.578985  1253 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:39.598646  1248 consensus_meta.cc:287] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.001s
I20260709 13:10:39.549873  1321 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.576788  1105 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.601796  1115 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:39.612701  1269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.016s	sys 0.046s
I20260709 13:10:39.601251 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:39.612330  1291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.017s
I20260709 13:10:39.572540   828 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.651115 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:39.644196  1260 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.666s	user 0.014s	sys 0.000s
I20260709 13:10:39.613675  1358 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.660280 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:39.664784  1423 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:10:39.664671  1426 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.665501  1420 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:39.665380  1426 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.665995  1420 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.666415  1420 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:39.619236  1190 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.647547  1343 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.646037  1291 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:39.628600 31144 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:39.654536  1317 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.623008  1321 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.667241  1417 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.689756 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.667659  1426 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.661090  1260 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.757282 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:39.761979 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.755800  1132 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.771347  1132 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:39.775615  1392 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.932s	user 0.009s	sys 0.000s
I20260709 13:10:39.778903 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.779851 30555 raft_consensus.cc:2368] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:39.780928 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.781522 30555 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:39.782310 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.783298 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1663) took 1451 ms. Trace:
I20260709 13:10:39.783654 30411 rpcz_store.cc:276] 0709 13:10:38.331523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.331641 (+   118us) service_pool.cc:224] Handling call
0709 13:10:38.340739 (+  9098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.353490 (+1012751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.783100 (+429610us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400208d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:39.783245 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305722624}
I20260709 13:10:39.785890  1175 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.786399  1175 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.788461  1175 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.793107  1175 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.793650  1175 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.795742  1175 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.803380  1175 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.804155  1175 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.806249  1313 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:39.806859  1313 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.810734  1175 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.817816 30376 leader_election.cc:400] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:39.818238 30376 leader_election.cc:403] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:39.820756 30483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.055s	sys 0.116s
W20260709 13:10:39.821218 30483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.055s	sys 0.116s
I20260709 13:10:39.790343  1401 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.685220  1317 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.823444 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:39.773983  1132 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.830458 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.698313  1419 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.836463 30555 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:39.838475 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:39.744146  1343 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:39.845062 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.762753  1344 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.846165 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:39.846611 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.853410 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.853569 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:39.832190  1334 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.856805 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.857481 30477 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
W20260709 13:10:39.857991 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.858557 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.844854  1401 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:39.860245 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.860181 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:39.859645 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.863993  1417 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.864694  1417 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.865511 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 368) took 1300 ms. Trace:
I20260709 13:10:39.867143  1417 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.865967 30483 rpcz_store.cc:276] 0709 13:10:38.565219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.904695 (+339476us) service_pool.cc:224] Handling call
0709 13:10:38.905028 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.931911 (+ 26883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.931956 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.932510 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.821648 (+889138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.821705 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.821801 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.865278 (+ 43477us) raft_consensus.cc:1685] finished
0709 13:10:39.865303 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.865447 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19598,"raft.queue_time_us":27677,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":10840,"thread_start_us":888768,"threads_started":1,"wal-append.queue_time_us":931128}
I20260709 13:10:39.861943 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 524) took 1314 ms. Trace:
I20260709 13:10:39.825963  1175 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:39.867902 30552 rpcz_store.cc:276] 0709 13:10:38.547392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.549583 (+  2191us) service_pool.cc:224] Handling call
0709 13:10:38.562368 (+ 12785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.562519 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:38.913270 (+350751us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.847927 (+934657us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.848298 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.850750 (+  2452us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.860908 (+ 10158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.860958 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.861023 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.861412 (+   389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.861867 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47796,"raft.queue_time_us":18072,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":67299,"spinlock_wait_cycles":299552896,"thread_start_us":828454,"threads_started":2,"wal-append.queue_time_us":695213}
I20260709 13:10:39.872983 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.873412 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.874032 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:39.869448 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:39.856433 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:39.878278 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.878655   828 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.878928 30552 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:39.879844 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.880793 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:39.881269 30552 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:39.881807  1175 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:39.882222  1175 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:39.883113  1175 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:39.884182  1430 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:10:39.884343  1175 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.886338  1358 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.887192  1190 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:39.848824  1343 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:39.888175 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.888738 30485 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:39.889248  1343 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:39.890027 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:39.890426  1260 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:39.761289  1291 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:39.891340  1425 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:40.305358  1425 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.305821  1425 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.305889 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:40.306833 30556 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.890895 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:39.891441 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:39.958652 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.880977  1321 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.312510  1420 consensus_meta.cc:287] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.002s
I20260709 13:10:40.089234   828 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.313860  1420 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.212858  1257 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:39.891120 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:40.226181  1435 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.922359 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.036418 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.314635 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.321265 30483 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:40.321789 31144 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:39.913949 30552 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:40.090876 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:39.870060  1401 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.319573 30551 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.331593 30477 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:40.320531 30481 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:40.336229 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:40.347865 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.338826 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.348547 30405 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:40.340684 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.349478 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.349874 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:40.343375 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.348536 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:40.353055 30405 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:40.354077 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:40.354805 30403 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.359544 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.360358 30411 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:40.361369 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.375376 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.376541 30556 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:40.376868 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.381249 30552 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:40.382741 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:40.093572   862 consensus_meta.cc:287] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.552s	user 0.017s	sys 0.004s
I20260709 13:10:40.310391  1334 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10.
I20260709 13:10:39.875795  1313 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.392222 31148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.010s
I20260709 13:10:40.393983 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.392649 30402 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:40.392220 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 449725us
I20260709 13:10:40.319996  1435 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.278949  1429 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:10:40.394080   862 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.398306  1425 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.399402   862 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:40.399813  1237 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 1.261s	user 0.010s	sys 0.006s
I20260709 13:10:40.400421 30557 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:39.925776  1248 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.468s
I20260709 13:10:40.400372  1237 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.401335  1237 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:40.402264  1436 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:40.403518 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1864) took 2126 ms. Trace:
I20260709 13:10:40.403877  1317 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:40.403892 30486 rpcz_store.cc:276] 0709 13:10:38.277103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.278898 (+  1795us) service_pool.cc:224] Handling call
0709 13:10:38.279309 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.316168 (+ 36859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.316214 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.325497 (+  9283us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.539609 (+1214112us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b180040d1a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:39.698503 (+158894us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:39.698559 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.698644 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.403162 (+704518us) raft_consensus.cc:1685] finished
0709 13:10:40.403185 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.403419 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21571,"raft.queue_time_us":37112,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":14943,"spinlock_wait_cycles":16917376,"thread_start_us":158659,"threads_started":1,"wal-append.queue_time_us":1877201}
I20260709 13:10:40.406716  1237 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:40.408304  1237 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:40.408769  1237 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:40.409680  1237 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.410960  1237 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.411741  1265 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.412395  1265 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.414134 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 538) took 1171 ms. Trace:
I20260709 13:10:40.414644 30552 rpcz_store.cc:276] 0709 13:10:39.242481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.413289 (+1170808us) service_pool.cc:224] Handling call
0709 13:10:40.413639 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.413810 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.413837 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.413880 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.413913 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.413972 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.414074 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:40.416460  1403 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.534s	user 0.000s	sys 0.017s
I20260709 13:10:40.416697 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 539) took 1078 ms. Trace:
I20260709 13:10:40.417438  1435 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:40.418681 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 540) took 1080 ms. Trace:
W20260709 13:10:40.418859 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1641) took 1807 ms (client timeout 1781 ms). Trace:
W20260709 13:10:40.419277 30554 rpcz_store.cc:269] 0709 13:10:38.611626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.617298 (+  5672us) service_pool.cc:224] Handling call
0709 13:10:40.418668 (+1801370us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54003f1e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:40.418792 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688093952}
I20260709 13:10:40.419175 30556 rpcz_store.cc:276] 0709 13:10:39.338530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.417885 (+1079355us) service_pool.cc:224] Handling call
0709 13:10:40.418179 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.418355 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.418382 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.418426 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.418474 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.418527 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.418629 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.419663 30551 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:40.420893 30556 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:40.421625 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1648) took 1063 ms. Trace:
I20260709 13:10:40.421861 30554 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:40.351569  1401 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.425913 30408 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:40.417137 30552 rpcz_store.cc:276] 0709 13:10:39.338232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.415811 (+1077579us) service_pool.cc:224] Handling call
0709 13:10:40.416161 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.416340 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.416368 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.416407 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.416458 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.416521 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.416642 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.434195 30556 rpcz_store.cc:276] 0709 13:10:39.358256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.420355 (+1062099us) service_pool.cc:224] Handling call
0709 13:10:40.420726 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.421361 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.421569 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48384}
I20260709 13:10:40.319056  1257 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:40.454592 30376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.040s	sys 0.064s
W20260709 13:10:40.454980 30376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.040s	sys 0.064s
W20260709 13:10:40.455502 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 632114us
I20260709 13:10:40.462023 30403 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:40.467123 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.315522   828 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.469296  1257 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:40.400492  1425 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.439266  1265 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:40.470664  1297 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.436s	user 0.005s	sys 0.005s
I20260709 13:10:40.476583  1420 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.484457 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1674) took 1191 ms. Trace:
W20260709 13:10:40.484445 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.506611  1175 consensus_meta.cc:287] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.001s
I20260709 13:10:40.507367  1439 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.507476 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:40.586910 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 79569.7us
I20260709 13:10:40.513922 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:40.589691 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 75833.1us
I20260709 13:10:40.592010 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.515173 30411 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:40.515792 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.519094 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.485639  1343 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:40.521148  1317 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:40.521150  1437 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:10:40.524168  1424 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.895s	user 0.001s	sys 0.010s
I20260709 13:10:40.532136  1447 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:40.534520 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:40.536937 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 475015us
W20260709 13:10:40.537107 30407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.025s	sys 0.070s
I20260709 13:10:40.539866  1292 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.566443 30552 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:40.571319 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.594573 30402 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:40.598098 30404 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:40.614768  1292 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.617511  1292 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.600239 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.585198 30409 rpcz_store.cc:276] 0709 13:10:39.292783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.292895 (+   112us) service_pool.cc:224] Handling call
0709 13:10:39.322932 (+ 30037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.323191 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:39.625216 (+302025us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.223518 (+598302us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.482284 (+258766us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18002a0ee0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:40.482598 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.482673 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:40.484131 (+  1458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.484228 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.484381 (+   153us) inbound_call.cc:177] Queueing success response
0709 13:10:40.522647 (+ 38266us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18002a0ee0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
Metrics: {"mutex_wait_us":199669,"prepare.queue_time_us":529274,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2667,"raft.queue_time_us":385857,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":51137,"spinlock_wait_cycles":70999680,"thread_start_us":702535,"threads_started":2,"wal-append.queue_time_us":776295}
I20260709 13:10:40.601835 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.618562  1292 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.606395 30407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.025s	sys 0.070s
I20260709 13:10:40.605011 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:40.609768 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:40.588940 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:40.628770 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.629097  1458 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.629665  1458 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.631194  1420 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:40.631852  1420 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.633019 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.633613 30402 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:40.596901  1425 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.634999 30411 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:40.637559 30486 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:40.635361 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:40.603782  1334 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:40.606775  1175 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.642608 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.645165 30481 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:40.645470 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.611428  1447 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:40.585846  1297 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.607264  1291 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:40.622305  1313 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:40.623397  1442 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:40.648082 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 317825us
I20260709 13:10:40.649529 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.650306 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:40.651742 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.651932 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.654343 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.655143 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:40.681624 30560 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:40.660741 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.682071 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:40.662153 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.681501 30481 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:40.682667 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.682842 30485 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:40.683175 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.641422  1334 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.683764 30481 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:40.605978  1343 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.687342 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.611236  1317 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.657907 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.684255 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:40.597834  1439 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.688114 30478 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:40.688727 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.642215  1257 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.663331  1453 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.690244 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.660636  1251 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:40.663972  1452 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:40.648046  1321 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:40.696184 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:40.761317 30410 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:40.761685 30481 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.699045 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.695858 30486 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:40.660336  1222 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.637125  1292 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.694262 30484 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:40.699569  1424 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:40.753752 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.758136 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.643764  1401 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.643540  1425 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.760754 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1671) took 1482 ms. Trace:
I20260709 13:10:40.752112  1451 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.677408  1291 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.767601 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.768334 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:40.779204 30483 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:40.775731 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 173755us
I20260709 13:10:40.774931 30406 rpcz_store.cc:276] 0709 13:10:39.278538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.278731 (+   193us) service_pool.cc:224] Handling call
0709 13:10:39.520362 (+241631us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.530043 (+  9681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.530088 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:39.542469 (+ 12381us) log.cc:844] Serialized 52 byte log entry
0709 13:10:39.839898 (+297429us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:40.280358 (+440460us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.485728 (+205370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.485807 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.520536 (+ 34729us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:40.757059 (+236523us) raft_consensus.cc:1685] finished
0709 13:10:40.760501 (+  3442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.760682 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214333,"prepare.queue_time_us":183205,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":236664,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":5240,"spinlock_wait_cycles":29774080,"thread_start_us":670608,"threads_started":2,"wal-append.queue_time_us":688230}
I20260709 13:10:40.686990  1334 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.768433 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.760776  1449 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.782658 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:40.687261  1442 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:40.809283 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 187133us
I20260709 13:10:40.787503 30486 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:40.764982 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.813670 30403 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:40.813699  1449 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.765201  1362 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:40.756858  1257 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:40.819212 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 190504us
I20260709 13:10:40.816864 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:40.826910 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 221968us
I20260709 13:10:40.831578 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:40.760628  1251 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.818771  1362 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.774680  1222 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.817373  1456 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:40.843713 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 181643us
I20260709 13:10:40.822464   828 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:40.782207  1451 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.853328 30451 leader_election.cc:400] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
I20260709 13:10:40.850113 30374 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:40.859225 30451 leader_election.cc:403] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:40.857093  1253 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:40.770845  1447 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.841744  1362 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.846711  1458 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.876137 30479 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:40.869881 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:40.877691 30481 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:40.848459  1457 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.880782 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49271.6us
I20260709 13:10:40.882242 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:40.872956  1321 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:40.884240  1321 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.884935 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:40.885741  1461 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.886396  1461 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:40.886646 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.876639  1448 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:40.888406  1448 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:40.888814  1448 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:40.890962  1473 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.900693 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 435) took 1031 ms. Trace:
I20260709 13:10:40.916807  1483 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:40.917315  1483 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:40.917773  1483 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:40.920720  1237 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:10:40.921759 30477 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:40.891206 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:40.924736 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:40.891462  1464 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:40.922966 31148 rpcz_store.cc:276] 0709 13:10:39.869604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.869733 (+   129us) service_pool.cc:224] Handling call
0709 13:10:39.876388 (+  6655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.394015 (+517627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.394051 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.454840 (+ 60789us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.655826 (+200986us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:40.655864 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.656577 (+   713us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.900422 (+243845us) raft_consensus.cc:1685] finished
0709 13:10:40.900452 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.900624 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199301,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":28018,"thread_start_us":717744,"threads_started":2,"wal-append.queue_time_us":373552}
I20260709 13:10:40.879984  1297 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:40.879091  1420 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:40.873633  1469 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:40.880419  1471 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.873068  1435 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.940366 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:40.949101  1358 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:40.949460 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1813) took 1280 ms. Trace:
I20260709 13:10:40.950591  1477 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:40.951431  1477 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.954986  1417 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:40.955425  1417 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:40.955806  1417 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.949494  1358 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.959199  1358 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.915665  1401 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.882865  1447 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.941073  1253 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:40.965231  1427 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.374s	user 0.008s	sys 0.013s
I20260709 13:10:40.925323  1317 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.899097  1474 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.897842  1457 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.948689  1488 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.946915  1277 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:40.938838  1237 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:10:40.891294  1439 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.942900 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 95000.7us
I20260709 13:10:40.862769  1468 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:10:40.903244  1475 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
W20260709 13:10:40.937849 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68044.9us
I20260709 13:10:40.938031  1455 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:40.901974  1458 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:10:40.890617  1257 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.970357 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 79230.5us
I20260709 13:10:40.994537 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:40.941725  1343 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:40.961658 30451 connection.cc:256] RPC call timeout handler was delayed by -2.2475338999998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:10:40.977880  1277 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.949842 30551 rpcz_store.cc:276] 0709 13:10:39.669345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.420859 (+751514us) service_pool.cc:224] Handling call
0709 13:10:40.421159 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.425708 (+  4549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.425736 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.454215 (+ 28479us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.643487 (+189272us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:40.643526 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.643589 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.949245 (+305656us) raft_consensus.cc:1685] finished
0709 13:10:40.949265 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.949406 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":828,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":175456,"threads_started":1,"wal-append.queue_time_us":302896}
I20260709 13:10:40.946295  1420 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:40.863648  1456 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.941929  1305 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:10:40.991135 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:41.076215  1334 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.084909  1469 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.085614  1469 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:41.075882 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 150469us
I20260709 13:10:41.089674 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:41.093321 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:41.046557 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.992334 31148 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:40.971896 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 155110us
I20260709 13:10:40.966917  1435 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:40.891433  1473 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:41.003142 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1643) took 2385 ms (client timeout 1838 ms). Trace:
I20260709 13:10:41.006105 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.008919 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.982342  1442 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:40.981323  1292 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:41.011886 30451 connection.cc:256] RPC call timeout handler was delayed by -1.7297007930000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:41.013810  1420 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:41.034062 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.992779  1425 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.059415 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:40.963265  1471 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.011415  1277 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:40.980131  1474 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:40.984124  1488 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.010285  1297 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.046770  1475 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.123484  1222 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.123255  1475 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.125496  1475 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:40.992238 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 110128us
I20260709 13:10:41.098382 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:41.100219 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 109133us
W20260709 13:10:41.102639 30559 rpcz_store.cc:269] 0709 13:10:38.612075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.629275 (+ 17200us) service_pool.cc:224] Handling call
0709 13:10:40.996944 (+2367669us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400339ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:40.997117 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152002432}
I20260709 13:10:41.075831  1486 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:41.087460  1251 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.087513 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.112365  1362 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.100481  1439 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.127194 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.127302 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:41.138180 30451 connection.cc:256] RPC call timeout handler was delayed by -1.1030016199999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:10:41.151357 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:41.152293  1495 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:41.152774  1449 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.142330  1475 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:41.155305  1475 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.155951  1313 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.156256  1435 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.156430  1313 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.156970  1457 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.157316  1475 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.157805  1475 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:41.158927 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:41.161178 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:41.161885 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:41.163014  1493 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.163722  1493 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.164788  1493 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.165510  1457 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.165831  1489 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.166036  1457 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:41.166326  1489 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:41.137919  1486 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.166788  1489 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.167016  1457 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.161707  1291 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.168309  1486 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.097422  1330 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.150324  1439 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.168979  1330 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:41.169257  1439 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.169442  1330 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.140898  1474 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.140687  1456 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:41.175284 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48049.7us
I20260709 13:10:41.164690  1358 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:41.144271 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45953.1us
I20260709 13:10:41.140525  1471 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.174547 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.154721  1473 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:41.182650 30451 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.838s (SENT) [suppressed 4 similar messages]
I20260709 13:10:41.138535  1496 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:41.188980 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.204532 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.204788 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.204958 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.230307 30484 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:41.142423  1483 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.188153  1477 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.196601  1175 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.152801  1495 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:41.174711  1292 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:41.215694  1438 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.989s	user 0.003s	sys 0.000s
I20260709 13:10:41.196764  1343 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.220820 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.221089  1488 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.223999 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1673) took 1931 ms. Trace:
I20260709 13:10:41.224632 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:41.226306 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 126797us
I20260709 13:10:41.222123  1420 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.162364  1277 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.186022  1475 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:41.211541  1448 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.138934  1417 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:41.247591 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 143362us
I20260709 13:10:41.196380  1401 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:41.261271 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.301347 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.303248 30479 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:41.273885  1292 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.303342 30407 rpcz_store.cc:276] 0709 13:10:39.292376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.292539 (+   163us) service_pool.cc:224] Handling call
0709 13:10:39.312694 (+ 20155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.342993 (+ 30299us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:39.870513 (+527520us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.627603 (+757090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.627651 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.627694 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.223758 (+596064us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b540036ea54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:41.223804 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.223932 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69316,"prepare.queue_time_us":525547,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":15984,"raft.queue_time_us":325,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":69013760,"thread_start_us":1105522,"threads_started":2,"wal-append.queue_time_us":666756}
I20260709 13:10:41.304769 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.228596  1496 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.306669  1496 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.305299 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.245123  1489 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.265146  1495 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:41.305294 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.313328 31148 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:41.264923 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.314477 30480 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:10:41.310310 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85831.9us
I20260709 13:10:41.243872  1471 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:41.329864  1448 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.330519  1362 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.241423  1313 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.306599  1343 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.331617  1277 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.519598 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.412882 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.519104 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:41.507598 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 195668us
I20260709 13:10:41.525790 30406 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.518153  1483 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.463129  1442 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.308568  1401 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.520016 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.524863 30409 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:41.331738  1330 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.533331  1330 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.332218 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.521862  1237 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:41.534847  1237 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:41.344095  1422 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.719s	user 0.010s	sys 0.002s
I20260709 13:10:41.538030  1237 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.529081 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.539875 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.529906  1313 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.392216 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.526947  1442 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.484680  1477 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.520372 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.541227 30402 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:41.529949  1401 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.541110  1477 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.542217 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.539665 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.520589 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.311654  1488 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.543097 30404 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:41.542410 30478 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.273466  1334 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.297705  1358 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.545065 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:41.544277 30477 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:41.545768 30402 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:41.539976 30485 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:41.448740 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 266085us
I20260709 13:10:41.484678 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.543933 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.540673 30409 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:41.531478  1343 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.551846  1477 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.553400 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:41.553854 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.555105 30409 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:41.556174 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.556731  1456 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:41.565301 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.568584 30477 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:41.307870  1180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.550s	user 0.024s	sys 0.010s
I20260709 13:10:41.339495 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:41.574295  1418 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.884s	user 0.016s	sys 0.007s
W20260709 13:10:41.575693 30557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1806) took 3153 ms (client timeout 2347 ms). Trace:
W20260709 13:10:41.576103 30557 rpcz_store.cc:269] 0709 13:10:38.422515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.424174 (+  1659us) service_pool.cc:224] Handling call
0709 13:10:41.575464 (+3151290us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54000389d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:41.575625 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4542752000}
I20260709 13:10:41.578233 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.611058 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.611886 30486 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:41.509572 30480 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:41.560820 30485 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.562141 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:41.562276 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:41.509732 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 322027us
I20260709 13:10:41.563650  1420 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:41.564101  1412 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 2.443s	user 0.026s	sys 0.023s
I20260709 13:10:41.565582  1456 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.580497  1358 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.559996  1448 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.572805  1488 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:41.590679  1334 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:41.602622  1428 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.919s	user 0.002s	sys 0.009s
I20260709 13:10:41.637494 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.336144  1292 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.339210  1469 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.636534 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:10:41.622911  1180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.875s	user 0.035s	sys 0.014s
I20260709 13:10:41.657348  1506 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:41.658187  1506 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.658996 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.659950 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.660727  1334 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:41.661108  1334 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.661444  1334 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.661653  1180 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.662443  1180 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:41.631152  1115 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:41.663084  1115 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.663491  1115 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.663767  1180 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.666873  1313 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:41.667464  1313 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:41.667618  1506 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.668285  1313 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.277012  1175 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.671799 30405 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:41.673434  1175 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.675124  1456 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.675370 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1682) took 1162 ms. Trace:
I20260709 13:10:41.676332 30525 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:41.677197  1506 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.677940  1506 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.678642  1506 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.680088  1496 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.682314  1496 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.635277  1358 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.684727  1358 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.686605  1495 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.688719  1495 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.688589  1506 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:41.604813 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 608422us
I20260709 13:10:41.607726  1489 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.608597  1442 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.692409  1451 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.692524 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 294) took 2839 ms. Trace:
I20260709 13:10:41.615651 30477 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:41.675973 30410 rpcz_store.cc:276] 0709 13:10:40.513408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.534261 (+ 20853us) service_pool.cc:224] Handling call
0709 13:10:41.675157 (+1140896us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400285fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:41.675296 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356996480}
I20260709 13:10:41.616336 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:41.619164 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57145.2us
I20260709 13:10:41.693692 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.616974 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.695591 30480 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:41.624083 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.696463 30486 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:41.557473 30406 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:41.603528  1477 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:41.332302  1417 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:41.703248 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.675199 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1678) took 1163 ms. Trace:
I20260709 13:10:41.691186 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1634) took 3081 ms. Trace:
I20260709 13:10:41.704062 30403 rpcz_store.cc:276] 0709 13:10:40.512164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.570977 (+ 58813us) service_pool.cc:224] Handling call
0709 13:10:41.674988 (+1104011us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54001293d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:41.675122 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464739712}
I20260709 13:10:41.691267 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 1972) took 1346 ms. Trace:
I20260709 13:10:41.692770 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.705260 30408 rpcz_store.cc:276] 0709 13:10:40.344637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.349647 (+  5010us) service_pool.cc:224] Handling call
0709 13:10:41.691054 (+1341407us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b5400287dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:41.691195 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124544384}
I20260709 13:10:41.706049 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.704136 30477 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:41.707413 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:41.694815 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:41.708678 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:41.709450 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 197166us
I20260709 13:10:41.692960 31153 rpcz_store.cc:276] 0709 13:10:38.852912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.853937 (+  1025us) service_pool.cc:224] Handling call
0709 13:10:38.854275 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:38.854618 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.854650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:38.855221 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 13:10:39.262787 (+407566us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.262835 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.262909 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.573697 (+2310788us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:41.692229 (+118532us) raft_consensus.cc:1685] finished
0709 13:10:41.692249 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.692441 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":713,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":316867968,"thread_start_us":407155,"threads_started":1,"wal-append.queue_time_us":800695}
I20260709 13:10:41.704161 30558 rpcz_store.cc:276] 0709 13:10:38.609572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.611983 (+  2411us) service_pool.cc:224] Handling call
0709 13:10:38.623122 (+ 11139us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:38.623612 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:38.623642 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:38.635111 (+ 11469us) log.cc:844] Serialized 52 byte log entry
0709 13:10:38.874290 (+239179us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:38.874411 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.874562 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.563433 (+2688871us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:41.690886 (+127453us) raft_consensus.cc:1685] finished
0709 13:10:41.690907 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.691108 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":492,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10240,"spinlock_wait_cycles":27048704,"thread_start_us":160747,"threads_started":1,"wal-append.queue_time_us":290083}
I20260709 13:10:41.712881 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:41.339184  1474 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.334347  1439 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.632045 30479 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:41.604367 30478 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:41.701046 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:41.699838 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:41.702677 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86435.5us
I20260709 13:10:41.714241 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.715000 30477 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:41.716398 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:41.753396 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 53634.4us
I20260709 13:10:41.753772 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.756543 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.754204 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.758038 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.759840 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:41.760039 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:41.760437 30480 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:41.760596 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46561.4us
I20260709 13:10:41.760963 31151 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 6.
I20260709 13:10:41.635222  1448 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.725386 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:41.761361 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.764555 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:41.718493 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.718796  1222 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:41.770146 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 243885us
W20260709 13:10:41.770673 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45374.4us
I20260709 13:10:41.768872 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.776520 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.777002 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.766880 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.779968 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:41.781985 30480 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:41.717710  1442 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.718961  1426 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.791426 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:41.764137  1495 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.788381 31149 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:41.717437  1457 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.792773 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:41.765836  1343 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.793092  1473 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.787565 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.334991  1475 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.706532  1488 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.763301  1321 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.762962  1260 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.756393  1500 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:41.769908  1420 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.765856  1175 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.708763  1471 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:41.775709  1401 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.775766  1222 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.789095  1330 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.863396  1473 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:41.789252  1483 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.819588 30406 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:41.758210  1474 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.818819  1435 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.827556  1451 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.830556  1469 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:41.852196 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64730.3us
I20260709 13:10:41.791484  1268 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:10:41.859750  1499 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:41.846895  1343 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:41.862325  1496 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.859153  1321 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:41.861860  1260 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.874961  1420 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:41.876200  1330 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:41.861181  1500 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:41.862742  1175 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.876080  1222 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.883518 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:41.927728 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44319.3us
I20260709 13:10:41.910575  1260 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.862646  1512 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.877532  1483 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:41.873924  1473 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.891358  1343 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.899080  1321 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.864562  1479 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:10:41.928844 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:41.911275  1499 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:41.886536  1451 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.923596  1500 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:41.967259 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 143487us
I20260709 13:10:41.926144  1330 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.926765  1175 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.976634 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.934043  1358 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:41.983188 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:41.938812  1506 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.934643  1512 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:42.021960 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.022264 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:42.022712 30402 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:42.022825 30410 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.024117 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.025182 30402 raft_consensus.cc:2410] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:42.020747 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:42.028995 30406 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.030766  1265 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:41.975492  1256 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.988277  1512 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.034966  1256 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.035406  1256 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.059159 30410 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:42.066710  1395 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:42.067250  1395 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:42.067384  1517 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:42.068132  1395 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.068066  1115 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.069010  1474 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.987635  1268 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:42.071358  1497 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:42.072242  1395 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:42.078800 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.082568  1456 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.083128  1456 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.085172  1456 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.085628  1456 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.086022  1456 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:41.934751  1471 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.982605  1439 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.092540  1451 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.093348  1499 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:41.990664  1448 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:41.966651  1334 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.096704  1334 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.030435  1488 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:41.990356  1420 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.100302  1483 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.061661 30406 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:42.140184 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 378210us
W20260709 13:10:42.146883 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 366977us
I20260709 13:10:42.147399  1495 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:42.206450 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56065.2us
I20260709 13:10:42.194957  1115 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.205325 30450 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:42.195688  1451 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:10:42.217805 30408 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:42.212906 30406 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:42.224654 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.227453 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.229570 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.230182 31148 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.230337 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.231513 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.232761 30551 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:42.233348 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:42.231391 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.233995 30404 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.209601  1442 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:42.237699 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.210171  1313 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:42.236382 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.238641 30557 raft_consensus.cc:2368] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:42.238966 30560 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:42.239580 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:42.239825 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.240037 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.236886 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.240566 30552 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:42.237524 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:42.240545 30410 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.242815 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.241227 30551 raft_consensus.cc:2368] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8.
I20260709 13:10:42.243551  1321 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.246101 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.246999 30409 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.248214 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.249856  1512 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:42.251269  1518 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:42.253216 30559 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.254846 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.255857 30403 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.256606 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.256944 30559 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:42.259785 30404 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:42.222738  1489 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:42.274821  1495 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.277328  1256 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.278419 30552 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:42.280324 30407 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.289445  1330 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.298508  1426 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:42.299439 30558 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.234776  1456 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.272197  1442 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.306803 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1903) took 1086 ms. Trace:
I20260709 13:10:42.307201 30484 rpcz_store.cc:276] 0709 13:10:41.220056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.272833 (+1052777us) service_pool.cc:224] Handling call
0709 13:10:42.306292 (+ 33459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.306478 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.306504 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.306545 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.306576 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.306628 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.306746 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.310029 30558 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:42.316879 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1825) took 2619 ms. Trace:
I20260709 13:10:42.277935  1260 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:42.325726 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 114591us
I20260709 13:10:42.302498  1401 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:42.356843 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.317380 30554 rpcz_store.cc:276] 0709 13:10:39.697033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.426453 (+729420us) service_pool.cc:224] Handling call
0709 13:10:40.426926 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:40.427422 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:40.474359 (+ 46937us) log.cc:844] Serialized 14 byte log entry
0709 13:10:41.677094 (+1202735us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b1800464140. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:10:42.170969 (+493875us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.171215 (+   246us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:42.215355 (+ 44140us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.220470 (+  5115us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:42.220531 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.220638 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.316652 (+ 96014us) raft_consensus.cc:1685] finished
0709 13:10:42.316676 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.316813 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":464887,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":281,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":47843,"spinlock_wait_cycles":13385600,"thread_start_us":493209,"threads_started":2,"wal-append.queue_time_us":1483078}
I20260709 13:10:42.360106 31148 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:42.359308 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.362064 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.363808 30409 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.363884 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:42.362339 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.363134 30557 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:42.232843  1469 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:42.366809 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.365729 31146 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:10:42.258999  1458 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:42.305997  1343 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.371001 30557 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:42.301954  1222 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.369817 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.372682 30407 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:42.373543 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.374069 30408 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:42.382499 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.378634  1248 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:42.319191  1313 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.439800 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.814457 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:42.815348 30482 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:42.456486 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.389303 30484 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:42.630519 30479 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.444506 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.811650 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.812282 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.383636 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.852123 31146 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:42.858132 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.905140 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.364261  1260 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.427546 30410 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:42.860706 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.847086 30483 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:42.914067 30556 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:42.506399 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:42.864995 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.457602 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:42.387804 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1902) took 1168 ms. Trace:
I20260709 13:10:42.915117 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:42.916182 30555 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:39.124002 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.459179 30525 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:42.916810 30483 raft_consensus.cc:2368] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
W20260709 13:10:42.917081 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 457956us
W20260709 13:10:42.570261 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.917670 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:42.437259  1447 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:42.918962 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.922909  1447 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.923352  1512 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.923636 30556 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.924453 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.924589 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.925267  1447 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.925527 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.926141 30556 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.377419  1237 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:42.931850 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:42.893335  1248 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.882869 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.902657 30551 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.457908 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.906064 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 553) took 1190 ms. Trace:
I20260709 13:10:42.938055 30558 rpcz_store.cc:276] 0709 13:10:41.715774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.716168 (+   394us) service_pool.cc:224] Handling call
0709 13:10:42.905917 (+1189749us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54002463d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:42.906016 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253032320}
I20260709 13:10:42.938588 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.939800 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.940065 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.940608 30558 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:42.941457 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.941735 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.386958 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:42.388603  1510 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.463s	user 0.001s	sys 0.000s
W20260709 13:10:42.437902  1515 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.647s	user 0.000s	sys 0.017s
W20260709 13:10:42.448168  1535 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:42.910084 30557 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:42.375800  1458 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.961330 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.911474 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:42.963564 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52157.8us
I20260709 13:10:42.915087 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:42.915092 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.919207 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.966545 30556 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:42.485666  1222 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:42.969378 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:42.493156  1469 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.969879 30479 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:42.970486  1248 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.970999 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.947636  1530 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:42.971730  1530 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:42.972026 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.972604 30557 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:42.972616  1530 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.973404 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.922072  1313 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.566006  1265 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:42.439383  1256 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:42.654724 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.927240 30403 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:42.916240 30481 rpcz_store.cc:276] 0709 13:10:41.219799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.763604 (+543805us) service_pool.cc:224] Handling call
0709 13:10:41.763911 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.764260 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.764289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.784870 (+ 20581us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.966781 (+181911us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b18000a4440. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:42.221809 (+255028us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:42.221872 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.221984 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.387489 (+165505us) raft_consensus.cc:1685] finished
0709 13:10:42.387509 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.387740 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1491,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6025,"spinlock_wait_cycles":10410880,"thread_start_us":254803,"threads_started":1,"wal-append.queue_time_us":593826}
I20260709 13:10:42.979406 30481 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:42.980038 30479 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:42.980594 30481 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:42.927649 30482 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:42.928077 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.619778 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.936442 30483 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:42.845786  1330 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:42.948585 30558 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.364464  1500 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.994997  1368 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:42.995563  1500 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:42.995712  1368 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.952452 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:43.009815 30551 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:43.010393  1368 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:42.959966 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 573085us
I20260709 13:10:42.913427  1499 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:42.475721  1175 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:42.967406 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:42.967942 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:42.969206 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.975440 30557 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:43.017686 30556 raft_consensus.cc:2410] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:10:42.981882 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.018594 30403 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:10:43.019637 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.983605 30555 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:42.984086 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:42.988193 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:42.989192 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:42.968729  1458 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.977373  1265 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:42.993218 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:43.026358 30558 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:42.974999  1313 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:42.954871  1237 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:42.960943  1447 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:42.999011 31153 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:43.004779  1248 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:43.007141 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:42.910260 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:42.976462  1321 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.027081 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.351590 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:43.330776 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 179151us
I20260709 13:10:43.025704  1368 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:43.352267 30404 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:43.105580 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:43.355212 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 367120us
W20260709 13:10:43.355921 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.146797 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.103459 30560 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:43.044759 30411 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:43.382558 30357 placement_policy_util.cc:248] tablet 2e1b5d40df944767ab310e2bd822d5b0: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:10:43.414469 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.463708 30404 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:43.417265 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:43.465268 30403 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:43.438541 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:43.424714 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1698) took 1055 ms. Trace:
I20260709 13:10:43.467314 30407 rpcz_store.cc:276] 0709 13:10:42.368691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.105260 (+736569us) service_pool.cc:224] Handling call
0709 13:10:43.424387 (+319127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.440085 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.449860 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1699) took 1075 ms. Trace:
I20260709 13:10:43.469975 30409 rpcz_store.cc:276] 0709 13:10:42.374383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.909528 (+535145us) service_pool.cc:224] Handling call
0709 13:10:43.449784 (+540256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:43.411774 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58271.6us
W20260709 13:10:43.104022  1449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.034s	sys 0.052s
I20260709 13:10:43.488054 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:43.469213 30486 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:43.452569 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 445525us
I20260709 13:10:43.494184 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:43.495841 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1672) took 1043 ms. Trace:
I20260709 13:10:43.496241 30559 rpcz_store.cc:276] 0709 13:10:42.452316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.486147 (+1033831us) service_pool.cc:224] Handling call
0709 13:10:43.495328 (+  9181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.495524 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.495561 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.495600 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.495629 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.495679 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.495788 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.496810 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.497421 30404 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:43.498391 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.500207 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.501181 30409 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:43.505854 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.506631 30403 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:43.507701 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.508409 30403 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:43.509764 30478 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:43.018750  1451 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.434s
I20260709 13:10:43.065560  1442 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:43.524375 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.526789 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.520871 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.529773 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.528486 30404 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:43.496018  1449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.042s	sys 0.068s
I20260709 13:10:43.019250  1499 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.438524  1313 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:43.486835  1321 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.497793  1506 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:43.571909 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1837) took 1310 ms. Trace:
I20260709 13:10:43.572191 30559 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.545019  1175 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.573664 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.573758 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.574582 30408 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:43.547403 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1684) took 1303 ms. Trace:
I20260709 13:10:43.574666 30486 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:43.572321 30552 rpcz_store.cc:276] 0709 13:10:42.261402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.261561 (+   159us) service_pool.cc:224] Handling call
0709 13:10:42.261912 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.278834 (+ 16922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.571681 (+1292847us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400186354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:43.571853 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37487360}
I20260709 13:10:43.575848 30410 rpcz_store.cc:276] 0709 13:10:42.244201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.244385 (+   184us) service_pool.cc:224] Handling call
0709 13:10:42.244754 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.913880 (+669126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.547164 (+633284us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400122854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:43.547341 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419716480}
I20260709 13:10:43.577649 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1697) took 1228 ms. Trace:
I20260709 13:10:43.549722 30557 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:43.578002 30408 rpcz_store.cc:276] 0709 13:10:42.348901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.573378 (+1224477us) service_pool.cc:224] Handling call
0709 13:10:43.577593 (+  4215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.560103 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 2029) took 1179 ms. Trace:
I20260709 13:10:43.578855 30478 rpcz_store.cc:276] 0709 13:10:42.381362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.382172 (+   810us) service_pool.cc:224] Handling call
0709 13:10:43.559928 (+1177756us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002111d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:43.560043 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590495104}
I20260709 13:10:43.562848  1425 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.563225  1534 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.541s	user 0.000s	sys 0.001s
I20260709 13:10:43.565135 30560 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:43.585296 30559 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:43.567224  1442 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.521442  1522 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:10:43.485910  1368 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:43.570657 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.554584 30558 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:43.598364 30403 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:43.417249  1248 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.583658 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1668) took 1132 ms. Trace:
I20260709 13:10:43.600961 30557 rpcz_store.cc:276] 0709 13:10:42.451008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.549137 (+1098129us) service_pool.cc:224] Handling call
0709 13:10:43.549485 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.583274 (+ 33789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.583587 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.064608  1343 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.454536  1447 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:43.572626  1449 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.595894 30374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.008s
I20260709 13:10:43.531924 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:43.613830  1420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.013s
I20260709 13:10:43.615850  1442 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:43.594810 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:43.617147  1420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.013s
I20260709 13:10:43.617399  1442 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.617939  1420 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:43.598518 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1675) took 1145 ms. Trace:
I20260709 13:10:43.618777 30558 rpcz_store.cc:276] 0709 13:10:42.453189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.161929 (+708740us) service_pool.cc:224] Handling call
0709 13:10:43.554120 (+392191us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:43.554335 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.598194 (+ 43859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.598445 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8510336}
I20260709 13:10:43.619465  1442 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:43.605470 30408 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:43.617091 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 85270.3us
I20260709 13:10:43.606559 30410 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:43.622375 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:43.616523 30374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.013s	sys 0.009s
W20260709 13:10:43.597396  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.010s
W20260709 13:10:43.610472 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.010s
I20260709 13:10:43.583691  1506 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.627205 30405 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:43.627188 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.012s	sys 0.010s
W20260709 13:10:43.609122  1469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.006s	sys 0.015s
W20260709 13:10:43.631681 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.014s
W20260709 13:10:43.633358 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.015s
I20260709 13:10:43.632697 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:43.598996  1486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.002s	sys 0.018s
I20260709 13:10:43.609472  1175 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.626902  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.010s
I20260709 13:10:43.596323  1480 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:43.645876 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:43.591099  1425 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.596982  1453 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:43.616144  1447 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:43.613684  1330 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:43.664251 30481 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:10:43.629554  1541 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 13:10:43.639850 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:43.643862 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:43.629606  1495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.008s	sys 0.017s
W20260709 13:10:43.630118  1469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.015s
I20260709 13:10:43.644734 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:43.646780 30477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.019s	sys 0.053s
I20260709 13:10:43.677074 30484 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:43.677441 30477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.019s	sys 0.053s
I20260709 13:10:43.646519 30553 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.644084  1343 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.644728  1486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.002s	sys 0.018s
I20260709 13:10:43.634542  1420 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.660483 30557 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:43.642551  1442 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:43.662282 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:43.630321  1449 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.662027 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:43.639737  1451 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:43.675861 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:43.677002 31151 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:43.650616 31146 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:43.658985 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.702736 30482 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.692304  1343 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.703275  1442 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:43.703864  1442 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.704988  1343 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.705808  1442 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:43.654212  1490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.024s	sys 0.034s
W20260709 13:10:43.706627  1490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.024s	sys 0.034s
I20260709 13:10:43.707074  1490 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:43.707429  1490 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:43.708271  1490 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.709319  1490 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:43.680251  1495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.008s	sys 0.017s
I20260709 13:10:43.668347 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:43.711186 30406 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:43.712335 30482 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:43.713308 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.714419 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.715452 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.722334 30523 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:43.722841  1489 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:43.724190  1489 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:43.724323 30523 leader_election.cc:400] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:43.724803 30523 leader_election.cc:403] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.724706  1489 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:43.725382  1489 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:43.724822 30482 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:43.683496 30309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 196) took 16728 ms (client timeout 15000 ms). Trace:
I20260709 13:10:43.705892 30481 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:43.691095 30402 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:43.634673  1313 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.680251  1330 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.696322 30553 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:43.659912  1401 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:43.697783 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.734419 30486 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.646255  1175 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.731009 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:43.735620 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1839) took 1472 ms. Trace:
I20260709 13:10:43.736795 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:43.740028 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 387) took 1368 ms. Trace:
I20260709 13:10:43.740514 30480 rpcz_store.cc:276] 0709 13:10:42.371869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.372775 (+   906us) service_pool.cc:224] Handling call
0709 13:10:42.373106 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.378990 (+  5884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.379039 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.379604 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.686012 (+306408us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:42.686072 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.686173 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.739787 (+1053614us) raft_consensus.cc:1685] finished
0709 13:10:43.739814 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.739961 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5468,"raft.queue_time_us":10535,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":306021,"threads_started":1,"wal-append.queue_time_us":596010}
I20260709 13:10:43.695863  1420 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.745437 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:43.738917 30553 rpcz_store.cc:276] 0709 13:10:42.262783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.262932 (+   149us) service_pool.cc:224] Handling call
0709 13:10:43.645744 (+1382812us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:43.735547 (+ 89803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786112}
W20260709 13:10:43.730875  1536 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:43.737632  1401 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.699967  1469 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.727620 30309 rpcz_store.cc:269] 0709 13:10:26.949865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.954827 (+  4962us) service_pool.cc:224] Handling call
0709 13:10:43.678128 (+16723301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:36.201352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.239790 (+ 38438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.239869 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:10:36.239888 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:36.241826 (+  1938us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.241905 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.241941 (+    36us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:10:36.311088 (+ 69147us) tablet.cc:701] Row locks acquired
0709 13:10:36.311139 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:10:36.311313 (+   174us) write_op.cc:270] Start()
0709 13:10:36.311460 (+   147us) write_op.cc:276] Timestamp: P: 1783602636311249 usec, L: 0
0709 13:10:36.311482 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.316833 (+  5351us) log.cc:844] Serialized 7064 byte log entry
0709 13:10:36.842626 (+525793us) op_driver.cc:464] REPLICATION: finished
0709 13:10:37.068759 (+226133us) write_op.cc:301] APPLY: starting
0709 13:10:37.068862 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:37.069275 (+   413us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:37.069418 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:37.108703 (+ 39285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:37.109203 (+   500us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:10:37.109257 (+    54us) write_op.cc:312] APPLY: finished
0709 13:10:37.109762 (+   505us) log.cc:844] Serialized 125 byte log entry
0709 13:10:37.109984 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.110157 (+   173us) write_op.cc:454] Released schema lock
0709 13:10:37.110234 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:37.124705 (+ 14471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.125448 (+   743us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3209953,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":185483,"apply.run_cpu_time_us":5367,"apply.run_wall_time_us":50885,"num_ops":18,"prepare.queue_time_us":270862,"prepare.run_cpu_time_us":34096,"prepare.run_wall_time_us":321852,"raft.queue_time_us":203683,"raft.run_cpu_time_us":32390,"raft.run_wall_time_us":114792,"replication_time_us":530972,"thread_start_us":594825,"threads_started":4,"wal-append.queue_time_us":142409,"wal-append.run_cpu_time_us":20667,"wal-append.run_wall_time_us":1651223}]]}
I20260709 13:10:43.660549  1368 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.753417  1420 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.766916  1469 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.769549  1469 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.760843 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.734308  1260 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:43.777194  1175 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.744164  1442 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:10:43.786012 30484 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:43.779050 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.788794 30482 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:43.766451  1330 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:43.796847 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.807567 30482 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.791787 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:43.774982  1451 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:43.774771  1499 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:43.797452 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.775718  1469 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:43.786402 30486 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:43.780279  1260 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:43.801465 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.793051  1453 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:10:43.813185  1248 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.837582  1330 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.880431 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.844962  1237 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:43.896668 30484 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:43.892581  1425 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.892724 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.890307 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.961980 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:43.963274 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1846) took 1608 ms (client timeout 1588 ms). Trace:
I20260709 13:10:43.963336 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.877760  1550 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:10:43.964323 30486 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:43.885340  1451 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:43.961757 30481 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:10:43.895648  1458 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.002s
I20260709 13:10:43.940882 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:43.971190 30486 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:43.979211 30486 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:43.976619 30484 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:43.985028 30484 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:44.023885 30484 pending_rounds.cc:85] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 4
I20260709 13:10:44.024865 30484 pending_rounds.cc:107] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:43.902350  1469 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:43.893802  1548 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.991648 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2002) took 1765 ms. Trace:
I20260709 13:10:43.989179  1458 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.961045  1237 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:43.980397 30486 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:43.997362  1265 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:43.967876  1467 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:44.021438  1401 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:43.901358  1330 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.007373 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.008090 30558 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:44.008054 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.009902 30559 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:44.009987 30557 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:44.011118 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 406590us
W20260709 13:10:44.012079 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 409701us
I20260709 13:10:44.013314 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2004) took 1777 ms. Trace:
I20260709 13:10:44.059887 30485 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:44.063230 30411 rpcz_store.cc:276] 0709 13:10:42.235884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.236216 (+   332us) service_pool.cc:224] Handling call
0709 13:10:42.236513 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.448725 (+1212212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.013015 (+564290us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003eec54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:44.013253 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823576960}
I20260709 13:10:44.064811 30553 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.065647 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.066540 30411 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 5.
I20260709 13:10:44.067898 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:43.974792 30554 rpcz_store.cc:269] 0709 13:10:42.355293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.359962 (+  4669us) service_pool.cc:224] Handling call
0709 13:10:43.961773 (+1601811us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:43.963190 (+  1417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234176}
I20260709 13:10:44.071316 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.025499 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.073575 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.026022 30484 raft_consensus.cc:2889] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.027168 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.027774 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:44.075773 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 427570us
I20260709 13:10:43.992816 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1687) took 1746 ms. Trace:
I20260709 13:10:44.044561 30486 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.076354 30402 rpcz_store.cc:276] 0709 13:10:42.246504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.247017 (+   513us) service_pool.cc:224] Handling call
0709 13:10:42.247279 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.730116 (+1482837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.992514 (+262398us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002f6cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:43.992736 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306952064}
I20260709 13:10:44.000584 30482 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:44.077519 30553 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:43.995834  1260 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.073727 30403 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:44.026360 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.087688 30405 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:10:44.034401 30406 rpcz_store.cc:276] 0709 13:10:42.226753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.227315 (+   562us) service_pool.cc:224] Handling call
0709 13:10:42.227720 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.711555 (+1483835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.991363 (+279808us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003ee754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:43.991576 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411313024}
I20260709 13:10:44.079056 30482 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.033089  1499 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:44.071818 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.086484 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:44.080022 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 334682us
I20260709 13:10:44.091372 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:43.985879 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.081663 30411 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:44.082036 30554 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:44.092779 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 107021us
I20260709 13:10:44.078382 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.093606 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.094743 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.095432 30406 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:44.093448 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:44.094765 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.097795 30451 leader_election.cc:400] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:44.098201 30451 leader_election.cc:403] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:44.099584 30484 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.100484 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:44.101791 30409 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.023s
W20260709 13:10:44.102103 30409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.007s	sys 0.023s
I20260709 13:10:44.121622 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.096705 30411 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:44.124812 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.128858 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:44.130903 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 265748us
I20260709 13:10:44.133455 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.137742 30408 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:44.135078 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.144680 30553 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:44.084789 30486 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:44.088104 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:44.147046 30558 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.148093 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.148875 30486 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:44.124297  1248 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:44.128674  1265 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.131567  1550 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:44.056715  1237 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.152051 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.153537 30486 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.157907 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.161213 30553 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:44.161580 30486 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:44.162811 30486 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.164052 30486 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.141695  1260 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.173635 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.142892  1368 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:44.124457  1548 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:44.143244  1557 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:44.186930 30558 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:44.192517 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:44.155426  1248 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:44.195767 30557 raft_consensus.cc:2368] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:10:44.160415  1566 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8.
I20260709 13:10:44.176723  1425 raft_consensus.cc:2764] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:10:44.204553  1549 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:10:44.205577  1573 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:44.207557  1573 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.211210  1570 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:44.212040  1570 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.219024  1572 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.219725  1570 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:44.221482  1458 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:44.222295  1554 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:10:44.183977  1368 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:10:44.200232  1546 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:10:44.196348  1564 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.239409  1449 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.199067  1248 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.158794  1469 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.236119  1467 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.244086  1564 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:44.262456  1564 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.262943  1550 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.264029  1564 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.264559  1550 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:44.295341 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 160096us
I20260709 13:10:44.300230 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.302064 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.309252 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1714) took 1305 ms. Trace:
I20260709 13:10:44.310477 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:44.311178 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 222245us
I20260709 13:10:44.312072 30411 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.312407 30408 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:44.313596 30450 leader_election.cc:336] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.871s (SENT)
W20260709 13:10:44.314754 30450 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.965s (SENT)
I20260709 13:10:44.319165 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:44.319916 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.320055 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.320622 30450 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.309881 30404 rpcz_store.cc:276] 0709 13:10:43.003957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.533434 (+529477us) service_pool.cc:224] Handling call
0709 13:10:43.533806 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.534164 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.534190 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.571305 (+ 37115us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.047204 (+475899us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:44.047242 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.047304 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.308278 (+260974us) raft_consensus.cc:1685] finished
0709 13:10:44.308372 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.308858 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17804,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":421022,"threads_started":1,"wal-append.queue_time_us":598011}
I20260709 13:10:44.330799 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2033) took 1678 ms. Trace:
I20260709 13:10:44.331300 30477 rpcz_store.cc:276] 0709 13:10:42.652474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.652661 (+   187us) service_pool.cc:224] Handling call
0709 13:10:42.653130 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:42.653631 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:42.887787 (+234156us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.677851 (+790064us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.678575 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:10:43.678752 (+   177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:43.678797 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.678887 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.330116 (+651229us) raft_consensus.cc:1685] finished
0709 13:10:44.330161 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.330497 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172155,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":61827,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":73380,"thread_start_us":923874,"threads_started":2,"wal-append.queue_time_us":1086428}
I20260709 13:10:44.322896 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.307466 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:44.359045 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 126146us
I20260709 13:10:44.360373  1237 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:44.362546  1447 consensus_meta.cc:287] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:10:44.384256  1330 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:44.385720 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.386601 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.387272 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.388962  1506 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.391228  1447 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.391876  1481 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.392634  1481 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:44.416133  1566 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:44.416949  1566 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:44.417732  1566 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.419319  1321 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:44.420189  1321 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:44.420514 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 287020us
I20260709 13:10:44.420701  1321 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:44.421989 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 340618us
I20260709 13:10:44.422333  1467 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.423177  1343 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.424274  1343 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.422205 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.419315  1447 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.428567  1237 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:44.429315  1401 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:44.422019 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 99451.3us
I20260709 13:10:44.420629  1557 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:44.436450  1175 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:44.441108  1591 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.428460  1425 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:44.435904 30558 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.463047  1343 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.429921  1401 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.427381  1467 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:44.474980 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 167933us
I20260709 13:10:44.475735  1330 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.476234  1330 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.476663  1330 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:44.470153 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44892.2us
I20260709 13:10:44.484320  1449 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:44.487372  1313 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:10:44.487862  1449 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.489436  1595 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:44.489918 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68000us
I20260709 13:10:44.491247 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.465193  1557 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:44.496357  1175 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:44.497617 30553 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:44.499068  1175 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.471318  1401 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.503104 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1713) took 1493 ms. Trace:
I20260709 13:10:44.502977  1588 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:44.504460  1591 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.511861  1588 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.505728 30409 rpcz_store.cc:276] 0709 13:10:43.003645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.530430 (+526785us) service_pool.cc:224] Handling call
0709 13:10:43.530660 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.530915 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:44.102419 (+571504us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.378208 (+275789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.403179 (+ 24971us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:44.430447 (+ 27268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.468487 (+ 38040us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.496738 (+ 28251us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":678903,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":124650,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":253,"thread_start_us":845082,"threads_started":3,"wal-append.queue_time_us":140060}
I20260709 13:10:44.512301  1588 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:44.513721  1591 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.515177 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1667) took 2051 ms. Trace:
I20260709 13:10:44.485071 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:44.493335 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 302133us
I20260709 13:10:44.521425  1602 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:10:44.530995  1522 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.531602  1522 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:44.531967  1451 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.503290  1481 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.534575  1481 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.515719 30551 rpcz_store.cc:276] 0709 13:10:42.450498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.031753 (+581255us) service_pool.cc:224] Handling call
0709 13:10:43.032129 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.360063 (+327934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.360108 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.417956 (+ 57848us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.023992 (+606036us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:44.024033 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.024107 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.410202 (+386095us) raft_consensus.cc:1685] finished
0709 13:10:44.427622 (+ 17420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.501931 (+ 74309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767,"raft.queue_time_us":420735,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17966,"thread_start_us":483175,"threads_started":1,"wal-append.queue_time_us":688028}
I20260709 13:10:44.542986  1451 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.545166  1442 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.545660  1442 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:44.546017  1442 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.537886 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 563) took 1536 ms. Trace:
I20260709 13:10:44.546933 30560 rpcz_store.cc:276] 0709 13:10:43.001036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.585989 (+584953us) service_pool.cc:224] Handling call
0709 13:10:43.586264 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.641709 (+ 55445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.641739 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.641777 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:43.641812 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.537333 (+895521us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54002468d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:44.537403 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.537646 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127099264}
I20260709 13:10:44.497017  1557 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.513805  1588 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:44.562551 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55911.4us
I20260709 13:10:44.563735  1237 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.587788  1594 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:10:44.589063  1594 consensus_queue.cc:1243] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:44.519446  1425 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:44.591817 30308 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 5 to 6, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.524608  1368 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.594046  1368 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.627327 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1680) took 2172 ms. Trace:
I20260709 13:10:44.625113 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.627887 30556 rpcz_store.cc:276] 0709 13:10:42.454563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.158967 (+704404us) service_pool.cc:224] Handling call
0709 13:10:43.452911 (+293944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.453175 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:44.005651 (+552476us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.625735 (+620084us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.626375 (+   640us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.626629 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.626731 (+   102us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:44.626822 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.626939 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.627150 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":783068,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":142,"raft.queue_time_us":29476,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":422,"spinlock_wait_cycles":4480,"thread_start_us":915657,"threads_started":3,"wal-append.queue_time_us":202876}
W20260709 13:10:44.641817  1420 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.006s
I20260709 13:10:44.642441  1420 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.645347 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 561) took 1644 ms. Trace:
I20260709 13:10:44.647235  1330 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:44.595016  1265 consensus_queue.cc:1175] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0472fa7187444a91b443058ef89fceb9" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:44.635748 30308 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 5 to 8, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:44.659598 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:44.674305 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44937.1us
W20260709 13:10:44.673893 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 82164us
I20260709 13:10:44.673656  1260 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:44.675664 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 355936us
I20260709 13:10:44.532905  1522 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.674212  1588 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.674746  1330 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.679548  1260 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:44.683612  1260 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:44.685883 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet 788d95f5ce114732b7f934005a3580e2: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:44.686774  1447 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:44.687350  1447 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:44.687862  1447 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.692852 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:44.693862 30479 raft_consensus.cc:2368] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:10:44.694463 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 566) took 1078 ms. Trace:
I20260709 13:10:44.694890 30407 rpcz_store.cc:276] 0709 13:10:43.616169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.616354 (+   185us) service_pool.cc:224] Handling call
0709 13:10:43.634962 (+ 18608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.765482 (+130520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.765525 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.765579 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.765624 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.694041 (+928417us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002864d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:44.694094 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.694278 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299626240}
I20260709 13:10:44.695819 30483 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:10:44.697781 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet b145c49726dc4998aea9471d4b0ca159: Illegal state: Replica 0472fa7187444a91b443058ef89fceb9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:10:44.701640 30485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34018 (request call id 2034) took 2047 ms (client timeout 1600 ms). Trace:
W20260709 13:10:44.702088 30485 rpcz_store.cc:269] 0709 13:10:42.654266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.654406 (+   140us) service_pool.cc:224] Handling call
0709 13:10:44.701216 (+2046810us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540017b1d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:44.701431 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2487988992}
I20260709 13:10:44.702440 30482 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:44.703903 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.712071 30477 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:44.703393  1420 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.707336  1566 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.709053 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:44.709273  1449 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.710266 30484 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:44.645846 30552 rpcz_store.cc:276] 0709 13:10:43.000447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.576701 (+576254us) service_pool.cc:224] Handling call
0709 13:10:43.576952 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.577148 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:44.001652 (+424504us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.620698 (+619046us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.644663 (+ 23965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.644745 (+    82us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:44.644843 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.644945 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.645143 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1694,"prepare.queue_time_us":629474,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":95,"raft.queue_time_us":62744,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":303,"thread_start_us":895644,"threads_started":3,"wal-append.queue_time_us":209391}
I20260709 13:10:44.710175  1248 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.704133  1495 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:44.719350  1489 consensus_meta.cc:287] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.002s
W20260709 13:10:44.681255 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 124007us
I20260709 13:10:44.714514 30483 raft_consensus.cc:2376] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11. Re-sending same reply.
I20260709 13:10:44.718910  1522 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.722570 30479 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:44.731249  1105 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:44.731931  1105 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:44.732443  1105 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.719965  1489 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.757650 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.714455  1260 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.772712 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.791792  1451 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:44.793061 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.789857  1442 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:44.778668 30486 consensus_meta.cc:287] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.004s
W20260709 13:10:44.799829 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.802376 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 615635us
I20260709 13:10:44.804634 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.805765  1506 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:44.805969  1442 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.779278  1321 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.810798 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.811823  1506 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.813024  1248 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.814152  1321 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:44.814759 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 67567.5us
I20260709 13:10:44.761663  1566 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.800603 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.823413  1573 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:44.824009  1573 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.824425  1401 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.825555  1573 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:44.827951 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.835062 30483 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.852780 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.856945 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.860592  1447 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.866310 30552 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:44.879580  1248 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.880970  1489 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:44.882968  1481 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:44.884059  1481 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:44.884408  1481 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:44.884924  1401 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.885421  1481 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.887813  1481 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.888809 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:44.890663 31151 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:44.896236  1597 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.191s	user 0.002s	sys 0.002s
I20260709 13:10:44.896905 30477 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:44.899741 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 430269us
I20260709 13:10:44.891335 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.906117 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:44.907202 31149 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:44.908756 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.909693 30478 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:44.911294  1596 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.381s	user 0.004s	sys 0.002s
I20260709 13:10:44.912626 30374 leader_election.cc:400] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:10:44.912984 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:44.913739 30486 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:44.914680 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60202.1us
I20260709 13:10:44.916006 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.913189 30374 leader_election.cc:403] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:44.917308 30523 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.919934  1550 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.920636  1550 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:44.921216  1550 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.921466  1602 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:44.921996  1602 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:44.922457  1602 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:44.924024 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74936.5us
I20260709 13:10:44.924853 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.925599  1248 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:44.925827 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.926015  1248 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.926470  1248 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.921931 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.927248 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:44.927568  1499 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:44.928077  1499 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.929107  1499 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.934945  1594 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:44.935336 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.935937 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.936455 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.937465 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:44.938138 30484 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:44.937872  1248 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.938848 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.939428  1489 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.939891  1489 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:44.940059 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.940178  1248 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.940835  1599 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:44.941238  1506 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:44.941679  1599 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.943720  1594 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:44.944792  1594 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:44.945258  1594 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:44.940296  1489 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.946684  1594 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.948155  1175 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.948228  1594 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.952543 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:44.953557 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:44.953719  1442 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:44.945214 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:44.956182  1442 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.956321  1603 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:44.956605  1442 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:44.957109  1603 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.957746  1442 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.953581  1545 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:44.958344  1603 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:44.952744  1321 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:44.954900  1471 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:44.960577  1606 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:44.961374  1442 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:44.962754 30357 auto_rebalancer.cc:629] Failed to schedule move for tablet 1f911d757027485a941dce045769b0fe: Illegal state: Replica ce312b0d7a1747c8898a748f8d76df81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:44.904772  1573 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:44.966179  1600 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:44.946261  1599 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.967356  1590 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:44.967825  1600 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.968305  1600 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:44.969305  1600 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.971063  1600 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.971402 30552 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:44.973727 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:44.946149  1557 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:44.977950  1557 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:44.980190  1590 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:44.992828 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.988998 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 90279.2us
I20260709 13:10:45.004101 30483 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:45.005385 30486 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:45.006875 30478 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:45.007618 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:45.013624 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60193us
I20260709 13:10:45.014482 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.021026 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:45.013361  1566 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:45.041679  1483 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:45.043388 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.048132 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.051275 31151 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:45.053681 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46182us
I20260709 13:10:45.033951  1495 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:45.039510  1599 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:45.056278  1483 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.052541  1557 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:45.064679 31146 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:45.070459 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:45.070940  1447 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.058888  1495 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.073326 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.082471 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:45.073994 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.058202  1471 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:45.098992 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:45.103149 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.081931  1495 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.105403  1566 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:45.106022  1566 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.064355  1545 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:45.074205  1557 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:45.098995 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:45.110508 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.083524  1590 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:45.119449 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.120362  1602 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.127542 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:45.082199  1321 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:45.136615 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.109817  1447 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.082154  1105 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.137336  1600 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.166069  1600 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.167004  1105 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.114511  1557 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:45.137490  1401 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.142771 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 68963.4us
I20260709 13:10:45.131649  1237 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:45.154064  1489 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.147313 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:45.151145  1609 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:10:45.151247  1602 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.154541  1552 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:45.155032  1566 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.216065 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:45.156432 30556 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:45.156088  1483 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.147184  1260 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.156810  1175 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:10:45.210616 30477 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:45.110965  1599 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:45.158464 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 184962us
I20260709 13:10:45.162802  1545 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:45.164363  1618 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:45.135241  1343 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:45.145355  1603 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:45.145563  1605 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:10:45.188067 30411 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:45.140791  1442 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:45.138865  1451 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.157717 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:45.217500 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90066.3us
I20260709 13:10:45.188457  1594 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:45.239188  1321 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.239849  1343 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.214200  1600 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.186947  1401 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.256848 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:45.174894  1471 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.233187  1603 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:45.253252  1552 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:45.274780 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.254462  1175 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.257469  1442 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.282364 30556 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:45.297606 30481 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:45.298246  1593 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:45.298735  1593 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.299612  1593 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.300773  1593 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.303133  1545 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.303272  1343 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.304176 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:45.276551  1321 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.310609  1603 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.266947  1237 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.264716  1594 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:45.314783 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.265786  1368 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:45.326382 30450 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:10:45.318527 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:45.332085 30450 leader_election.cc:403] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.270659  1260 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.321743 30480 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:45.345655 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.276839  1522 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:45.355711 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:45.363687 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 89012.4us
I20260709 13:10:45.352169  1589 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.392316 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.334504  1175 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.374320  1105 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:10:45.396049 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:45.360212  1467 consensus_queue.cc:1059] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:10:45.399554  1616 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:10:45.403898 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:45.406512 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 88058.2us
I20260709 13:10:45.416762 30477 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:10:45.401994  1594 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.392198  1603 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.374141  1260 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.403257  1265 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.422943 30479 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:45.423398 31146 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
W20260709 13:10:45.431360 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.431890 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.433317 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:45.412510  1489 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.415213  1566 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.416940  1599 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:45.459237 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 225317us
I20260709 13:10:45.403118  1442 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.467028  1630 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.470033  1564 raft_consensus.cc:3055] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:45.442885  1453 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:45.471397 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.385731  1589 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:45.498845 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 94941.6us
I20260709 13:10:45.490664 30407 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:45.429476  1248 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.450220  1590 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.384379  1552 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:45.502552 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 106067us
W20260709 13:10:45.503087 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52636.9us
I20260709 13:10:45.486718  1401 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.496351  1564 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:45.497699  1453 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:45.522210 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.509076  1471 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:45.608325 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 92115.9us
W20260709 13:10:45.608393 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 71614.8us
W20260709 13:10:45.609988 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74802.3us
I20260709 13:10:45.524232  1453 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.616374  1642 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:10:45.619386  1260 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.539956  1483 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:10:45.660023 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.679005 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:45.620811  1566 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:45.673784  1573 consensus_meta.cc:287] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.709s	user 0.014s	sys 0.006s
I20260709 13:10:45.534863  1420 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:10:45.712538 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:45.708601 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:45.706710 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:45.690761  1237 raft_consensus.cc:2764] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:45.719547 31151 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:45.691965  1566 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:45.710450  1495 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
W20260709 13:10:45.720664 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.515566  1630 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.703871  1642 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.731681  1642 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:45.728070 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 192276us
I20260709 13:10:45.725368 31148 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.730911 31149 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.711970  1175 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.704114  1330 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:45.739362 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.728924  1566 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:45.729882  1420 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:45.768220 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:45.779554 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58618.5us
W20260709 13:10:45.778805 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.771584  1330 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.730863  1599 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.813674  1639 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:10:45.813928  1630 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:45.814522  1646 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:10:45.815173  1638 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:10:45.815466  1550 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.893s	user 0.011s	sys 0.004s
I20260709 13:10:45.815869  1550 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.817365 31144 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:45.773200  1420 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.819864  1420 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.821174  1420 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:45.841429 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67563.6us
I20260709 13:10:45.843950  1237 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:45.850853 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.851284  1237 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.852039 31144 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:45.852281 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:45.852809 30404 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:45.855093  1642 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.842245  1599 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:45.853278  1622 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:10:45.842305  1550 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.863592  1425 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:45.869717 31149 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
W20260709 13:10:45.872579 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.734889  1495 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.893570 30404 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:45.900066 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:45.875072  1599 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.904518 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:45.907008  1626 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 13:10:45.908915  1495 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.910967  1330 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:45.921221 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:45.924736 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 89100.4us
I20260709 13:10:45.932487  1589 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.920712  1442 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:10:45.933208 30411 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:45.933668  1442 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:45.934087  1442 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.926266  1653 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:45.935213  1442 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.936462 31149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:10:45.937040  1237 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.937304 31149 raft_consensus.cc:606] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:45.937697 31149 raft_consensus.cc:614] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:45.939091  1647 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:45.939714  1647 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:45.942592  1557 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:10:45.943143  1647 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.943073  1557 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.944170 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:45.944281 30478 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:45.945025  1471 raft_consensus.cc:2764] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:45.935214  1653 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.946592 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:45.947247  1653 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.947824  1652 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:45.949230  1652 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:45.949690  1652 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:45.950918  1453 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.953224  1453 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:45.927997  1599 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:45.954566  1599 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:45.955003  1599 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.957324  1566 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.939829  1655 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:45.960114 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.960470 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.960803 31144 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:45.961606  1330 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:45.963377 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:45.964485 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:45.973560 31148 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:45.980545  1659 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.980814  1653 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:45.978811 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 114234us
I20260709 13:10:45.981129  1659 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:45.983083 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:45.983831 30483 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:45.984850 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:45.986593 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:45.987388 30477 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:45.988533  1659 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:45.978014  1599 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:45.991279 30479 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:45.992654 30479 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:45.990038 30451 connection.cc:256] RPC call timeout handler was delayed by -1.782045184000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:10:45.993810 30451 connection.cc:256] RPC call timeout handler was delayed by -1.1915252869999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 13:10:45.998888 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.000224 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.000241 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.001329 30559 raft_consensus.cc:2410] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:46.000494 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.002260 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.002802 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.003038 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.003235 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.003720 30556 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.003947 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.004485 30559 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.004532 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.005178  1489 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.005779 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.005848  1489 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.007467 30558 pending_rounds.cc:85] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 3
I20260709 13:10:46.007805 30558 pending_rounds.cc:107] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:10:46.008077 30558 raft_consensus.cc:2889] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.010733 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.011495 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:46.015049  1489 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.016117 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:46.022903 30560 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:46.035842 30559 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
W20260709 13:10:46.036132 30376 leader_election.cc:336] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.588s (SENT)
I20260709 13:10:46.036573 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:45.923466  1603 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.993086  1659 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.040205  1659 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.043767 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.045650 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:45.936472  1442 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.042423  1659 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.048056 30407 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:45.950507  1652 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.049216 30479 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.058986 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.035054  1489 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.068037 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.068408 30483 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:46.070606 30483 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:46.056646 30525 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 406b169640e341629c55637d07dd3d47. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.069134 30480 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:46.035265  1599 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:46.071837 30559 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:46.049597  1648 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.208s	user 0.000s	sys 0.004s
I20260709 13:10:46.075618 31146 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:46.048364  1420 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:46.076889 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.052793  1321 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:46.078603 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.079206 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:46.080166 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44056.1us
I20260709 13:10:46.082317 31149 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.079654 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:46.083978  1591 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.084362 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.088864 30480 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.091297  1599 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.091886  1599 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:46.096757 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.097478 30559 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:46.097684  1655 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.098222  1655 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.098968  1644 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:46.099510  1644 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.099926 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1950) took 1345 ms. Trace:
I20260709 13:10:46.100157  1655 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.100301 30485 rpcz_store.cc:276] 0709 13:10:44.754687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.756050 (+  1363us) service_pool.cc:224] Handling call
0709 13:10:44.776236 (+ 20186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.824122 (+ 47886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.824163 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.860491 (+ 36328us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.016855 (+156364us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:45.016921 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.017027 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.038545 (+1021518us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b2400108068. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041e429c4 00007fa041e40acb 00007fa041ffbdc9 00007fa041ffba55 00007fa041ffafb0 00007fa044c71488 00007fa044c71be8 00007fa044c49398 00007fa044c4476a 00007fa044c43bb6
0709 13:10:46.084439 (+ 45894us) raft_consensus.cc:1685] finished
0709 13:10:46.084459 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.099864 (+ 15405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33943168,"thread_start_us":151086,"threads_started":1,"wal-append.queue_time_us":255271}
I20260709 13:10:46.101615  1644 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.101954 30559 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.102560 31148 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.103505  1557 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.059770  1603 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.085896 30560 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:46.078902  1467 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:46.078171  1659 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.106961 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.107627 31146 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:46.112867 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.113595 30411 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:46.114228  1566 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.088580  1653 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:46.124711 30404 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.119235 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.120507 30451 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:46.123698 30479 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:46.126482 30559 raft_consensus.cc:2376] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11. Re-sending same reply.
I20260709 13:10:46.100759  1655 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.128727 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.128774  1655 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.131492  1655 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.134964 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.137048 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:46.136462 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.138572 30559 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.139381 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.139632 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.140020 30559 raft_consensus.cc:2376] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11. Re-sending same reply.
I20260709 13:10:46.140688 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.140990 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.141273 30560 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:46.142148 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.142168 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.137776  1658 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.143860 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.144997 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.146013 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.136813 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:46.147114 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.147233  1658 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.138947 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.148088 30559 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.148288 30411 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:46.074661  1489 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:46.149852 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.155131 30480 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:46.155614 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.156277 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.156837 30559 raft_consensus.cc:2376] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9. Re-sending same reply.
I20260709 13:10:46.157999 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.155720 30404 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:46.158651 30559 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.159442 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.162089 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:46.164940 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.092962  1599 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.170174 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.172446 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:46.168210 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.169350 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.169621 30411 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:46.175303 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.169693  1105 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.172474 30559 raft_consensus.cc:2368] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:46.179352  1557 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.179457 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.179747 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.180114 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.180408 30559 raft_consensus.cc:2368] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:46.180493 30552 raft_consensus.cc:2393] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.181684 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.185117 30552 raft_consensus.cc:2410] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:46.189615 30560 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:46.192715  1489 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.192994 30479 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.194065 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.195026 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.195685 30481 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.200225  1603 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.167275  1566 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:46.195097 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.201970 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.190939 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.203724 30403 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:46.210249 30554 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:46.208678  1557 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:46.215806  1557 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.216632 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.217164 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.217767 30411 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.219029 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:46.221874 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.222654 30554 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.222975 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.223381 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.224052 30554 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.224781 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.225775 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.228520 30405 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.228929 30484 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:46.229442 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.230075 30484 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.230520 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.231657  1652 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:46.232529  1653 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:46.232693 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.233719  1652 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.234714 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:46.235139 30478 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.235986 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:46.237154  1664 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:46.237481  1662 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:46.237926  1664 consensus_queue.cc:1243] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:46.238547  1664 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:46.239838  1451 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:46.240321  1451 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:46.241375  1451 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.209681  1566 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:46.243103  1566 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.242885  1453 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.243834  1453 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.211866  1659 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:46.247037 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:46.248133 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.247833 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.237186 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.231277 30405 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:10:46.236275 30478 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.252971 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.254436 30552 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:46.256865 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.257813 30559 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.249449 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.261837 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.263487 30552 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.251322 30483 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.185721  1105 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:46.231765 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.271019 30483 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.269747 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.274003 30403 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:46.281265 30552 raft_consensus.cc:2410] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:46.281811 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.283703 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.279094 30479 pending_rounds.cc:85] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:10:46.292522 30479 pending_rounds.cc:107] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:46.292819 30479 raft_consensus.cc:2889] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.291391 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.293862 30560 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:46.294476 30404 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:46.297575 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.297780 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.285135 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.306300 30406 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:46.264526  1589 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.264595  1451 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.283695  1652 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:46.324084 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.325254 30411 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:46.310935 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.299419  1401 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:10:46.327657 30405 raft_consensus.cc:2393] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:46.315932 30554 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:46.316187 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.326040 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.296633 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.330057 30559 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:46.195817  1564 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.330070 30408 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.278542  1481 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:46.333105 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.334233 30403 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:46.323660  1655 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:46.322801  1652 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.337190  1330 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.345256 30559 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.348533 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.307814 30481 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:46.350046 30483 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:46.350566 30483 pending_rounds.cc:85] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:10:46.345959 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.350920 30483 pending_rounds.cc:107] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:46.353022 30483 raft_consensus.cc:2889] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.356416 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.348259  1652 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.388970 30403 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:46.349222  1564 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:46.385800 30559 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:46.387969 30552 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:46.390292 30552 pending_rounds.cc:85] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:46.390712 30552 pending_rounds.cc:107] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:46.391741 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.393181 30484 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:46.394131 30484 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.404709  1658 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:46.406845 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 109160us
I20260709 13:10:46.407897 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.409796 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.410861  1495 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.411077  1401 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.414877  1662 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:46.415068 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.415992  1662 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.416791  1662 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:46.389846  1248 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:46.410897  1420 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:10:46.386446  1589 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.432009 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.386561 30560 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:46.387102 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.391062 30552 raft_consensus.cc:2889] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.271914  1105 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.446722 30481 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:46.343065  1655 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:46.456753 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.462677 30408 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:46.444842 30485 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
W20260709 13:10:46.469580 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59751.2us
W20260709 13:10:46.474010 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.478027 30408 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:46.472522  1260 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.483507  1260 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.484609  1655 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.485527  1260 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.418519  1566 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.492882  1566 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.502986  1662 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.506446 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:46.448854  1659 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:46.513440  1321 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:46.546816 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.541131  1636 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.032s	user 0.013s	sys 0.007s
I20260709 13:10:46.540335  1486 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:46.595350 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.614494 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.624367 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.625296 30484 raft_consensus.cc:2393] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:46.626273 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.627034 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1958) took 1456 ms. Trace:
I20260709 13:10:46.628196 30484 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:46.629678 30484 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:46.633780 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:46.634537 30483 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:46.637571 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.580972  1486 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:46.628584 30482 rpcz_store.cc:276] 0709 13:10:45.171004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.171120 (+   116us) service_pool.cc:224] Handling call
0709 13:10:45.194594 (+ 23474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.267609 (+ 73015us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:45.932403 (+664794us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003c0820. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa048aa13c7 00007fa0450b39a7 00007fa0450c30bf
0709 13:10:45.932582 (+   179us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.995753 (+ 63171us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.044431 (+ 48678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.044492 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:46.044541 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.626784 (+582243us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b5400360454. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:46.626845 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.626979 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39013,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":10002,"raft.queue_time_us":19451,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":227689984,"thread_start_us":185684,"threads_started":3,"wal-append.queue_time_us":155657}
I20260709 13:10:46.651100 30477 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.577580  1658 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.581276  1425 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.662050 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:46.662169 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:46.576766  1321 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.669059 30483 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:46.675376 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.682641 30483 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.662587  1641 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.685297 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1962) took 1513 ms. Trace:
W20260709 13:10:46.692116 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56580.4us
I20260709 13:10:46.688040 30486 rpcz_store.cc:276] 0709 13:10:45.172263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.172937 (+   674us) service_pool.cc:224] Handling call
0709 13:10:45.191311 (+ 18374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.229831 (+ 38520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.229859 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.235449 (+  5590us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.368730 (+133281us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:45.368818 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.368958 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.442850 (+1073892us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:46.674840 (+231990us) raft_consensus.cc:1685] finished
0709 13:10:46.674865 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.685233 (+ 10368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6759,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7848,"spinlock_wait_cycles":5795072,"thread_start_us":109723,"threads_started":1,"wal-append.queue_time_us":181443}
I20260709 13:10:46.628197  1659 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.684245  1330 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:46.711508 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 474007us
I20260709 13:10:46.714473 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.662290  1658 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.737232 30409 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.698359  1588 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:46.737960 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.738619 30402 raft_consensus.cc:606] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.685084  1480 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:46.709897  1330 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:46.698231  1641 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.707212  1495 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:46.772044 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.776748 30557 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.777225 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:46.756762  1330 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.780614 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.780463 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.757372  1557 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:46.783221 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.757838  1685 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:46.781399  1676 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.206s	user 0.001s	sys 0.001s
I20260709 13:10:46.785000 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.797106 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:46.720686  1486 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.782500  1552 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:46.781935  1678 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:46.800420 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:46.788101  1481 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:46.789453  1684 ts_tablet_manager.cc:933] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:46.808676 30376 leader_election.cc:336] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.642s (SENT)
I20260709 13:10:46.810130 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:46.787601  1401 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:46.787856  1681 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.812027 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.797683  1594 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.816305 30410 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:46.785017  1677 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:10:46.815320  1481 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:46.803589  1653 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:46.826876 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 138933us
I20260709 13:10:46.827193 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.828068 30486 raft_consensus.cc:2410] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:10:46.825276 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 149027us
I20260709 13:10:46.805131  1552 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:46.830996 30374 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.818993  1681 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.816736  1486 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:46.835528 30376 leader_election.cc:336] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.642s (SENT)
I20260709 13:10:46.837719 30523 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.838605 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:46.840937 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.824512  1321 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.810262  1557 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.832911  1401 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:46.846626  1401 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.848683  1401 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.849344  1401 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:46.849944  1401 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.836829  1552 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.859278  1481 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.860136  1652 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.860770  1481 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.837687  1681 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.873230  1652 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.873548  1658 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:46.841367  1653 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:46.873960 31146 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:46.875095  1653 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.879038 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:46.879487  1451 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:10:46.880359 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:46.880980 30483 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:46.865423  1564 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.883513  1564 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:46.853287  1619 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:46.885100  1619 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:46.886345  1564 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.886075  1619 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:46.886734  1683 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:10:46.840885  1655 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:10:46.887876  1260 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.888655  1557 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.889281 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:46.891076 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:46.900995 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70095.3us
W20260709 13:10:46.904228 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 66589.8us
W20260709 13:10:46.914860  1682 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:10:46.937911 31151 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:46.917514 30557 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:46.923529  1641 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.927999 31153 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:46.952278 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:46.955456  1641 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:46.956420  1641 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:46.956871  1641 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:46.957769  1641 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.939646  1480 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.977205  1700 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:46.969113  1599 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.968472  1690 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.944068  1260 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:46.973543  1467 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:46.992493 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 156986us
W20260709 13:10:46.993378 30376 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.686s (SENT) [suppressed 39 similar messages]
I20260709 13:10:46.986636  1599 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.002890  1599 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.004169  1599 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.007983  1681 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.010370  1681 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:46.983326  1453 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:46.987721  1690 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:46.981021  1655 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:10:47.023816 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 75143.2us
I20260709 13:10:46.997612  1467 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.981387  1480 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.062589 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2011) took 1214 ms. Trace:
I20260709 13:10:47.084014  1260 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:47.084563  1669 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.816s	user 0.003s	sys 0.000s
I20260709 13:10:47.040998  1684 tablet_copy_client.cc:323] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
W20260709 13:10:47.057521  1703 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:47.088253  1690 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:47.070861 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.087427 30477 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:47.108377  1701 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.108287 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.109275 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.135370 30410 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:47.109457 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.136224 30408 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:47.109825 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.111001 30407 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.111719 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.117228  1552 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.073593  1330 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.110481  1599 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:47.125006 30409 rpcz_store.cc:276] 0709 13:10:45.848839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.850854 (+  2015us) service_pool.cc:224] Handling call
0709 13:10:45.851162 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.737821 (+886659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.062264 (+324443us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54002869d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:47.062497 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037216512}
W20260709 13:10:47.126588 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 132965us
I20260709 13:10:47.142568 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.143087 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.140801 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:47.144120 30376 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.700s (SENT)
I20260709 13:10:47.144713 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:47.149843 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.152719 30408 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:47.153030 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.167477 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.141629  1701 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.169991 30411 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:10:47.169051 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 186054us
I20260709 13:10:47.173496 31153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43936 (request call id 458) took 1484 ms. Trace:
W20260709 13:10:47.173952 30376 leader_election.cc:336] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.765s (SENT)
I20260709 13:10:47.174194  1343 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.174646  1343 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:47.175057 30376 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.851s (SENT)
I20260709 13:10:47.175546 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.175470  1343 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.176608  1343 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.176720  1420 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:47.177579 30376 leader_election.cc:336] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.888s (SENT)
I20260709 13:10:47.162979  1453 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.167270  1545 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:47.161128  1690 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:47.186319 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.188385 30406 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:47.190605 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42728 (request call id 3) took 1081 ms. Trace:
I20260709 13:10:47.173884 31153 rpcz_store.cc:276] 0709 13:10:45.688774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.690820 (+  2046us) service_pool.cc:224] Handling call
0709 13:10:47.173302 (+1482482us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400596ad4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:47.173412 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579924224}
W20260709 13:10:47.219743 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 179188us
I20260709 13:10:47.202906 30556 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:47.207762 30405 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:47.222687 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1877) took 1120 ms. Trace:
I20260709 13:10:47.223300 30556 rpcz_store.cc:276] 0709 13:10:46.101958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.239297 (+137339us) service_pool.cc:224] Handling call
0709 13:10:47.202372 (+963075us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:47.202647 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.222335 (+ 19688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.222613 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6953216}
W20260709 13:10:47.178686 30376 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.917s (SENT)
I20260709 13:10:47.225106 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.219673 30402 rpcz_store.cc:276] 0709 13:10:46.126127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.161812 (+ 35685us) service_pool.cc:224] Handling call
0709 13:10:47.190327 (+1028515us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54002869d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a3853 00007fa04a07160a 00007fa0435f77d4 00007fa0435f7762 00007fa0435f7691 00007fa0435f760c 00007fa0435f68c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:47.190448 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324306688}
I20260709 13:10:47.237811 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.238557 30554 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:47.241339 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.242129 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1879) took 1139 ms. Trace:
I20260709 13:10:47.242205  1679 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:47.242476 30555 rpcz_store.cc:276] 0709 13:10:46.102528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.227147 (+124619us) service_pool.cc:224] Handling call
0709 13:10:47.241191 (+1014044us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:10:47.242074 (+   883us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59422976}
I20260709 13:10:47.242767  1679 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.244906  1679 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.247637 30403 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.246238  1685 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.246886 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.247109 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.249505 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.247337  1678 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:47.179320  1330 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:47.250988  1678 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.252490 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:47.253512 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 441554us
I20260709 13:10:47.256070 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 583) took 1235 ms. Trace:
I20260709 13:10:47.256242  1237 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.256637  1237 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:47.256479 30551 rpcz_store.cc:276] 0709 13:10:46.020319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.232448 (+212129us) service_pool.cc:224] Handling call
0709 13:10:46.971064 (+738616us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:46.971299 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.982483 (+ 11184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.982523 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.992685 (+ 10162us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.123826 (+131141us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:47.123886 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.123998 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.255683 (+131685us) raft_consensus.cc:1685] finished
0709 13:10:47.255712 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.256011 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4228,"raft.queue_time_us":109395,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":46955904,"thread_start_us":84177,"threads_started":1,"wal-append.queue_time_us":208040}
W20260709 13:10:47.201387  1689 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
I20260709 13:10:47.258540  1105 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.259172  1105 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.179797  1453 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.260803  1564 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.261319  1105 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.261276  1564 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.261875  1105 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.245501 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.263151 30410 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:47.247152 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.264575 30404 raft_consensus.cc:2410] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:47.265219 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.265805 30485 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:47.176260  1467 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.265842 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.271114 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:47.271884 31146 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:47.266582 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.209859  1664 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:47.274706 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.276654 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:47.277084 31116 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.281356 31153 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:47.262306  1105 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.267154  1495 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:47.257093  1237 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.288940  1677 consensus_queue.cc:1243] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:47.291868 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.180859  1701 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.211476  1480 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.272927  1599 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:10:47.282753 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.283077  1707 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:47.284931 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.285735 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.308607 30483 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:47.309834 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:47.310829 30483 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:47.205336  1552 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:47.286451  1708 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:47.286841 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.324329 30484 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:47.282516 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.262470  1453 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.287590  1695 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.288463 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 406b169640e341629c55637d07dd3d47 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:10:47.289108 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.290598 30479 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:47.293330 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.293623 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.294625 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.264509  1557 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.332267 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.301683 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:47.301980 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2066) took 1147 ms. Trace:
I20260709 13:10:47.306025 30407 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.303349 30410 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:47.340411 30485 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:47.289652  1664 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:47.345461 30481 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.337157 30483 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:47.331115 30559 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
W20260709 13:10:47.300725 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 122073us
I20260709 13:10:47.324230 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:47.342002 30486 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:10:47.347637 30376 leader_election.cc:336] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.977s (SENT)
I20260709 13:10:47.340929 30480 rpcz_store.cc:276] 0709 13:10:46.158640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.158968 (+   328us) service_pool.cc:224] Handling call
0709 13:10:46.159224 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.159401 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:46.163677 (+  4276us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.078812 (+915135us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18004380a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:47.290139 (+211327us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.295001 (+  4862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.295061 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:47.295107 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.295172 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.301924 (+  6752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11828,"prepare.queue_time_us":4477,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":77,"raft.queue_time_us":160800,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":14113,"spinlock_wait_cycles":16479488,"thread_start_us":302350,"threads_started":2,"wal-append.queue_time_us":103718}
I20260709 13:10:47.351545 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.352188 30410 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:47.351982  1664 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.359338  1708 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.360352  1708 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.290043  1260 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:10:47.372862 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 575828us
I20260709 13:10:47.372877 31118 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.330781  1695 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.376170 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:47.335202  1453 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.384526 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.385221 30410 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.387418 30407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:47.388224 30407 raft_consensus.cc:606] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.388622 30407 raft_consensus.cc:614] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:47.389632 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.391070 30450 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:10:47.399788 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 106176us
W20260709 13:10:47.417188 30308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 102) took 25316 ms (client timeout 15000 ms). Trace:
I20260709 13:10:47.368438 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 406b169640e341629c55637d07dd3d47 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-406b169640e341629c55637d07dd3d47
W20260709 13:10:47.419766 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 72151.8us
W20260709 13:10:47.421938 30376 leader_election.cc:336] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.016s (SENT)
I20260709 13:10:47.368523  1619 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:47.377979  1695 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.385984  1659 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:47.348941  1557 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.344254  1712 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:10:47.377120  1690 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:10:47.435333 30376 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.025s (SENT)
I20260709 13:10:47.412307  1248 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.412526  1566 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:47.447337 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.383486  1642 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:47.431349  1480 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:47.430830  1594 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:47.433600  1714 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.455394 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 98279.3us
W20260709 13:10:47.458168 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 164892us
I20260709 13:10:47.464680 30523 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:47.466048 30376 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.045s (SENT)
I20260709 13:10:47.451418  1248 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:47.456212  1672 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.148s	user 0.004s	sys 0.000s
I20260709 13:10:47.456363  1480 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:47.470853 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70267.4us
W20260709 13:10:47.479228 30376 leader_election.cc:336] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.056s (SENT)
W20260709 13:10:47.456286 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 83504.6us
I20260709 13:10:47.469970  1248 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.500669 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:47.493654 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:47.516932 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.417730 30308 rpcz_store.cc:269] 0709 13:10:22.023315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.023922 (+   607us) service_pool.cc:224] Handling call
0709 13:10:47.339525 (+25315603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:45.031444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:45.119644 (+ 88200us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:45.119702 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:10:45.119739 (+    37us) tablet.cc:662] Decoding operations
0709 13:10:45.120328 (+   589us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:45.120430 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:45.120460 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:45.120961 (+   501us) tablet.cc:701] Row locks acquired
0709 13:10:45.121033 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:10:45.121234 (+   201us) write_op.cc:270] Start()
0709 13:10:45.121394 (+   160us) write_op.cc:276] Timestamp: P: 1783602645121165 usec, L: 0
0709 13:10:45.121434 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:10:45.151597 (+ 30163us) log.cc:844] Serialized 913 byte log entry
0709 13:10:46.121080 (+969483us) op_driver.cc:464] REPLICATION: finished
0709 13:10:46.542474 (+421394us) write_op.cc:301] APPLY: starting
0709 13:10:46.548662 (+  6188us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:46.584102 (+ 35440us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:46.658599 (+ 74497us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:46.720490 (+ 61891us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:46.785332 (+ 64842us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:46.789180 (+  3848us) write_op.cc:312] APPLY: finished
0709 13:10:46.803144 (+ 13964us) log.cc:844] Serialized 29 byte log entry
0709 13:10:46.803352 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.803447 (+    95us) write_op.cc:454] Released schema lock
0709 13:10:46.803520 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:46.829959 (+ 26439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:46.831512 (+  1553us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":412644,"apply.run_cpu_time_us":3617,"apply.run_wall_time_us":267203,"num_ops":2,"prepare.queue_time_us":165792,"prepare.run_cpu_time_us":41948,"prepare.run_wall_time_us":276560,"raft.queue_time_us":172792,"raft.run_cpu_time_us":124729,"raft.run_wall_time_us":302021,"replication_time_us":986943,"thread_start_us":467377,"threads_started":4,"wal-append.queue_time_us":255657}]]}
I20260709 13:10:47.469229  1552 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:47.484829  1700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.004s
I20260709 13:10:47.536304 30403 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:47.538313 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 53043.2us
I20260709 13:10:47.528458 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.525357 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:47.537833 30407 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:10:47.529053 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.487033  1564 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.586952 30408 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:47.590934 30409 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.486532 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:10:47.583233 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 215239us
I20260709 13:10:47.550001 30559 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:47.483664  1480 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.495947  1566 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:47.598845 30407 pending_rounds.cc:85] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 7
I20260709 13:10:47.493330  1723 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:47.591755 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:47.613651 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 46902.5us
I20260709 13:10:47.619288 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.629703 30405 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:47.633013 30402 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:47.493497  1713 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:47.584432  1700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.014s	sys 0.005s
I20260709 13:10:47.623236 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.485910  1679 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.634593 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 169979us
I20260709 13:10:47.620211 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.656694 30404 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:47.491542  1707 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:47.636068 30407 pending_rounds.cc:107] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:47.633838 31117 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:47.621553 30411 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:47.659863 30407 raft_consensus.cc:2889] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.640159 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:47.492856  1557 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.466661  1714 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:47.704200 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70424.6us
W20260709 13:10:47.707679  1715 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
W20260709 13:10:47.709136  1716 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:10:47.709955  1237 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.663635  1707 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.748346 30486 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.712152  1481 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:47.663477  1679 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.749044  1481 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.749439  1481 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.715137 30570 tablet_copy_source_session.cc:215] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:47.717801  1700 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:47.750916  1679 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.751083  1700 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:47.716890 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57736.1us
I20260709 13:10:47.753218  1700 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:47.718660 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 127012us
I20260709 13:10:47.753618 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:47.754104 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.634286  1723 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.754419 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:47.754839 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:47.755080 30557 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.755301  1723 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.755868 30558 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:47.756515  1723 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.755316 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:47.759047 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.759503 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.760260 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.761231  1664 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.761533 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.636530  1713 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:47.731420  1717 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:10:47.732367  1706 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:10:47.763572  1728 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:47.763517  1713 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.764243  1728 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.764964  1713 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.765700 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 491) took 1138 ms. Trace:
I20260709 13:10:47.705771  1401 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.740702  1467 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:47.744227 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.745657 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:47.724359  1619 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:47.494489  1594 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.759624 30559 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:47.732703 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:47.748122  1260 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:47.739466  1725 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:47.769662 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:47.739480 30410 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:47.534256  1733 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.172s
I20260709 13:10:47.787205 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:47.665557 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.748199  1707 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.782541  1700 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:47.790913 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58306.2us
I20260709 13:10:47.773487 30407 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:47.779920 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:47.780555  1714 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.780287  1566 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.781191 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:47.547582  1659 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:47.784345 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.765388  1728 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:10:47.795621 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 130150us
I20260709 13:10:47.796057 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:47.800586 30554 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:47.824030 30409 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:47.824369 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:47.800719 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.825274 30407 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:47.803349  1453 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:47.805014  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406b169640e341629c55637d07dd3d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:47.791482  1734 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:47.657685  1693 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 13:10:47.807080  1589 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:47.834674 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.830825  1655 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:47.809731  1481 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.810983  1733 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.811728 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:47.830976  1728 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.803011  1420 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:47.814174 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44598.1us
I20260709 13:10:47.849361 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:47.822819 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 194522us
I20260709 13:10:47.827278  1659 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.802299 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.827953  1453 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.790678  1730 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:47.781672  1260 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.864214 31146 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:47.864737  1260 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.866222  1260 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.782578  1685 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:47.867399  1237 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.831743 30376 leader_election.cc:400] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:47.868011 30376 leader_election.cc:403] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:10:47.868942 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44099.3us
I20260709 13:10:47.870891  1653 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11.
I20260709 13:10:47.812831  1729 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.843891 30481 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:10:47.872138 30481 pending_rounds.cc:85] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:10:47.872444 30481 pending_rounds.cc:107] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:47.872730 30481 raft_consensus.cc:2889] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.854156  1734 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.825333 30553 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:47.856518 30559 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:47.659844  1105 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.857275 30554 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:10:47.852766 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.875352 31151 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:47.876816 30556 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:47.862840  1680 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:47.881357 31149 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:47.863631 31153 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:47.873908  1714 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.870610 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.838428  1733 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.838977  1655 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.889092 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.890441 30555 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:47.892104 30482 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:47.893599  1730 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:47.856936  1589 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:47.858770 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:47.876498  1453 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.817986  1695 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.850371  1564 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:10:47.905668 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.857597  1659 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:47.906980 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.908591 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:47.909479 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.913347  1237 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:47.915602 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.916210  1420 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:47.931393 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.893151  1714 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.948920 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:47.959376 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43848.1us
I20260709 13:10:47.959991 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.867010  1685 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.888105  1680 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.942175  1641 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.942022  1679 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:47.944046  1619 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:47.923499  1105 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:47.982120 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.989758  1653 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:47.983034  1589 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.990485  1653 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.991014  1481 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:47.992663  1653 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:47.957908  1727 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.998627 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:47.960840  1420 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:47.926394  1700 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:10:47.955844  1693 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.964184  1737 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.998169 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.009176 30407 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.971803  1723 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:48.013104 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 52563.2us
I20260709 13:10:48.014125 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.022634 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.000732  1729 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:48.035022 30407 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:48.010354  1736 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.003866  1679 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:47.938685  1734 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:47.942585  1733 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.025815  1343 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.055734  1420 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.064216  1480 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.052003  1720 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:48.067373  1720 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.002111  1735 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:10:48.072420  1733 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.037514  1743 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.080895  1679 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.982419  1655 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.025166  1727 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:48.070330  1720 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.107220 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.108006 30407 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.108675  1695 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:48.112463  1248 consensus_meta.cc:287] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.002s
I20260709 13:10:48.112910  1248 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.114997 30407 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:48.054584  1736 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.120635  1707 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.122207 30552 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:48.123539  1680 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.083251  1655 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.766093 31147 rpcz_store.cc:276] 0709 13:10:46.627578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.644716 (+ 17138us) service_pool.cc:224] Handling call
0709 13:10:46.682751 (+ 38035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.831208 (+148457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.831648 (+   440us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.905184 (+ 73536us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.226776 (+321592us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:47.380049 (+153273us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.745159 (+365110us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b18002581c0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa044c514bc 00007fa041f9f48b 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287
0709 13:10:47.747291 (+  2132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.747372 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.765355 (+ 17983us) raft_consensus.cc:1685] finished
0709 13:10:47.765465 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.765621 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172347,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2225,"raft.queue_time_us":91793,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":12370,"spinlock_wait_cycles":13524352,"thread_start_us":484030,"threads_started":4,"wal-append.queue_time_us":395355}
I20260709 13:10:48.135736  1738 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
I20260709 13:10:48.136575  1738 consensus_queue.cc:1243] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:48.137060  1738 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:48.137351  1738 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:48.015259  1693 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.141450  1693 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.141937  1731 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.142424  1731 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.143821  1685 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.144888  1731 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:48.150214 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.151218 30409 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:48.121512  1736 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:48.156635 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.157420 30407 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 5.
W20260709 13:10:48.154616 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 132031us
I20260709 13:10:48.163012 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:48.105525  1641 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.138099  1738 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:47.962055  1730 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.177609  1695 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:48.176599  1679 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.193920 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:48.198673 30408 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:48.199437 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.206202 31146 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:48.200392 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.200526 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.208953 30402 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.202095  1690 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:48.208595 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:48.201970 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.212939 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:48.213126 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 214988us
I20260709 13:10:48.213869 30411 raft_consensus.cc:2410] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:48.214280 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.214401 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.216550 30405 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:48.219429 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:48.202807  1330 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:48.191927  1695 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.210053  1720 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.192006  1248 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.216708  1738 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.223758  1700 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.219635  1680 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.189962  1641 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:48.192883  1693 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:48.241365 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.209920  1653 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:10:48.215430  1685 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:48.257102 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.229787  1695 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:48.210309  1679 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.259126 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.224638  1105 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:48.240003  1720 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:48.253019  1343 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:48.247406  1690 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:48.226616  1594 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:48.224002  1237 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:48.252024  1680 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.268560  1727 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:48.272774  1680 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:48.275102  1751 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:48.253365  1248 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:48.261479  1734 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.228375  1728 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:10:48.279279  1248 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:48.279886  1707 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:48.263877  1760 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.270038  1453 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.280233  1248 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.282359  1453 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.253145  1759 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:48.283272  1662 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:48.283319  1759 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:48.268901 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.283843  1662 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:48.284834 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.285389 30411 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.285868 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.261325  1714 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.261560  1480 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.287005 30405 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.287124 30551 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:48.283921  1759 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:48.288682 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.263092 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 62772.5us
I20260709 13:10:48.291399 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:48.282428  1664 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.002s
I20260709 13:10:48.296448 30485 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:48.298251  1599 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:48.298686 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.299057  1599 consensus_queue.cc:1243] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:48.299520  1599 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:48.299829  1599 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:48.295509  1760 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:48.306465 30404 raft_consensus.cc:1240] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:48.307421  1695 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.309602  1759 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.310983  1759 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.303188 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:48.320231 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:48.295334 30402 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:48.301043 30410 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:48.302222 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.302564 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.322396 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.322778  1453 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:48.323087 30409 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:48.323257  1453 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.323724  1453 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.322794  1690 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:48.327841  1690 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:48.328686  1690 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.288371  1720 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.292450  1260 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:48.334163 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 114830us
I20260709 13:10:48.293584 30411 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:48.303215 30408 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:48.304689 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.339983 30406 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.304876  1599 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.338656 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.341519 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:48.341253 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:48.347232 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:48.294624  1733 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:48.343700 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.360775 30408 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:48.354995 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:48.363538 30376 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.683s (SENT)
I20260709 13:10:48.363689 30411 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:48.333282  1760 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.371984  1738 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:48.384601  1726 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.863s	user 0.002s	sys 0.002s
I20260709 13:10:48.386570  1642 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:48.392578 31146 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:48.357743  1480 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:48.365896  1736 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:48.393340 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:48.432866 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.395072  1599 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.293399  1662 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.436750 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.364233  1714 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:48.372247  1655 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:48.438350 30554 raft_consensus.cc:2410] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:48.440902 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:48.443279 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.400564  1642 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:48.447196 30559 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:48.411470  1728 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.457726 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:48.470417 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48398.9us
I20260709 13:10:48.407508  1765 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:48.433745  1480 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:48.489670 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.497932 30480 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.488893  1420 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:48.492661 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.494339  1641 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:48.495347  1642 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.490571 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.498274 30406 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:48.414114  1738 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.497901 30479 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 6.
I20260709 13:10:48.410038  1766 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:10:48.450170  1736 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:48.510830 30558 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:48.511292 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.523445 30559 raft_consensus.cc:2410] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:48.512542 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.408903  1760 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.514886 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:48.514935 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:48.453167  1564 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:48.533233 30479 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.533845 30480 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:48.490686  1105 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:48.453310  1557 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.536433 31116 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:48.436450  1707 consensus_queue.cc:1059] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:10:48.542433 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.510300  1765 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:48.544636 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:48.544687 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.485988  1655 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.547688 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.438220  1330 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:10:48.552160 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.543529  1734 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:48.556226 30559 raft_consensus.cc:2410] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:48.497406  1728 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.541219  1662 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.453631  1659 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.512800  1730 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:48.518946  1641 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.551657  1481 raft_consensus.cc:2804] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:48.552313  1642 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:48.570840  1768 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:48.571192 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.572430 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.573251 30559 raft_consensus.cc:2410] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:48.574026 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.574055  1760 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:48.575388  1767 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:10:48.576484 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.578365 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.578828  1664 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.579313  1664 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.580667 30478 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:48.581346  1664 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.582017 30478 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:48.582347 30559 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:48.583647 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.585635 30559 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:48.587195  1655 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.587543 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.584936 30478 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:48.589111 30478 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:48.546386  1105 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.592917  1105 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.562115  1480 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.557650  1737 raft_consensus.cc:3055] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:48.615293  1743 consensus_meta.cc:287] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.000s
I20260709 13:10:48.615849  1743 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:48.614494  1737 raft_consensus.cc:740] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:48.606400  1738 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.605733  1736 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.540982  1564 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.619673 30559 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:48.608671  1765 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.548831  1557 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.554214  1343 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:10:48.569491  1734 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:48.617731  1737 consensus_queue.cc:260] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.714862  1442 raft_consensus.cc:993] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:10:48.715565  1442 raft_consensus.cc:1081] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:10:48.716557  1695 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:48.717530 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 205081us
I20260709 13:10:48.719179  1764 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:48.728360 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:48.734190 30483 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:48.636093  1453 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.722682  1481 raft_consensus.cc:697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:48.745304 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:48.745478 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:48.746203 31149 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:48.750923 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.754113 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.754668 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.756152 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.732553  1690 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.757501 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:48.757694 30551 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:48.758136 31146 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:10:48.699923  1680 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.739274  1737 raft_consensus.cc:3060] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:48.774178  1453 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:48.779498 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2004) took 1503 ms. Trace:
I20260709 13:10:48.779945 30486 rpcz_store.cc:276] 0709 13:10:47.276521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.356770 (+ 80249us) service_pool.cc:224] Handling call
0709 13:10:47.357044 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.748917 (+391873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.779247 (+1030330us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400360954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:48.779433 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899526016}
I20260709 13:10:48.783284  1780 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:48.783888  1619 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:48.784305  1619 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:48.785128  1619 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.788228 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.788875 30556 raft_consensus.cc:2376] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11. Re-sending same reply.
I20260709 13:10:48.789775 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.791414 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 474) took 1007 ms. Trace:
I20260709 13:10:48.791757 31151 rpcz_store.cc:276] 0709 13:10:47.783726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.783842 (+   116us) service_pool.cc:224] Handling call
0709 13:10:47.784148 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.875742 (+ 91594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.791174 (+915432us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54003e2e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:48.791338 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209322752}
I20260709 13:10:48.794131 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.795243 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.795750 30560 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:10:48.796466  1772 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:10:48.796552 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.797654 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:48.798856  1775 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:10:48.806088 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.806787 30407 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.808230  1734 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.905154 30558 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:48.879747 30482 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:48.817040 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:48.892977 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.874555 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.890112 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:48.915786 30555 raft_consensus.cc:2410] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:48.790563 30556 raft_consensus.cc:2410] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:10:48.901072 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 155704us
I20260709 13:10:48.837325 30407 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:48.917631 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:48.916006 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.869482 30479 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:48.920411 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:48.921398 30402 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:48.923655 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:48.821755 30483 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:48.931281 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:48.810613 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:48.747376  1782 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.937172 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:48.944342 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.945286 30407 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.952234 30479 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:48.953285 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.953235 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.954320 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.954670 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:48.768162  1480 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:48.956627 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:48.892149  1728 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:48.786418  1619 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.962363  1679 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.869599  1720 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.963220 30477 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:48.888844  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43936 (request call id 468) took 2616 ms. Trace:
I20260709 13:10:48.991000  1684 rpcz_store.cc:276] 0709 13:10:46.265299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.274460 (+  9161us) service_pool.cc:224] Handling call
0709 13:10:46.821898 (+547438us) ts_tablet_manager.cc:934] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:10:47.793211 (+971313us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:48.388163 (+594952us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:48.388307 (+   144us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:48.703812 (+315505us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:48.738659 (+ 34847us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:48.879079 (+140420us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:48.881547 (+  2468us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":48450,"tablet-copy.queue_time_us":417662,"thread_start_us":290367,"threads_started":2}
I20260709 13:10:48.992993  1684 tablet_copy_client.cc:806] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:48.993714  1684 tablet_copy_client.cc:670] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:48.912187  1557 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.939795  1791 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:48.996205  1791 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:48.996621  1791 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:48.999318  1680 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:48.964150  1782 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.003643  1782 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.005509 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.006886 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:49.007460 30553 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.965081 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:48.899430  1641 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.896373  1659 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:48.878110  1481 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:48.874150  1486 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:48.966658 30483 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:48.967382 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:48.769682  1690 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:48.975466  1480 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:48.986949  1739 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 1.208s	user 0.003s	sys 0.001s
W20260709 13:10:48.988082  1785 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:48.931890  1790 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:48.938328  1693 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:48.783924  1780 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.080524  1780 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.020159 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 1999) took 1745 ms. Trace:
I20260709 13:10:49.081147 30485 rpcz_store.cc:276] 0709 13:10:47.275184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.351503 (+ 76319us) service_pool.cc:224] Handling call
0709 13:10:47.351785 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.296755 (+944970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.019924 (+723169us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400020b54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:49.020099 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171847552}
I20260709 13:10:49.020921 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.082878 30479 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:10:49.023942  1720 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.024659  1564 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.016006 30556 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:49.085520 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.057664  1486 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:49.057098 31116 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:49.087703  1486 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.088413 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:49.088687  1486 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:49.063027 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.090746 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.091112 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.091385 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.091668 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.064836 30407 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:49.092110  1781 raft_consensus.cc:2804] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:49.092636  1781 raft_consensus.cc:697] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:49.092883 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:49.093354  1690 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.065078 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.094151 30558 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:49.074681 30560 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:49.078023 30555 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:49.094384 30404 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:49.095841 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:49.086782 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.103196 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.103947 30553 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:49.104859 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:49.105464 30553 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:49.108134 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:49.107957 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 175237us
I20260709 13:10:49.109833 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.096249  1684 tablet_copy_client.cc:538] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:49.093567  1781 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.116838 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:49.118017 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.119442 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.120464 30555 raft_consensus.cc:2410] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:49.120357 31118 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:49.103544  1564 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:49.124388 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:49.103857  1695 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:49.147836 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:49.157641 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:49.158309 30553 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:49.125182  1788 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.144191  1589 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:49.145720  1695 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.165956 30553 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:49.166344 30553 pending_rounds.cc:85] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
W20260709 13:10:49.174064 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.151329  1564 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:49.166601 30553 pending_rounds.cc:107] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:49.177641 30553 raft_consensus.cc:2889] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.182015 30407 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:49.188946 30402 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:49.208817 30477 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:49.212404 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.214598  1564 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.218731 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.219832 30483 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:49.166605  1695 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.224098 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.196555  1731 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:49.187407  1589 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:49.237046 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.229182 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.229470 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:10:49.244668 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1707) took 1485 ms. Trace:
I20260709 13:10:49.245153 30552 rpcz_store.cc:276] 0709 13:10:47.754373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.760051 (+  5678us) service_pool.cc:224] Handling call
0709 13:10:49.239342 (+1479291us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400071cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:49.239510 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830609152}
I20260709 13:10:49.227921  1720 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.271595  1720 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.273707  1720 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:49.222069  1453 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:10:49.276067  1797 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:49.251314 30552 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:49.277220 30552 pending_rounds.cc:85] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:49.243800  1685 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:10:49.285498 30551 raft_consensus.cc:2410] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:49.266007  1684 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:10:49.277719 30552 pending_rounds.cc:107] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:10:49.281457 30376 leader_election.cc:336] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.708s (SENT)
I20260709 13:10:49.288522 30552 raft_consensus.cc:2889] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.277287 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.290931 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.252116  1480 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:49.293457  1720 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:49.294512 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.295583  1720 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:49.296890 30451 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.298906 30479 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.299311 30479 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.299489 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.306200  1679 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.306473 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:49.307665 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.307750  1680 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:49.308735  1680 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.309139  1680 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.309514  1680 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.311409 30559 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:49.311837 30559 pending_rounds.cc:85] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:49.312254 30559 pending_rounds.cc:107] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:49.287042  1794 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:49.312528 30559 raft_consensus.cc:2889] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.313228  1794 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:49.313690  1794 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:49.232856  1589 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.247530  1714 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.300436  1343 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:49.302475  1659 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.355196 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 604) took 1071 ms. Trace:
I20260709 13:10:49.355845 30405 rpcz_store.cc:276] 0709 13:10:48.284136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.284255 (+   119us) service_pool.cc:224] Handling call
0709 13:10:48.284576 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.292940 (+  8364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.338664 (+1045724us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5400267354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:49.355082 (+ 16418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5184256}
W20260709 13:10:49.379463 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 63344us
I20260709 13:10:49.303719  1790 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.391458 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:49.391686 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:49.317091  1794 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.393011 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:49.318774  1714 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:49.403333 30477 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:49.354175  1680 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.400758 30479 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.413450  1764 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.405105  1765 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:49.413455  1790 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:49.425686  1695 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.426276  1788 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:49.411010  1594 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:49.432828  1791 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.403545  1714 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.443707 30484 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:49.454092 31151 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:49.456189  1659 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.458035  1791 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.457896  1659 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.460532  1659 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:49.474973 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 92007.4us
I20260709 13:10:49.480466 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:49.483042  1105 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:49.564616 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.594623 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1919) took 1189 ms. Trace:
I20260709 13:10:49.554471  1564 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:10:49.597487  1807 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:49.598140 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1781) took 1259 ms. Trace:
W20260709 13:10:49.601116 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 161906us
I20260709 13:10:49.598521 30410 rpcz_store.cc:276] 0709 13:10:48.338921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.339029 (+   108us) service_pool.cc:224] Handling call
0709 13:10:48.339305 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.347665 (+  8360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.347697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.365344 (+ 17647us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.333840 (+968496us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18002e94e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:49.408499 (+ 74659us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.408541 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.408607 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.597873 (+189266us) raft_consensus.cc:1685] finished
0709 13:10:49.597891 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.598081 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20596,"raft.queue_time_us":18596,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2957,"spinlock_wait_cycles":6059264,"thread_start_us":74151,"threads_started":1,"wal-append.queue_time_us":1106378}
I20260709 13:10:49.526660 31147 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:49.618384  1684 tablet_bootstrap.cc:700] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Time spent opening tablet: real 0.154s	user 0.002s	sys 0.001s
I20260709 13:10:49.621192 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:49.623361 30477 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:49.624473 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.627435  1701 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:49.628338  1420 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:49.628589  1731 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:49.628738  1420 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:49.629215  1731 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.629834  1420 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:49.631784 30478 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:49.634641  1731 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.642254 30479 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.643220 30551 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:49.644552 30551 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:49.554520  1594 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:49.647142  1659 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.654735 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:49.664582 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.651247  1680 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:49.664628  1659 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.657945 30409 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:49.658034 30403 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:49.660063 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:49.666606 30409 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:49.660943 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:49.662460 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:49.668246 31146 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.666352  1594 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.669818 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:49.652160  1695 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.664906 30402 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:49.656575 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:49.676785 30408 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:49.660271 30405 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:49.670452 30403 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:49.671185 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:49.672271 30409 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:49.659644 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:49.683868 30404 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:49.692251 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:49.694772 30403 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:49.695133 30403 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:49.765453 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.767881 30451 leader_election.cc:336] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.537s (SENT)
I20260709 13:10:49.768045 31146 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:10:49.768631 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:49.666128  1764 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:49.685029  1420 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.773916 30403 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:49.825703 31149 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:49.692313  1680 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:49.829629 30403 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.831737 31146 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:10:49.833134 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.773540  1557 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:10:49.685407  1564 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:10:49.779944  1764 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.847905 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:49.846791 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 149730us
I20260709 13:10:49.850965  1805 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:49.847692  1812 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
W20260709 13:10:49.872991 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.874890 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:49.877000 30484 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:49.884423 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:49.885037 30484 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.887633 30479 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:49.889816 30403 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:49.849215  1791 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:49.871076  1720 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:49.914458 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 146618us
W20260709 13:10:49.923035 30451 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.588s (SENT)
W20260709 13:10:49.925738 30451 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.618s (SENT)
I20260709 13:10:49.927492 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:49.930335 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1786) took 1193 ms. Trace:
I20260709 13:10:49.911427  1594 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:49.930780 30406 rpcz_store.cc:276] 0709 13:10:48.736806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.736930 (+   124us) service_pool.cc:224] Handling call
0709 13:10:48.737246 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.916696 (+179450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.916730 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.349257 (+432527us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b2c000014c8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:49.349844 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.410919 (+ 61075us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:49.410988 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.411108 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.923802 (+512694us) raft_consensus.cc:1685] finished
0709 13:10:49.923823 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.930263 (+  6440us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7063,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9619,"spinlock_wait_cycles":8056064,"thread_start_us":236446,"threads_started":2,"wal-append.queue_time_us":105574}
W20260709 13:10:49.963759 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 111813us
W20260709 13:10:49.967291 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 96935.4us
I20260709 13:10:49.981006 30406 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:49.967597  1659 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:49.999526  1815 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:10:49.996326  1782 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.000679  1782 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.001896 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:50.006762 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.999540  1814 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:10:50.009351  1816 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:50.010751  1825 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:50.014058  1714 consensus_meta.cc:287] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.004s
I20260709 13:10:49.989312  1589 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:50.027274 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:50.066830 30478 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:50.014482  1714 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.026674  1701 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:50.030995  1825 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:50.065882  1343 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.107178 30486 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:50.030819  1659 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:10:50.028368  1765 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:50.072108  1798 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:50.112895 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 78509.4us
I20260709 13:10:50.124154 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.128145 30484 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:10:50.080578  1782 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:50.137892 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 161198us
I20260709 13:10:50.139809 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:50.083937  1701 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:50.168186 30376 leader_election.cc:336] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.973s (SENT)
I20260709 13:10:50.128075  1829 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:50.220679 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 80970.7us
I20260709 13:10:50.223793 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.111960  1343 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.231459 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:50.234040 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.140955  1782 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:50.131906  1798 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.142392  1805 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
W20260709 13:10:50.249804 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 123749us
I20260709 13:10:50.230589  1679 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:50.149617  1766 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 13:10:50.287779 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 214503us
I20260709 13:10:50.239588  1827 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:50.251148  1765 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:50.251673  1782 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:50.297412 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64692.1us
I20260709 13:10:50.299135 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.250954  1248 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:10:50.293571  1702 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.239764  1842 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:10:50.292526  1766 consensus_queue.cc:1243] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:50.291492  1824 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:50.291225  1827 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.230661  1825 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:50.318189 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.275609  1594 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:10:50.230789  1829 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.326570  1248 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:50.327037  1798 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.327986  1844 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.296613  1782 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.331192 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:50.338261 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:50.340471 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.363845 30407 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:50.363653 30406 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
W20260709 13:10:50.429064 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.510305  1794 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:50.436146  1845 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:50.438673  1798 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:50.513140  1798 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.330417  1702 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.351542  1827 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:50.438901  1826 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:10:50.437208  1833 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:10:50.439307  1804 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.049s	user 0.010s	sys 0.019s
I20260709 13:10:49.595101 30557 rpcz_store.cc:276] 0709 13:10:48.405441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.407035 (+  1594us) service_pool.cc:224] Handling call
0709 13:10:48.434501 (+ 27466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.434773 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:48.488935 (+ 54162us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.565794 (+ 76859us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.557427 (+991633us) spinlock_profiling.cc:243] Waited 977 us on lock 0x7b18002a9ca0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:10:49.557655 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.557728 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.594280 (+ 36552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.594363 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.594505 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13529,"prepare.queue_time_us":48308,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":31,"raft.queue_time_us":14012,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2297,"spinlock_wait_cycles":6071168,"thread_start_us":57857,"threads_started":1,"wal-append.queue_time_us":76024,"wal-append.run_cpu_time_us":1465,"wal-append.run_wall_time_us":1023423}
W20260709 13:10:50.527199 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.401850 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:50.437661  1834 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:10:50.535272 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:50.517046  1701 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.392302 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.460413  1343 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:50.418109  1714 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.463642  1856 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.515537  1829 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:50.555826  1420 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.722s	user 0.005s	sys 0.005s
W20260709 13:10:50.553620 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 161548us
W20260709 13:10:50.402629  1764 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.006s
I20260709 13:10:50.368487  1824 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:50.566757 30557 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:10:50.578920 30557 pending_rounds.cc:85] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:10:50.564827 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:50.571259 30411 raft_consensus.cc:2410] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:50.579589 30557 pending_rounds.cc:107] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:10:50.580035 30557 raft_consensus.cc:2889] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.581064 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 608) took 1786 ms. Trace:
I20260709 13:10:50.581383 30557 rpcz_store.cc:276] 0709 13:10:48.795157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.558822 (+1763665us) service_pool.cc:224] Handling call
0709 13:10:50.566417 (+  7595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.580829 (+ 14412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.581001 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.384418  1248 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:50.584810 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:50.558496  1798 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.560868  1594 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:50.587374 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:50.586256 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 186857us
I20260709 13:10:50.374310  1844 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.654935 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 609) took 1859 ms. Trace:
I20260709 13:10:50.655531 30557 rpcz_store.cc:276] 0709 13:10:48.795507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.596275 (+1800768us) service_pool.cc:224] Handling call
0709 13:10:50.654265 (+ 57990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.654490 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.654521 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.654568 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:50.654614 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.654718 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.654862 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:50.661763 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74497.5us
I20260709 13:10:50.669835 31153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:10:50.592516  1714 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:50.677912 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1736) took 1733 ms. Trace:
I20260709 13:10:50.678548 30557 rpcz_store.cc:276] 0709 13:10:48.944189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.656817 (+1712628us) service_pool.cc:224] Handling call
0709 13:10:50.677278 (+ 20461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.677495 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.677528 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.677590 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:50.677639 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.677709 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.677845 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.593941  1594 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:50.637766  1765 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:50.672206  1798 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:50.566511  1856 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.651055  1420 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:50.675616  1841 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:50.682096  1804 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:50.688464  1594 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:50.596339  1782 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.676841  1714 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.579216  1764 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.723522 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 611) took 1697 ms. Trace:
I20260709 13:10:50.734552 30557 rpcz_store.cc:276] 0709 13:10:49.025649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.686311 (+1660662us) service_pool.cc:224] Handling call
0709 13:10:50.722404 (+ 36093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.722581 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.722605 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.722647 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:50.722681 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.723332 (+   651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.723463 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.686467  1791 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:50.746764 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 83725.7us
W20260709 13:10:50.755030 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 88521.6us
I20260709 13:10:50.757090 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 614) took 1730 ms. Trace:
I20260709 13:10:50.757618 30557 rpcz_store.cc:276] 0709 13:10:49.026636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.735513 (+1708877us) service_pool.cc:224] Handling call
0709 13:10:50.756427 (+ 20914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.756658 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.756695 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.756753 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:50.756796 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.756866 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.757019 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.741233  1714 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:50.730363  1420 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.741916  1841 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:50.772497 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 616) took 1384 ms. Trace:
I20260709 13:10:50.772891 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:50.773023 30557 rpcz_store.cc:276] 0709 13:10:49.388389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.763884 (+1375495us) service_pool.cc:224] Handling call
0709 13:10:50.771869 (+  7985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.772078 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.772114 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.772169 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:50.772214 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.772284 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.772424 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.722280  1765 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.726815  1798 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.782994 31153 raft_consensus.cc:606] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:50.796190  1847 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:10:50.785948 30557 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:50.797374 30557 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:50.750046  1791 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.807389 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:50.798156 30557 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.808326 30478 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:50.809748 30557 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.811784 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:50.785559  1702 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.749574  1248 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.823293 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:50.824595 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.732806  1824 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.828998 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:50.833058  1840 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 13:10:50.835798  1729 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:50.836282  1729 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:50.837141  1729 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.840350  1798 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:50.840907  1857 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:10:50.855881 30557 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:50.856294 30557 pending_rounds.cc:85] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:10:50.856510 30557 pending_rounds.cc:107] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:50.856730 30557 raft_consensus.cc:2889] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.857347 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 617) took 1466 ms. Trace:
I20260709 13:10:50.857641 30557 rpcz_store.cc:276] 0709 13:10:49.391320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.774321 (+1383001us) service_pool.cc:224] Handling call
0709 13:10:50.785798 (+ 11477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.857131 (+ 71333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.857300 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.859829  1729 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:50.884785 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:50.886376 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:50.896183 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1929) took 2479 ms. Trace:
I20260709 13:10:50.903254 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1924) took 2492 ms. Trace:
I20260709 13:10:50.904189 30553 rpcz_store.cc:276] 0709 13:10:48.411587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.178638 (+767051us) service_pool.cc:224] Handling call
0709 13:10:49.178970 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.179204 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.179229 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.179724 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.295342 (+115618us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.295927 (+   585us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.360086 (+1064159us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:50.895446 (+535360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.895520 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.895567 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:50.903030 (+  7463us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.903188 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1599288,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":14545792,"thread_start_us":115288,"threads_started":1,"wal-append.queue_time_us":115650}
I20260709 13:10:50.896819 30554 rpcz_store.cc:276] 0709 13:10:48.416807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.249823 (+833016us) service_pool.cc:224] Handling call
0709 13:10:49.299704 (+ 49881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.895680 (+1595976us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:50.895726 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.895783 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:50.895833 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.895916 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.896107 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1578769}
W20260709 13:10:50.912539  1866 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 13:10:50.912937  1759 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.913324  1856 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:50.913546  1759 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.914088  1743 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.914605  1743 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.916538  1743 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:50.896260  1737 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.918048  1737 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.920084  1737 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:50.891968  1707 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:50.916785  1759 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:50.922880  1712 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.923820  1712 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:50.925906  1712 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:50.926991  1765 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:50.890215  1782 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.894567  1844 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.829911  1841 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.959937 30484 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:50.961447  1733 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.961681  1791 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.961913  1734 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.962003  1733 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:50.917279  1827 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.903076  1764 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.929708  1420 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:50.962123 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:50.962831  1734 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:50.935141  1695 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.015522  1564 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:51.016911  1730 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:51.017747 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 95506.9us
W20260709 13:10:51.030476 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 153386us
I20260709 13:10:51.032568 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.034257 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.036795 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.028328  1619 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:51.051116 30376 leader_election.cc:336] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.424s (SENT)
I20260709 13:10:51.069805 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:51.071226 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:51.073727 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:51.017367  1655 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:51.072127 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 230767us
I20260709 13:10:51.076795 30478 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.077255 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:51.078047 30483 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:51.084997 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:51.043078  1759 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:51.042886  1599 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.087764 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.088883  1260 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.082854  1619 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.082548  1655 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.035746  1594 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.096257  1828 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:51.093247  1260 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.031978  1712 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:10:51.153784 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.155320  1843 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.155814  1843 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.156267 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.156875 30403 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:51.157812 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.157910  1843 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.092243 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:51.031803  1695 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.090273  1743 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.128336  1734 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.031670  1730 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.044530  1707 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:10:51.080482  1824 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.150283 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.152424  1594 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.153293  1260 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.191879  1105 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:51.202354  1105 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.205775  1730 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.207016  1442 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.207552  1442 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.207793  1619 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.185519  1743 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.209399  1442 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.199064  1330 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:51.210404  1330 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:51.211580  1888 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:10:51.212529  1330 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.159422 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.213758 30403 raft_consensus.cc:2410] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:10:51.148319  1733 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.160478 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.164680 30478 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
W20260709 13:10:51.166728 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74543.6us
I20260709 13:10:51.222658 30484 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.158331 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.179193  1823 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.223640 30407 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:51.132071  1827 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.133430  1728 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.158407  1843 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:51.147207  1828 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:51.198750 30402 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:51.199277 31148 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:10:51.200843  1895 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:51.201555  1655 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.159246 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.180295  1766 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.177531  1731 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.222249 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:51.229398 30403 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:51.234668 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1944) took 2813 ms. Trace:
I20260709 13:10:51.218430  1791 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:51.252751 30556 rpcz_store.cc:276] 0709 13:10:48.420874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.336391 (+915517us) service_pool.cc:224] Handling call
0709 13:10:49.336855 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.898357 (+1561502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.898402 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.906536 (+  8134us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.940775 (+ 34239us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.079530 (+138755us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.234355 (+154825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.234433 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.234481 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:51.234494 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.234616 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1615898,"prepare.queue_time_us":210642,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":1651790,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":14254,"thread_start_us":250364,"threads_started":3,"wal-append.queue_time_us":128005}
I20260709 13:10:51.233871  1743 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.215147  1824 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.272385 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.246599  1737 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.230708  1679 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:51.235673  1765 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:51.232178  1714 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.263877  1733 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:51.284359  1882 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.267s	user 0.001s	sys 0.001s
I20260709 13:10:51.295531  1695 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.356226 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.349910 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:51.357090 30554 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:51.295655 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1728) took 2517 ms. Trace:
I20260709 13:10:51.243844  1891 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:51.298322 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:51.367820 30477 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:10:51.298748 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.233772  1728 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.300050 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.369705 31148 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:10:51.315063  1442 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.264498  1736 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:51.316676  1701 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:51.317384  1875 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:51.316694 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.397557 30402 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:10:51.319720 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:51.324091 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.328644 30556 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:51.329316 30557 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:51.264616  1655 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:51.295351  1885 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:10:51.234287  1823 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.255707  1894 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.345374 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:51.408905 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 89297.2us
I20260709 13:10:51.409340 30405 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:51.410667 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:51.347290 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.348060 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.285291  1330 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.245833  1843 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.274101  1892 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.358292 30551 rpcz_store.cc:276] 0709 13:10:48.778563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.645260 (+866697us) service_pool.cc:224] Handling call
0709 13:10:49.645607 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.909437 (+1263830us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:50.909463 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.930389 (+ 20926us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.245760 (+315371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:51.245800 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.245866 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.295447 (+ 49581us) raft_consensus.cc:1685] finished
0709 13:10:51.295464 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.295593 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1257527,"raft.queue_time_us":1266818,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":215182,"threads_started":1,"wal-append.queue_time_us":341398}
I20260709 13:10:51.372277  1700 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.264205  1791 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.356268  1619 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.383435 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:51.383785  1891 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.365733  1842 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:51.385706 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.386967 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1943) took 2966 ms. Trace:
I20260709 13:10:51.388144  1743 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:51.390584 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1921) took 2963 ms. Trace:
I20260709 13:10:51.329373  1734 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.435570 30554 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:51.260371  1731 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.398686 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:51.378758  1845 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:51.407362 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:51.413072 30403 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:51.414588 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.436055 30560 rpcz_store.cc:276] 0709 13:10:48.420615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.332764 (+912149us) service_pool.cc:224] Handling call
0709 13:10:49.333242 (+   478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:50.897264 (+1564022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.897308 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:51.202487 (+305179us) spinlock_profiling.cc:243] Waited 916 us on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:51.206938 (+  4451us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:51.207463 (+   525us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.263999 (+ 56536us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.286829 (+ 22830us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.367357 (+ 80528us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.386470 (+ 19113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.386567 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.386621 (+    54us) raft_consensus.cc:1685] finished
0709 13:10:51.386647 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.386890 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1664415,"prepare.queue_time_us":28443,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":69,"raft.queue_time_us":1681857,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18959,"spinlock_wait_cycles":33691776,"thread_start_us":56033,"threads_started":1,"wal-append.queue_time_us":72292}
I20260709 13:10:51.444615 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.445748  1891 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.446583 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2052) took 1436 ms. Trace:
I20260709 13:10:51.446969 30486 rpcz_store.cc:276] 0709 13:10:50.010390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.010541 (+   151us) service_pool.cc:224] Handling call
0709 13:10:50.010892 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.107789 (+ 96897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.446354 (+1338565us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b5400111a54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:51.446524 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220888960}
I20260709 13:10:51.426973  1892 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.424007  1330 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.450508  1892 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.417739 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.424007 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.332299  1105 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.428166  1714 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.403162  1736 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:10:51.430956  1900 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:51.416596  1844 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:51.419795  1856 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:51.434247 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:51.464838 30551 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.378482  1733 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.438105 30555 rpcz_store.cc:276] 0709 13:10:48.406109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.152724 (+746615us) service_pool.cc:224] Handling call
0709 13:10:49.161564 (+  8840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.902615 (+1741051us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:51.051312 (+148697us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.285704 (+234392us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.291729 (+  6025us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.291871 (+   142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.292079 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.369311 (+ 77232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.369415 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.369468 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:51.369488 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.369648 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1846689,"prepare.queue_time_us":242827,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":1888037,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":34442,"spinlock_wait_cycles":47872,"thread_start_us":271816,"threads_started":2,"wal-append.queue_time_us":173372}
I20260709 13:10:51.375303  1828 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.441494 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.332921  1855 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.425570  1790 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.451660 30405 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:51.416637 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:51.478121 30554 raft_consensus.cc:2410] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:10:51.478405 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61902.6us
I20260709 13:10:51.453608 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.440025  1743 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.455442 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.480260 30557 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:51.450680  1731 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.416385  1655 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.423431  1894 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.342337  1760 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.469238 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.495563 30555 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:51.472725 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1941) took 3052 ms. Trace:
I20260709 13:10:51.496487 30552 rpcz_store.cc:276] 0709 13:10:48.420088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.289822 (+869734us) service_pool.cc:224] Handling call
0709 13:10:49.290189 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.895111 (+1604922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.895144 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.128216 (+233072us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:51.128603 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.273144 (+144541us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.286974 (+ 13830us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.387773 (+100799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.387879 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.472397 (+ 84518us) raft_consensus.cc:1685] finished
0709 13:10:51.472506 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.472661 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1735407,"prepare.queue_time_us":18134,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":1721743,"raft.run_cpu_time_us":709,"raft.run_wall_time_us":49431,"spinlock_wait_cycles":6704000,"thread_start_us":144184,"threads_started":1,"wal-append.queue_time_us":314910}
I20260709 13:10:51.494769 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.473557  1843 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.476534  1791 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.481269 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.506453 30557 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:51.506628 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.507287 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.503042 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.507608 30554 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:51.438078  1619 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.511997 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2053) took 1494 ms. Trace:
I20260709 13:10:51.507910 30557 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:10:51.487082 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.509111 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.464116  1824 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.464460  1856 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.509397 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.451169  1734 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.512377 30480 rpcz_store.cc:276] 0709 13:10:50.017938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.024650 (+  6712us) service_pool.cc:224] Handling call
0709 13:10:50.024925 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.877670 (+852745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.877699 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.877736 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:50.877772 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.511780 (+634008us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002bded4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:51.511830 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.511942 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960634240}
I20260709 13:10:51.520857 30552 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:51.492053  1743 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.491384  1790 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.521556 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.514770 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.520674 30407 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:51.514542 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:51.522444 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 81575us
I20260709 13:10:51.522527 30555 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:51.523212 30557 raft_consensus.cc:2410] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:51.524044 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.526854 30555 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:51.527361 30553 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:51.495338  1788 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:51.512320  1828 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.521852  1856 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.477909  1844 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.530332  1765 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.565161  1765 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.566530  1728 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.567592  1765 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.568143 30406 raft_consensus.cc:1217] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:10:51.568632 30406 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:51.513567  1760 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.571511 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.544881  1655 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.548143  1823 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.529721  1790 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.551216  1105 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.556396 30551 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:10:51.559621 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.572489 30560 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:51.545490  1733 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.574891 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:51.584265 30409 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.578840 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.505945  1855 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.532114  1788 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.566399  1844 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.572019  1736 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:51.720311 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 57735us
I20260709 13:10:51.699644 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.718457 30556 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:10:51.807291 30411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1803) took 2139 ms (client timeout 1918 ms). Trace:
I20260709 13:10:51.840535 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:51.840452 30411 rpcz_store.cc:269] 0709 13:10:49.667967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.670939 (+  2972us) service_pool.cc:224] Handling call
0709 13:10:51.807029 (+2136090us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540039a3d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:51.807188 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048466304}
I20260709 13:10:51.640374 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:51.718457 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.843923 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.842401 30409 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.853715 30409 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:51.874132 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:51.661952  1851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.043s	sys 0.078s
I20260709 13:10:51.879163 30402 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:51.844700  1760 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:51.830534  1888 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.585s	user 0.003s	sys 0.000s
W20260709 13:10:51.660583  1914 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:10:51.851600 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:51.884439 30411 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:51.884908 30409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:51.885499 30409 raft_consensus.cc:606] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.885785 30409 raft_consensus.cc:614] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.590356  1619 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.816165  1894 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.797250  1734 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.687252  1855 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.816250  1764 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.590798 31147 raft_consensus.cc:1217] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
W20260709 13:10:51.734385  1684 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:10:51.881301 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:51.594033  1788 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:51.882701  1851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.059s	sys 0.095s
I20260709 13:10:51.896852 30411 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:51.898263 30408 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:51.901015  1714 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:51.901544  1714 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.903769  1714 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.904354  1714 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.904820  1714 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.891897  1764 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.889590  1105 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:51.907747  1105 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.909117  1764 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.909348  1856 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.910498 30406 raft_consensus.cc:2368] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9.
I20260709 13:10:51.911895 31151 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:51.900326  1743 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.914280  1743 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.915588  1856 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.916558 30554 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:51.917382 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:51.919970  1894 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.920629  1894 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.920991  1894 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.921216  1714 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.917882  1921 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.922768 30485 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:51.923187 30485 pending_rounds.cc:85] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:10:51.923399 30485 pending_rounds.cc:107] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:51.923616 30485 raft_consensus.cc:2889] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.925160 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.922176  1921 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.926765 31147 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:51.929031 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.930171 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.931829  1260 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.931881 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.932571 30408 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:10:51.932474  1260 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.933133 30551 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:51.934293 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:51.934856 30551 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.937752 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.935240 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:51.909897  1105 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:51.939527 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:51.929736  1918 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:10:51.935089 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:51.936386 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 553025us
I20260709 13:10:51.949754 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:51.951459  1700 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.943008  1343 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.952042  1700 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.945447  1892 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:51.954391  1700 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:51.957015 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:51.957614 31146 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:51.934661  1260 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:51.958307 30552 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:51.961012 30552 pending_rounds.cc:85] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:10:51.961258 30552 pending_rounds.cc:107] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:51.961485 30552 raft_consensus.cc:2889] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.958611 30525 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:51.963220 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:51.939205  1707 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.969795 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567508f2962f473b8fac20c97a240f35"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:10:51.919090  1832 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:51.970373 31146 raft_consensus.cc:606] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.983456 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:51.984985 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:51.988135 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1942) took 3567 ms. Trace:
I20260709 13:10:51.973483  1684 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:51.988674 30559 rpcz_store.cc:276] 0709 13:10:48.420351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.313495 (+893144us) service_pool.cc:224] Handling call
0709 13:10:49.313892 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.895533 (+1581641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.895559 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.131441 (+235882us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b2c000bb5a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:10:51.131845 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.402127 (+270282us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.405372 (+  3245us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.934530 (+529158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.934601 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.979739 (+ 45138us) raft_consensus.cc:1685] finished
0709 13:10:51.987866 (+  8127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.988046 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2134637,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":2129646,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":3160,"spinlock_wait_cycles":6024576,"thread_start_us":269885,"threads_started":1,"wal-append.queue_time_us":373844}
I20260709 13:10:51.994822 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.996770 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.997495 30557 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:51.998293 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:51.998586  1894 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:51.999337 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.000195 30557 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.003124  1892 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.002571  1684 tablet_bootstrap.cc:492] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:10:52.003705  1892 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.004220  1892 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.004308  1684 ts_tablet_manager.cc:1403] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 2.745s	user 0.039s	sys 0.061s
I20260709 13:10:51.996693  1921 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.010174 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:51.996739  1925 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:52.016314  1894 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.017699 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:51.970016  1782 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:51.992949  1909 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.975311  1731 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:52.007617  1700 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.011236  1734 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.027804 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:51.972461  1707 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:51.973985  1564 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:52.005411  1729 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.030483 30557 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:52.007798  1599 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:52.025102 30551 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:10:52.031762 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.023406 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.037783 30557 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.021654  1260 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:52.019654  1912 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:52.039965 30451 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.826s (SENT) [suppressed 30 similar messages]
I20260709 13:10:52.038365 30559 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.029057  1700 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.041371 30555 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:52.044184 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.045111 30559 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:52.045774 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.046474 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.053328 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.040068  1260 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:52.061836 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 93677.9us
I20260709 13:10:52.064119 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:52.065052  1260 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.041800  1912 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.071337 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 170111us
I20260709 13:10:52.030185  1734 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.043504  1700 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.072405 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.073973 30557 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:52.073457  1912 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.078480 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.078953 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:52.079303 30409 raft_consensus.cc:2410] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:52.083171 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.084190 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:52.086915  1929 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:52.087132 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.087456  1734 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:52.085724 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:52.087718  1921 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:52.089792 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.089876  1921 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:52.090960  1921 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.092083  1921 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.095129 30557 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.095058  1932 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.095645  1932 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.095963  1932 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.096061 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.096256  1832 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:52.099356 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.099550 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.099948 30402 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:52.100435 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.101214 30404 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:52.101533 30403 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:52.101877 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.088743 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:52.102392 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.102790 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.102422 30404 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:52.103031 30403 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:52.103567 30411 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:52.103849 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:52.104311 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.104943 30408 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:52.107721 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.108793 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.109330 30551 raft_consensus.cc:2376] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8. Re-sending same reply.
I20260709 13:10:52.110158 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.081123  1846 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:52.113658  1828 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:52.114545 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:52.114319  1684 raft_consensus.cc:359] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.114909  1828 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:52.115787  1684 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:10:52.116263 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:52.115819  1828 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.116564 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.117291 30409 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:52.116626  1684 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:52.110666 30551 raft_consensus.cc:2376] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11. Re-sending same reply.
I20260709 13:10:52.122455 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:52.123080 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.123813 30557 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.105557  1929 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:52.138216 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.138962 30551 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:52.138857  1891 consensus_queue.cc:1059] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:52.141134 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.074807  1788 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.145561 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.148609 30557 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.145301 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:52.147670  1929 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:52.155174 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:52.160573  1684 ts_tablet_manager.cc:1434] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.000s
I20260709 13:10:52.161937  1619 raft_consensus.cc:3055] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:52.162389  1619 raft_consensus.cc:740] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:52.163210  1619 consensus_queue.cc:260] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.163825 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.164253  1841 raft_consensus.cc:993] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:10:52.164815  1841 raft_consensus.cc:1081] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:10:52.165036 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.143795  1729 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:52.167438 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.167806 31151 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:52.169337 30405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:10:52.173103 30405 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.173565 30405 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.144726  1105 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:52.171746 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.187116 30551 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:52.175848 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.097440  1790 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.150759  1743 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:52.150907  1765 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:52.171478  1929 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.177820  1707 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.189653  1891 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:52.180416  1909 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:52.184448  1729 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:52.237349 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:52.260406 30557 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:52.297760 30406 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:52.119838  1912 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:52.262557 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.298322 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.284292  1330 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.284821  1790 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.281731  1679 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:52.288390  1892 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.147192  1825 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:52.180377  1788 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:52.177491  1828 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:52.238996  1743 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.307590  1743 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.307686  1892 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.238615  1557 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:52.301153 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.311465 30557 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.311084  1557 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.312950 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.260689  1105 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:52.314208 30557 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 3.
I20260709 13:10:52.315574 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.315541  1679 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.316483 30557 raft_consensus.cc:2376] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10. Re-sending same reply.
I20260709 13:10:52.317525 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.319476 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.321102 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.321556  1825 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:52.321786 30557 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:52.322072  1825 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.322909 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.323585 30557 raft_consensus.cc:2376] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9. Re-sending same reply.
I20260709 13:10:52.324337 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.324990 30557 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:52.324849  1825 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.325536 30450 leader_election.cc:400] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9.
I20260709 13:10:52.325707 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:52.303716 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.326426 30551 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:52.327255 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.325922 30450 leader_election.cc:403] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.328342  1828 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.330220 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:52.294095  1260 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.239607  1760 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:52.331985 30557 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:52.296356  1909 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.333415 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:52.299783  1729 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.337180 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:52.337873 30376 leader_election.cc:336] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.918s (SENT)
I20260709 13:10:52.339072 30559 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:52.339010 30406 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.340668 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:52.343791 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:52.348728 30406 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:10:52.305361  1707 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.291505  1932 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.291828  1765 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.351411 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:52.358474 31148 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.353636 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.354087 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.354624 30404 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:52.356335 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.317976  1679 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.330611  1828 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.313858  1557 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.360946 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.340210  1909 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.328349  1825 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:52.472112 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.495039 30406 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:52.486734 31148 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:10:52.352651  1894 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.301621  1700 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:52.516317  1260 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:52.520464  1921 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:52.521281  1921 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.522387 30405 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.524322 30405 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:52.340464  1760 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.470999  1738 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:52.357846  1707 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.352571  1105 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.532483 30405 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:53.091183  1700 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:52.912850  1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.012s
I20260709 13:10:53.092473 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.096307  1738 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:52.853179 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.099210  1738 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:52.603340  1765 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:52.970299  1679 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.988932  1932 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:52.841826  1934 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.546s	user 0.002s	sys 0.000s
I20260709 13:10:52.973994  1825 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9.
I20260709 13:10:52.634087  1912 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.104812 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:53.092758  1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.008s	sys 0.013s
I20260709 13:10:53.106413  1760 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:52.914649 30408 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.008s
I20260709 13:10:52.632843 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:53.126946 30408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.012s
I20260709 13:10:53.127192 30407 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:53.128050 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:52.637969  1851 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.107815  1921 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.108630 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 622) took 1180 ms. Trace:
I20260709 13:10:53.135959 30552 rpcz_store.cc:276] 0709 13:10:51.928143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.945056 (+ 16913us) service_pool.cc:224] Handling call
0709 13:10:51.945326 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.961929 (+ 16603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.107504 (+1145575us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54000ee7d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:53.107694 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26190080}
I20260709 13:10:53.136868 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:53.138123 30402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.009s
I20260709 13:10:53.107982  1891 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.118779  1700 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.133987  1851 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:52.631283  1828 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.138070 30556 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.107089 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.135488  1693 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.141556 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:53.117909  1734 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.175642 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1975) took 1063 ms. Trace:
I20260709 13:10:53.176203 30552 rpcz_store.cc:276] 0709 13:10:52.112224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.141278 (+1029054us) service_pool.cc:224] Handling call
0709 13:10:53.175542 (+ 34264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.177513 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:53.178428 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1775) took 1018 ms. Trace:
I20260709 13:10:53.210889 30552 rpcz_store.cc:276] 0709 13:10:52.159715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.177191 (+1017476us) service_pool.cc:224] Handling call
0709 13:10:53.178368 (+  1177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:53.145349 30410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.022s	sys 0.013s
I20260709 13:10:53.129251  1825 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.247411  1825 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.249763  1825 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.120177  1738 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.250593  1738 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:53.252377 30410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.022s	sys 0.013s
I20260709 13:10:53.252928  1738 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.253211  1707 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.147877  1891 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.256214  1891 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.155181  1828 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.127630  1679 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:53.138708 30402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.009s
I20260709 13:10:53.269434 30556 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:53.271809 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 624) took 1343 ms. Trace:
I20260709 13:10:53.272343 30556 rpcz_store.cc:276] 0709 13:10:51.928735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.270603 (+1341868us) service_pool.cc:224] Handling call
0709 13:10:53.271187 (+   584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.271407 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.271444 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.271498 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:53.271541 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.271610 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.271744 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.238418  1921 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.149809  1700 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.284436 31151 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:53.238056  1734 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.286520 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:53.299258 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:53.300341 31151 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:53.284229  1921 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.312341 31151 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:53.304962  1937 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:10:53.320351  1619 raft_consensus.cc:3060] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:53.321916 30525 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.317656 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:53.325634  1707 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:53.326151 30560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1954) took 2000 ms (client timeout 1638 ms). Trace:
W20260709 13:10:53.326568 30560 rpcz_store.cc:269] 0709 13:10:51.325785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.444386 (+118601us) service_pool.cc:224] Handling call
0709 13:10:53.325930 (+1881544us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003381d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.326059 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292772096}
I20260709 13:10:53.327924 30560 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.328555 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1738) took 1382 ms. Trace:
I20260709 13:10:53.328890 30560 rpcz_store.cc:276] 0709 13:10:51.946100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.327389 (+1381289us) service_pool.cc:224] Handling call
0709 13:10:53.327684 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.328319 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.328494 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.330544 30560 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:53.311724  1743 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.000s
W20260709 13:10:53.336690 30555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 621) took 1408 ms (client timeout 1581 ms). Trace:
W20260709 13:10:53.337215 30555 rpcz_store.cc:269] 0709 13:10:51.927827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.930929 (+  3102us) service_pool.cc:224] Handling call
0709 13:10:53.336492 (+1405563us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b54001d9cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.336621 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212169088}
I20260709 13:10:53.334388 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 629) took 1388 ms. Trace:
I20260709 13:10:53.338449 30560 rpcz_store.cc:276] 0709 13:10:51.946363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.329769 (+1383406us) service_pool.cc:224] Handling call
0709 13:10:53.330116 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.334104 (+  3988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.334330 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.320546  1921 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.343642 30560 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:53.331017  1891 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:10:53.323175  1828 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:53.345414 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1741) took 1398 ms. Trace:
I20260709 13:10:53.355010 30560 rpcz_store.cc:276] 0709 13:10:51.946584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.339722 (+1393138us) service_pool.cc:224] Handling call
0709 13:10:53.339996 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.344195 (+  4199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.345347 (+  1152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.356681 30560 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:53.352330  1891 consensus_queue.cc:1243] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:53.357401  1700 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.339501  1743 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.359961  1712 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:53.360435  1712 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:53.361393  1743 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.361426  1712 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.363822  1712 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.357403 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1744) took 1410 ms. Trace:
I20260709 13:10:53.364920 30560 rpcz_store.cc:276] 0709 13:10:51.947172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.356041 (+1408869us) service_pool.cc:224] Handling call
0709 13:10:53.356428 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.357105 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.357340 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.367105 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1747) took 1419 ms. Trace:
I20260709 13:10:53.367859 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:53.367971  1729 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.013s	user 0.011s	sys 0.000s
I20260709 13:10:53.375128 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1835) took 1019 ms. Trace:
I20260709 13:10:53.375716  1729 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.375656 30403 rpcz_store.cc:276] 0709 13:10:52.355979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.359966 (+  3987us) service_pool.cc:224] Handling call
0709 13:10:53.374200 (+1014234us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:53.374449 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.374685 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.374742 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.374799 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:53.374852 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.374924 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.375055 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005760}
I20260709 13:10:53.377077 30551 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:53.379282  1729 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.374207 30556 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:10:53.379977 30556 pending_rounds.cc:85] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:53.380249 30556 pending_rounds.cc:107] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:10:53.380510 30556 raft_consensus.cc:2889] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:53.372872 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.383116  1105 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.383684  1105 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.384627 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 1961) took 2043 ms. Trace:
I20260709 13:10:53.385152 30554 rpcz_store.cc:276] 0709 13:10:51.340848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.514483 (+173635us) service_pool.cc:224] Handling call
0709 13:10:53.384371 (+1869888us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54000721d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.384551 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905808128}
I20260709 13:10:53.386727  1828 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.387372  1828 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:53.389628  1943 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:53.389717  1828 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:53.391669 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38476 (request call id 2) took 1422 ms. Trace:
W20260709 13:10:53.393908  1909 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.002s
I20260709 13:10:53.340855  1701 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:53.395265  1701 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.396054 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1749) took 1448 ms. Trace:
I20260709 13:10:53.396521 30559 rpcz_store.cc:276] 0709 13:10:51.947878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.046334 (+ 98456us) service_pool.cc:224] Handling call
0709 13:10:53.395811 (+1349477us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002472d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.395983 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664353152}
I20260709 13:10:53.398133  1700 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.398674  1700 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.402765  1851 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.404433 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2078) took 1286 ms. Trace:
I20260709 13:10:53.404800 30409 rpcz_store.cc:276] 0709 13:10:52.118431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.118774 (+   343us) service_pool.cc:224] Handling call
0709 13:10:52.119198 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.120305 (+  1107us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:52.120348 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.120871 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.354833 (+233962us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:52.354890 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.354982 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.404239 (+1049257us) raft_consensus.cc:1685] finished
0709 13:10:53.404259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.404376 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682,"raft.queue_time_us":22757,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3872,"thread_start_us":186321,"threads_started":1,"wal-append.queue_time_us":699736}
I20260709 13:10:53.406369 30555 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:53.392159 31146 rpcz_store.cc:276] 0709 13:10:51.969514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.969647 (+   133us) service_pool.cc:224] Handling call
0709 13:10:53.391260 (+1421613us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b540031b620. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045026520 00007fa0450a3652 00007fa04a07160a 00007fa0435f77d4 00007fa0435f7762 00007fa0435f7691 00007fa0435f760c 00007fa0435f68c2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:53.391567 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101299968}
I20260709 13:10:53.398327 30559 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:53.413127 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.401278 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.409682 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.450654 30559 pending_rounds.cc:85] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:10:53.451145 30559 pending_rounds.cc:107] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:53.451618 30559 raft_consensus.cc:2889] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.431758 30481 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:53.452514 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.424582 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.454348 30479 raft_consensus.cc:2410] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:53.454906 30486 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:53.455585 30560 rpcz_store.cc:276] 0709 13:10:51.947597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.365960 (+1418363us) service_pool.cc:224] Handling call
0709 13:10:53.366485 (+   525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.366725 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.366752 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.366795 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:53.366828 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.366902 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.367042 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.439699 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.459681 30477 raft_consensus.cc:2410] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:53.394325  1909 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:53.460834 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59643.4us
I20260709 13:10:53.467087 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.468279 30484 raft_consensus.cc:2410] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:53.448724  1929 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:53.483345 30451 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.909s (SENT)
I20260709 13:10:53.495844 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.493837 30557 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:53.500972 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1758) took 1541 ms. Trace:
I20260709 13:10:53.501408 30557 rpcz_store.cc:276] 0709 13:10:51.959149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.492996 (+1533847us) service_pool.cc:224] Handling call
0709 13:10:53.493384 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.500601 (+  7217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.500902 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.386273  1105 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:53.504050 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.506650 30477 raft_consensus.cc:2368] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
W20260709 13:10:53.507122 30451 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.105s (SENT)
W20260709 13:10:53.508198 30451 connection.cc:256] RPC call timeout handler was delayed by -1.2990006490000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3286s for a response
I20260709 13:10:53.452579 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1751) took 1504 ms. Trace:
I20260709 13:10:53.508756 30559 rpcz_store.cc:276] 0709 13:10:51.948161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.397501 (+1449340us) service_pool.cc:224] Handling call
0709 13:10:53.397900 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.452281 (+ 54381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.452510 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.400359  1693 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:53.512472 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.514287 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:53.399595  1734 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.515977 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.514771  1823 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.519490  1832 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.519889  1825 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.522969 30307 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.524027 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1739) took 1577 ms. Trace:
I20260709 13:10:53.524088 30451 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.522341 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 623) took 1593 ms. Trace:
W20260709 13:10:53.485170  1935 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.884s	user 0.011s	sys 0.014s
I20260709 13:10:53.529457 30479 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:10:53.532545 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.536259 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1780) took 1354 ms. Trace:
I20260709 13:10:53.565045 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.565338 30551 rpcz_store.cc:276] 0709 13:10:52.182024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.327017 (+144993us) service_pool.cc:224] Handling call
0709 13:10:53.536049 (+1209032us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001e5fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.536186 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412822784}
I20260709 13:10:53.541970 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 625) took 1613 ms. Trace:
I20260709 13:10:53.567705 30556 rpcz_store.cc:276] 0709 13:10:51.928988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.273746 (+1344758us) service_pool.cc:224] Handling call
0709 13:10:53.274124 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.381026 (+106902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.541633 (+160607us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b5400185954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:53.541889 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229181824}
I20260709 13:10:53.564374 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:53.491353  1701 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:53.398913  1953 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:10:53.491053  1679 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.491146  1707 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:53.408918  1743 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.572487 30552 rpcz_store.cc:276] 0709 13:10:51.928458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.240220 (+1311762us) service_pool.cc:224] Handling call
0709 13:10:53.240662 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.289497 (+ 48835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.289540 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.289600 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:53.289644 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.522058 (+232414us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54003395d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:53.522115 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.522271 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111765888}
W20260709 13:10:53.585925 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 213261us
I20260709 13:10:53.513221 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1757) took 1555 ms. Trace:
I20260709 13:10:53.588657 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:53.580811 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1976) took 1468 ms. Trace:
I20260709 13:10:53.564318 30555 rpcz_store.cc:276] 0709 13:10:51.946259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.338209 (+1391950us) service_pool.cc:224] Handling call
0709 13:10:53.406161 (+ 67952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.406970 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.523783 (+116813us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b54000721d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:53.523948 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155313536}
I20260709 13:10:53.584677 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 651) took 1250 ms. Trace:
I20260709 13:10:53.588833 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:53.573935 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.576007 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.529874  1700 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.515009  1105 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.589406 30553 rpcz_store.cc:276] 0709 13:10:52.112440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.579937 (+1467497us) service_pool.cc:224] Handling call
0709 13:10:53.580324 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.580497 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.580521 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.580561 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.580589 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.580640 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.580752 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.592672 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.588001 30560 rpcz_store.cc:276] 0709 13:10:51.957417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.458140 (+1500723us) service_pool.cc:224] Handling call
0709 13:10:53.458528 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.458765 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.458798 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.458844 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:53.458888 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.458953 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.513155 (+ 54202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.589864 30408 rpcz_store.cc:276] 0709 13:10:52.334314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.334468 (+   154us) service_pool.cc:224] Handling call
0709 13:10:52.334768 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.334960 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:53.127378 (+792418us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.584124 (+456746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.584350 (+   226us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:53.584403 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.584474 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.584614 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":756700,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"thread_start_us":1232603,"threads_started":2}
W20260709 13:10:53.608151 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 476782us
I20260709 13:10:53.627293 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.569684  1874 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.470655  1929 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.628681 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.581648  1619 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:53.526414  1891 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:10:53.628791 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:53.599195 30307 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 5, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 5 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.607470  1679 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:53.650220 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:53.569849  1832 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.591039  1880 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.652742 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.625828  1707 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:53.633119  1921 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:53.630443  1876 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:53.695075 30560 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:53.695925 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1774) took 1536 ms. Trace:
I20260709 13:10:53.696424 30560 rpcz_store.cc:276] 0709 13:10:52.159490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.694192 (+1534702us) service_pool.cc:224] Handling call
0709 13:10:53.694608 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.695609 (+  1001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.695854 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.700321 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.657796 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:53.584233  1825 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.690142 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.607559  1743 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.629496  1105 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.654299  1701 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.607071  1564 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:10:53.701572 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43872.4us
I20260709 13:10:53.675920 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1838) took 1177 ms. Trace:
I20260709 13:10:53.649235  1734 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.705243 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.636490  1693 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:10:53.708542 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.665743  1714 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.689849  1921 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.739030 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.740108 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.740211 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.740792 30409 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.740973 30486 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:53.715593  1765 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:53.717715 30410 rpcz_store.cc:276] 0709 13:10:52.498285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.498439 (+   154us) service_pool.cc:224] Handling call
0709 13:10:52.511101 (+ 12662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.511316 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:53.252827 (+741511us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.675450 (+422623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.675520 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:53.675587 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.675677 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.675839 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580848,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":284483,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":22151,"thread_start_us":1161994,"threads_started":3,"wal-append.queue_time_us":206297}
I20260709 13:10:53.698380 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1777) took 1517 ms. Trace:
I20260709 13:10:53.746742 30560 rpcz_store.cc:276] 0709 13:10:52.180760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.697341 (+1516581us) service_pool.cc:224] Handling call
0709 13:10:53.697688 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.697921 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.697958 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.698047 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.698096 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.698167 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.698314 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:53.750442 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.714628  1619 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.731879 30307 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:10:53.703737  1928 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:53.735960 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.665912 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-406b169640e341629c55637d07dd3d47 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:10:53.737493 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.776104 30405 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:53.694939  1700 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.703967  1557 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.738713 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.742794 30484 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:53.742992 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.717904 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:53.744320 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.709034  1738 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.753427 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.689363  1880 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:53.728695 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 263115us
I20260709 13:10:53.799429  1695 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:53.776329 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.800465 30486 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.801890  1695 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:53.730954  1599 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.787321 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-406b169640e341629c55637d07dd3d47 on tablet 406b169640e341629c55637d07dd3d47 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.789304 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.803144  1599 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.803869 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.804450 30481 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:53.790056 30483 raft_consensus.cc:1240] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:53.805258  1599 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.790028 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.806130 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.806679 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.807296 30404 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:53.790421 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.789433 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.808969 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:53.809190 30479 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:53.744252  1921 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:53.815534 30404 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:53.798153 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 80330.7us
I20260709 13:10:53.804673 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.817368 30406 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.818493 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:53.818873 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:53.819240 30404 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:53.819970  1891 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:53.820501  1891 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:53.821578  1891 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.824096 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.826027 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:53.826812 30402 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:53.796682 30409 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:53.828465 30406 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:53.753479  1765 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.832198 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.816270 30405 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:53.788770  1105 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:53.777354  1949 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:53.844229 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.734993  1734 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.839092 30477 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:53.844837 30485 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:53.733785  1701 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.850948  1962 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:53.851393  1962 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:53.851331 30307 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 1 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:53.852240  1701 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:53.853238 30307 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 5 to 7, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:53.836813 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.848426 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.846334 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:53.853873 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.854275  1679 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:53.855304 30410 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.855420  1693 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:53.856102  1874 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:53.886828 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.887684 30482 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:53.837080  1765 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.843953  1909 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:53.798933  1700 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.798069  1955 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:53.878909 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.879442 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1922) took 5451 ms. Trace:
I20260709 13:10:53.879637 30479 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:53.857832 30403 raft_consensus.cc:2410] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:53.847182 30486 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:10:53.966624 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:53.790663  1619 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:53.884742 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 234613us
I20260709 13:10:53.843680  1828 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:53.856561  1105 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:53.885658 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.883023  1876 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:53.966770 30307 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 6, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:53.968719 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:53.830181  1738 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.848351  1599 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.971261 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:53.824252  1557 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:53.872762 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.973994 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 173090us
I20260709 13:10:53.790997  1707 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.835223  1695 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:10:53.964627 30558 rpcz_store.cc:276] 0709 13:10:48.406406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.157103 (+750697us) service_pool.cc:224] Handling call
0709 13:10:49.167438 (+ 10335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:50.894469 (+1727031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.894500 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:50.903808 (+  9308us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.875471 (+971663us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180049e0a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:10:52.073078 (+197607us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:52.097940 (+ 24862us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.105919 (+  7979us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.106102 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.106166 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.634164 (+527998us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b180049e0a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:53.477624 (+843460us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180049e0a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:53.857303 (+379679us) raft_consensus.cc:1685] finished
0709 13:10:53.857328 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.857465 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1739373,"prepare.queue_time_us":294830,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":1758645,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":48316,"spinlock_wait_cycles":77149568,"thread_start_us":217441,"threads_started":2,"wal-append.queue_time_us":1217643}
I20260709 13:10:53.849376  1824 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:10:53.986276 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:53.999859 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.002276 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.847783  1921 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:54.010401 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 215634us
I20260709 13:10:54.013778 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:53.983299  1876 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.020634 31146 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:53.858309  1949 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.021050 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.022574 30307 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 7, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:53.852279  1962 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:53.997105  1955 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:53.991784  1731 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:53.999050  1909 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.039963 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:53.962057  1693 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:53.995723  1929 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:54.025288 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 225616us
I20260709 13:10:54.076329 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.072793 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.075505 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.011583  1953 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:54.092252 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.079938 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.069865 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:54.048136  1712 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.005s
I20260709 13:10:54.069810  1731 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:54.106863 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 93186.3us
I20260709 13:10:54.110203 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:53.992334  1599 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.100769 30484 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:10:54.098587 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73470.2us
I20260709 13:10:54.121815 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.122812 30405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:10:54.025906  1876 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:54.070169  1969 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:10:54.092926  1937 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:54.041375  1832 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:54.040951  1955 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:54.105753  1823 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.002s
I20260709 13:10:54.104877  1731 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:54.075134  1557 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:54.093133  1953 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:54.154042 30411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.015s	sys 0.000s
I20260709 13:10:54.075480  1825 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:54.156605 30557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.020s	sys 0.026s
I20260709 13:10:54.157181 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.147903  1980 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.125367 30307 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 3, leader changed from <none> to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 3 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:10:54.163095 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1968) took 2056 ms. Trace:
I20260709 13:10:54.151371 31146 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:54.193642 30307 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 3 to 5, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 5 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:54.073130  1972 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.041529  1951 raft_consensus.cc:2764] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:54.025784  1971 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.071131  1619 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:54.161338 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.092330  1962 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.179816  1734 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:54.180639 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.154162  1714 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.183501 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.207712 30478 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:54.211022  1949 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:54.211699 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.192903 30559 rpcz_store.cc:276] 0709 13:10:52.106390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.510417 (+1404027us) service_pool.cc:224] Handling call
0709 13:10:53.516787 (+  6370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.555077 (+ 38290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.555121 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.555737 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.740074 (+184337us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:54.162044 (+421970us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.162668 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.162782 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.162842 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:54.162860 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.163025 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38998,"prepare.queue_time_us":229552,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":54500,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":19900,"thread_start_us":517603,"threads_started":2,"wal-append.queue_time_us":410193}
I20260709 13:10:54.214102 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.196228 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:54.154310  1874 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:54.106573  1851 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:10:54.106662  1909 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.151557 30405 raft_consensus.cc:606] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.184544 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:54.187268 30411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.015s	sys 0.000s
W20260709 13:10:54.157814 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47683.1us
W20260709 13:10:54.189085 30557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.020s	sys 0.026s
I20260709 13:10:54.207105 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1771) took 2058 ms. Trace:
I20260709 13:10:54.170094  1880 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:54.215137 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:54.317648 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 117209us
I20260709 13:10:54.363474 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1772) took 2204 ms. Trace:
W20260709 13:10:54.363147 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 93003.4us
I20260709 13:10:54.161662  1961 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:54.214735 30559 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:54.175074  1823 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.363528 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.162616  1955 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.365064 30555 rpcz_store.cc:276] 0709 13:10:52.158950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.631918 (+1472968us) service_pool.cc:224] Handling call
0709 13:10:53.667703 (+ 35785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.690963 (+ 23260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.691007 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.705428 (+ 14421us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.016902 (+311474us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.362902 (+346000us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.363144 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.363218 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.363262 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:54.363279 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.363421 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230258,"raft.queue_time_us":24639,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":263813,"threads_started":1,"wal-append.queue_time_us":436881}
I20260709 13:10:54.218102 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:54.366302 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 170150us
I20260709 13:10:54.230942 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1978) took 1903 ms. Trace:
W20260709 13:10:54.188638  1950 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:10:54.366724 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.379515 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.190057  1953 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.366369 30405 raft_consensus.cc:614] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:54.204345  1972 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.233317  1712 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.380985 30558 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:54.373284 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:54.374804 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.375599 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.375810 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1834) took 2020 ms. Trace:
I20260709 13:10:54.224879 30307 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:10:54.385663 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.386677 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.389219 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:54.376175 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.376665 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:54.336119 30375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.004s
W20260709 13:10:54.391767 30375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.011s	sys 0.005s
I20260709 13:10:54.393973 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.394891 30485 raft_consensus.cc:2376] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12. Re-sending same reply.
I20260709 13:10:54.396093 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.372833 30560 rpcz_store.cc:276] 0709 13:10:52.327613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.747910 (+1420297us) service_pool.cc:224] Handling call
0709 13:10:53.748262 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.995025 (+246763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.995096 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:53.995153 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.995199 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.230653 (+235454us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400038ed4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:54.230723 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.230872 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566969088}
I20260709 13:10:54.380157 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.366376 30552 rpcz_store.cc:276] 0709 13:10:52.148785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.585675 (+1436890us) service_pool.cc:224] Handling call
0709 13:10:53.586121 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:53.586599 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.586643 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:53.587413 (+   770us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.879688 (+292275us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.967869 (+ 88181us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.968171 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.043427 (+ 75256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.043695 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.206827 (+163132us) raft_consensus.cc:1685] finished
0709 13:10:54.206856 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.207034 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4015,"prepare.queue_time_us":92299,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":25215,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":32765,"thread_start_us":306659,"threads_started":2,"wal-append.queue_time_us":500995}
I20260709 13:10:54.381729 30478 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.398211 30559 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:54.215322  1743 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:54.371380  1874 consensus_queue.cc:1243] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:54.417279  1962 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:54.401971 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.409082 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.435436 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.374661  1824 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:54.397158 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:54.436866 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.400502  1972 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:54.369982  1961 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.456051 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.405045 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:54.228175  1963 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:10:54.409109 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1973) took 2298 ms. Trace:
I20260709 13:10:54.457762 30556 rpcz_store.cc:276] 0709 13:10:52.110815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.569054 (+1458239us) service_pool.cc:224] Handling call
0709 13:10:53.583286 (+ 14232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.699219 (+115933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.699261 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.699799 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.009278 (+309479us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:54.373728 (+364450us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.373938 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.391324 (+ 17386us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b5400338bd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:54.391376 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.391441 (+    65us) raft_consensus.cc:1685] finished
0709 13:10:54.408840 (+ 17399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.409020 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":373622,"prepare.queue_time_us":394097,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":32590,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":20103,"spinlock_wait_cycles":198743296,"thread_start_us":217080,"threads_started":1,"wal-append.queue_time_us":367825}
I20260709 13:10:54.411553 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.460868 30403 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 5.
I20260709 13:10:54.412173 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.412544 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.366175  1765 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.414472 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 632) took 2334 ms. Trace:
I20260709 13:10:54.384786  1712 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.377457  1954 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:54.388258  1823 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:54.418569 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:54.476236 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.419518  1599 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:54.403568  1951 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:54.407579  1979 raft_consensus.cc:2764] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:10:54.429559  1876 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.366197  1980 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:54.430585  1974 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:54.432370  1921 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:54.456468  1730 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:54.388458 30555 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:54.437377 30479 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:54.440795 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.546223 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.548928 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:54.551250 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:54.479043  1823 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:54.552896 30477 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:54.447669 30481 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:54.437299 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:54.452054 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.452433 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.188551  1986 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.217s
I20260709 13:10:54.561255  1986 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.561609  1986 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:54.562438  1986 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.563676  1986 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.456998 30409 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:54.540469  1951 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:54.569983 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 117619us
I20260709 13:10:54.463320 30410 raft_consensus.cc:2410] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:10:54.570322 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 133146us
I20260709 13:10:54.573915 30374 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:54.464735 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.466593 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.476574 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 1972) took 2369 ms. Trace:
I20260709 13:10:54.457901 30559 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:54.469563 30557 rpcz_store.cc:276] 0709 13:10:52.079744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.502396 (+1422652us) service_pool.cc:224] Handling call
0709 13:10:53.503682 (+  1286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.504133 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.504178 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.504744 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.367589 (+862845us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:54.413927 (+ 46338us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.414157 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.414235 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.414279 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:54.414292 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.414415 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45979,"prepare.queue_time_us":48151,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":7445,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14300,"thread_start_us":862523,"threads_started":1,"wal-append.queue_time_us":713500}
I20260709 13:10:54.526876 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.524031 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.485594 30478 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:54.527894 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:54.577935 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54016.1us
I20260709 13:10:54.578397 30403 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:54.530746 30486 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:54.578842 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.578919 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.579540 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.537267 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.580003 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.579543 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:54.571375 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:54.436069 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.581418 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.581869 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.582278 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.468186  1961 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:54.521458  1973 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:54.555567 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.588672 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.589762 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.590741 30558 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:54.483080  1743 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:10:54.474851  1880 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:10:54.386579 30411 rpcz_store.cc:276] 0709 13:10:52.355731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.359814 (+  4083us) service_pool.cc:224] Handling call
0709 13:10:53.533187 (+1173373us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:10:53.533427 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.533697 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:53.534014 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.375405 (+841391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.375471 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:54.375537 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.375614 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.375743 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4100,"prepare.queue_time_us":35727,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":7052,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8086,"spinlock_wait_cycles":2104576,"thread_start_us":834091,"threads_started":1,"wal-append.queue_time_us":683039}
I20260709 13:10:54.591427 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.555332  1823 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.588025  1599 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.593650  1891 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.594233  1743 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.594882 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.595971 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.596107  1984 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.596702  1734 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:54.597110  1734 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:54.597684  1734 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.597141  1951 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.598194 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1748) took 2650 ms. Trace:
I20260709 13:10:54.598888  1701 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:54.599331  1701 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:54.599726  1701 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.601142 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:54.602018  1707 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:54.602422  1707 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:54.584189  1972 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:54.602946  1707 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.603164  1972 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:54.585258  1921 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:54.588141  1949 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.604101  1972 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.605420 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2113) took 1195 ms. Trace:
I20260709 13:10:54.605698 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:54.576071 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.607074 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.577564 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.596971  1880 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:54.538882 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.575327 30551 rpcz_store.cc:276] 0709 13:10:52.107391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.566781 (+1459390us) service_pool.cc:224] Handling call
0709 13:10:53.592285 (+ 25504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.627006 (+ 34721us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:53.885652 (+258646us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.044822 (+159170us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.046278 (+  1456us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.046651 (+   373us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:54.449361 (+402710us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.476243 (+ 26882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.476318 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.476357 (+    39us) raft_consensus.cc:1685] finished
0709 13:10:54.476369 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.476497 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415527,"prepare.queue_time_us":708718,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":90453,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":54992,"spinlock_wait_cycles":11520,"thread_start_us":418145,"threads_started":3,"wal-append.queue_time_us":167804}
I20260709 13:10:54.547246  1824 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:54.608546 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 219409us
I20260709 13:10:54.543228 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:54.584648 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.609303 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.610031 30559 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:54.537489  1738 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:54.575428 30552 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:10:54.611477 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 635) took 1001 ms. Trace:
I20260709 13:10:54.606093 30480 rpcz_store.cc:276] 0709 13:10:53.410364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.410535 (+   171us) service_pool.cc:224] Handling call
0709 13:10:53.411214 (+   679us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:53.411723 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.411763 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:53.459503 (+ 47740us) log.cc:844] Serialized 52 byte log entry
0709 13:10:53.735301 (+275798us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:53.978626 (+243325us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.146241 (+167615us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.151722 (+  5481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.151801 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.605197 (+453396us) raft_consensus.cc:1685] finished
0709 13:10:54.605217 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.605362 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5252,"prepare.queue_time_us":329254,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2770,"raft.queue_time_us":80872,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":28263,"thread_start_us":570057,"threads_started":3,"wal-append.queue_time_us":476151}
I20260709 13:10:54.611964 30558 rpcz_store.cc:276] 0709 13:10:53.610153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.610456 (+1000303us) service_pool.cc:224] Handling call
0709 13:10:54.610846 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.611079 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.611118 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.611176 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:54.611219 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.611289 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.611409 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.608547 30557 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:54.586566 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:54.587153 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.448585  1962 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:54.613870 30485 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.607371 30560 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:54.609303 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.622529 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:54.598587 30554 rpcz_store.cc:276] 0709 13:10:51.947733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.386049 (+1438316us) service_pool.cc:224] Handling call
0709 13:10:53.386425 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.414455 (+ 28030us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:53.716080 (+301625us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.243672 (+527592us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180003b3e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa048aa13c7 00007fa0450b39a7 00007fa0450c30bf 00007fa0450c3038
0709 13:10:54.243991 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.244230 (+   239us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.244819 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.362881 (+118062us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.362925 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.362997 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.597974 (+234977us) raft_consensus.cc:1685] finished
0709 13:10:54.598009 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.598134 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118769,"prepare.queue_time_us":872154,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":32094,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":47088,"spinlock_wait_cycles":9337600,"thread_start_us":446403,"threads_started":2,"wal-append.queue_time_us":410815}
I20260709 13:10:54.541529  1980 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.636839 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.638011 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.559615  1730 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:54.638913 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.639804 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:54.646577 30485 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:54.646746 30554 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:54.651013  1949 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:54.652613 30558 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:54.655472 30483 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:54.657161 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:54.622812  1824 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.623041  1962 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:54.622241  1880 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:54.635592  1599 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:54.693842  1954 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:54.672747  1953 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.594920  1743 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:10:54.640854  1738 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.717054  1730 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:54.777799  1980 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:54.701054  1993 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:54.779958 30481 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:54.780217 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 73362.5us
I20260709 13:10:54.781792 30482 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:54.779156 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 637) took 1153 ms. Trace:
I20260709 13:10:54.647001  1891 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.783911 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:54.811674 30480 raft_consensus.cc:2376] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9. Re-sending same reply.
I20260709 13:10:54.809355 30553 rpcz_store.cc:276] 0709 13:10:53.624589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.628278 (+  3689us) service_pool.cc:224] Handling call
0709 13:10:54.702277 (+1073999us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540039fb54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:54.778117 (+ 75840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067137792}
I20260709 13:10:54.788908  1988 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:54.811359  1994 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.163s	user 0.004s	sys 0.003s
I20260709 13:10:54.822229  1988 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:54.812652  1993 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:54.816614  1984 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:54.779446  1823 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.828112  1891 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.823190  1998 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:54.838018  1993 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.852083  1876 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:54.853091  1953 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:54.854115  1991 log.cc:927] Time spent T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 13:10:54.854423  1909 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.034498  1909 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.035377  1909 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:54.896569 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 312855us
I20260709 13:10:54.904234 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2094) took 1099 ms. Trace:
I20260709 13:10:55.040591  1909 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.039353 30407 rpcz_store.cc:276] 0709 13:10:53.805108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.805356 (+   248us) service_pool.cc:224] Handling call
0709 13:10:53.805647 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.016386 (+210739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.016424 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.023727 (+  7303us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.380532 (+356805us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:54.380570 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.380662 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.903586 (+522924us) raft_consensus.cc:1685] finished
0709 13:10:54.903643 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.903975 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49100,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":543073,"threads_started":2,"wal-append.queue_time_us":527959}
I20260709 13:10:54.925316 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:54.930111 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.951026 30486 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:54.952183 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 313177us
W20260709 13:10:54.955367 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 317297us
I20260709 13:10:54.973299 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1795) took 1003 ms. Trace:
I20260709 13:10:55.030128  1619 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:54.853097  1823 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:54.832335  1880 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.051681 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.053308 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.053815  1880 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.054329 30480 raft_consensus.cc:2376] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13. Re-sending same reply.
I20260709 13:10:55.050721 30557 rpcz_store.cc:276] 0709 13:10:53.971807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.613586 (+641779us) service_pool.cc:224] Handling call
0709 13:10:54.613854 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.614090 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:54.635667 (+ 21577us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.972065 (+336398us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.972392 (+   327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.972466 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.972576 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.972736 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.973024 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88475,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":109,"raft.queue_time_us":139969,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":404,"thread_start_us":334907,"threads_started":1,"wal-append.queue_time_us":230715}
I20260709 13:10:54.850117  2006 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:55.051076  1619 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:54.862193  1988 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.058018  2006 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:54.837077  1984 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:54.864686  1997 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 13:10:55.059531  1984 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.060015  1619 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.063915 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:55.070641  2007 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:55.071375  2007 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:55.071843  2007 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:55.073726 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.078198  1954 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:55.108291 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.115711 30552 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:55.128386 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64762.6us
I20260709 13:10:55.032349  1599 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.133329  1599 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.140352 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 636) took 1499 ms. Trace:
I20260709 13:10:54.849409  1765 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.157954  1700 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:55.159183 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59232.1us
W20260709 13:10:55.159866 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 71256.8us
I20260709 13:10:55.160877  1712 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.162897  1679 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:55.164067 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 507346us
I20260709 13:10:55.165447 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:55.167044 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1788) took 1232 ms. Trace:
W20260709 13:10:55.185140  1734 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.009s
I20260709 13:10:55.172185  1949 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:55.180907  1679 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:55.190850 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:55.194242 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 61716.1us
I20260709 13:10:55.194875  1712 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:55.171435 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.194990  2006 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.181298 30552 rpcz_store.cc:276] 0709 13:10:53.934248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.611397 (+677149us) service_pool.cc:224] Handling call
0709 13:10:54.647395 (+ 35998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.116385 (+468990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.166623 (+ 50238us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54000393d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:55.166943 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075572096}
I20260709 13:10:55.144661 30559 rpcz_store.cc:276] 0709 13:10:53.624256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.610892 (+986636us) service_pool.cc:224] Handling call
0709 13:10:54.649658 (+ 38766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.974159 (+324501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.974211 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.974977 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.119228 (+144251us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.119269 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.119389 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.121513 (+  2124us) raft_consensus.cc:1685] finished
0709 13:10:55.121535 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.123996 (+  2461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17151,"raft.queue_time_us":174726,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5413,"thread_start_us":460723,"threads_started":2,"wal-append.queue_time_us":143209}
I20260709 13:10:55.210078  1712 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:55.216662  1701 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.001s
I20260709 13:10:55.232535 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:55.233850 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:55.234839  1701 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.236100  1949 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.237360  1701 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.226224  1712 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.243763  1679 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.243784  1988 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.245121  1679 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.245862  1980 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:55.247630  1980 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:55.218632  1734 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.248673  1980 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:55.249377  1998 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:55.249624  1980 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.250113  1971 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:55.250550  1971 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.251327  1980 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.251713  1971 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.252360  1891 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:55.252904  1891 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:55.253469  1971 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.254482 30559 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:55.254791  1954 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:55.255219  1954 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:55.252363  1962 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.003s
I20260709 13:10:55.256171  1954 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.256621  1962 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.257848  1954 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.259601  1962 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.260346  1693 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.254142  1891 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.256197 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:55.262486 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:55.263579 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:55.263954 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.264736 30486 raft_consensus.cc:2376] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9. Re-sending same reply.
I20260709 13:10:55.265235  1891 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.265523  1909 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:55.266038  1909 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.266465  1909 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:55.268144 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.264017  1738 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:55.269731 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.264874  1599 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.271075  2001 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:55.268949  1734 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.271559  2001 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:10:55.271778  1955 consensus_meta.cc:287] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.889s	user 0.005s	sys 0.009s
I20260709 13:10:55.272022  2001 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.272280  1955 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.269043  1738 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.275274  1738 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.277053  1953 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:55.277519  1953 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.256945  1714 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.261286  1824 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
W20260709 13:10:55.278258  2016 log.cc:927] Time spent T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 13:10:55.277709  1599 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.277946  1953 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:55.285735 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58902.4us
I20260709 13:10:55.280493  1955 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:55.278030  1961 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.679s	user 0.000s	sys 0.013s
I20260709 13:10:55.310863 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.312314  1932 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.313110  1932 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.314061 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1798) took 1168 ms. Trace:
I20260709 13:10:55.289178  1824 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.316711 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 644) took 1112 ms. Trace:
I20260709 13:10:55.317095 30553 rpcz_store.cc:276] 0709 13:10:54.182253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.815375 (+633122us) service_pool.cc:224] Handling call
0709 13:10:54.815751 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.826273 (+ 10522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.826328 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.962412 (+136084us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.136088 (+173676us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:55.211223 (+ 75135us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.225936 (+ 14713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.284119 (+ 58183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.284184 (+    65us) raft_consensus.cc:1685] finished
0709 13:10:55.284205 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.294216 (+ 10011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81356,"prepare.queue_time_us":73625,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":66644,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":62552,"thread_start_us":168908,"threads_started":1,"wal-append.queue_time_us":228946}
I20260709 13:10:55.319082 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.319147 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.320333 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.320670 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.321537 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.322183 30479 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:55.323046 30478 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:55.324137  2032 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:10:55.325840 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45999us
I20260709 13:10:55.318383 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.327369  1876 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.327641 30480 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:55.327946  1876 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.318264  1824 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.286567  1998 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.314472 30556 rpcz_store.cc:276] 0709 13:10:54.145770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.478780 (+333010us) service_pool.cc:224] Handling call
0709 13:10:55.313691 (+834911us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54001e55d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:55.313870 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658452352}
I20260709 13:10:55.330482  1876 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.348917 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:55.349851  1707 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.003s
I20260709 13:10:55.350757  1707 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.345652  1693 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.354550  1693 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.349939 30406 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:55.358065 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.358227 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.356479  1707 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.364892  1984 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.368575 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.369928 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.371066  1830 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:55.372912  1932 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.372695  1712 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.404747 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1801) took 1257 ms. Trace:
W20260709 13:10:55.373840 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 104255us
I20260709 13:10:55.342548  1961 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.416759  1961 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.405184 30554 rpcz_store.cc:276] 0709 13:10:54.146819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.658740 (+511921us) service_pool.cc:224] Handling call
0709 13:10:54.659135 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.132458 (+473323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.135154 (+  2696us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:55.155472 (+ 20318us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.226932 (+ 71460us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:55.325790 (+ 98858us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.326154 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.326319 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.326469 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.404273 (+ 77804us) raft_consensus.cc:1685] finished
0709 13:10:55.404301 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.404570 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42006,"prepare.queue_time_us":64738,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":175109,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":6042,"thread_start_us":394015,"threads_started":2,"wal-append.queue_time_us":246208}
W20260709 13:10:55.375743 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 151921us
W20260709 13:10:55.379081 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 208013us
I20260709 13:10:55.384363  1693 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:55.385263 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.394013 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 67074.2us
I20260709 13:10:55.331406  1714 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.408715 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:55.408380 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47509.8us
W20260709 13:10:55.423364 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.424563 30484 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:55.405049  1712 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.427161 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1803) took 1050 ms. Trace:
I20260709 13:10:55.439788  1955 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:55.440126 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.441167  1714 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.441776 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.433118 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.443184  2030 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:55.444403  1909 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.447367  2007 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.448719 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.449949  1730 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.450389 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.450557  1730 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.450659 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.435746 30557 rpcz_store.cc:276] 0709 13:10:54.376625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.057062 (+680437us) service_pool.cc:224] Handling call
0709 13:10:55.057578 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.058181 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.058218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.100160 (+ 41942us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.217669 (+117509us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:55.360682 (+143013us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.426783 (+ 66101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.426857 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.426898 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:55.426908 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.427071 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135300,"prepare.queue_time_us":109240,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":66665,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":5976,"thread_start_us":139499,"threads_started":2,"wal-append.queue_time_us":189584}
I20260709 13:10:55.450831  2006 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.461896  2006 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.464632  2006 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.451051 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.466511 30407 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:55.451529 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.468513 30411 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:55.453255  1972 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.470275  1972 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:55.471215 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 62667.1us
I20260709 13:10:55.473083  1972 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.475308 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 641) took 1457 ms. Trace:
I20260709 13:10:55.475788 30555 rpcz_store.cc:276] 0709 13:10:54.017562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.636533 (+618971us) service_pool.cc:224] Handling call
0709 13:10:54.641620 (+  5087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.641957 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.641985 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.642402 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.183435 (+541033us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b540021c3a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450206b8 00007fa0450a992b 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c
0709 13:10:55.183549 (+   114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.428016 (+244467us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.438181 (+ 10165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.474838 (+ 36657us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.474887 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:55.474976 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.475136 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137814,"prepare.queue_time_us":122187,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":11580,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":24907,"spinlock_wait_cycles":206625536,"thread_start_us":470660,"threads_started":2,"wal-append.queue_time_us":222367}
I20260709 13:10:55.452953 30404 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:55.478050  2021 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.225s	user 0.000s	sys 0.002s
I20260709 13:10:55.458366 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.455709 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:55.491703  1954 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:55.493489 30479 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:10:55.457580  2028 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
W20260709 13:10:55.497856 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 71143.7us
I20260709 13:10:55.457849  2029 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:55.461145  1909 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.454387  1599 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.502650 30411 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:55.499898 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:55.453351  1730 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.454495  2007 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.504139 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:55.508965 30406 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:55.407249  1738 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:55.510453 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 68867.7us
I20260709 13:10:55.514099 30402 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:10:55.515151 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 162563us
I20260709 13:10:55.518630 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:55.503299  1984 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.456516  1932 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:10:55.519531 30450 leader_election.cc:336] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.661s (SENT)
I20260709 13:10:55.527799 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:55.528992  1947 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:55.530108  1993 consensus_meta.cc:287] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.002s
I20260709 13:10:55.520475  1972 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:55.535220 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76973.6us
I20260709 13:10:55.521055  1599 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.538964 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 633) took 1953 ms. Trace:
I20260709 13:10:55.454748  1998 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.541900 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:55.544384  2001 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.526010 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:55.548221 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 92656.1us
I20260709 13:10:55.551872 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.556011 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.556336 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.558120 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:55.554559 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50085.4us
I20260709 13:10:55.565073 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:55.563248  1712 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.568068  1891 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:55.569310 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.565364  1880 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:10:55.569129  1599 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.571065 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:55.565233  2029 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:10:55.571733  1979 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.530575  1993 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.559577  1961 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:55.555722  1953 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.572546 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:55.577037  1916 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:55.581455  1953 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.539552 30551 rpcz_store.cc:276] 0709 13:10:53.585546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.609021 (+1023475us) service_pool.cc:224] Handling call
0709 13:10:54.654131 (+ 45110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.792843 (+138712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.792876 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.809104 (+ 16228us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.161770 (+352666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.339278 (+177508us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.538040 (+198762us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54001ac0a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045024733 00007fa0450a9dbf 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c
0709 13:10:55.538125 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.538269 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.538339 (+    70us) raft_consensus.cc:1685] finished
0709 13:10:55.538501 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.538749 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57466,"prepare.queue_time_us":127090,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4996,"raft.queue_time_us":153443,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":5283,"spinlock_wait_cycles":34578176,"thread_start_us":572886,"threads_started":3,"wal-append.queue_time_us":386177}
I20260709 13:10:55.582885  1830 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:55.583344  1830 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:55.583709  1961 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:55.584018  1891 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:55.584308 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1799) took 1438 ms. Trace:
I20260709 13:10:55.584605  1891 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:55.585057  1891 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:55.577283 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.586115 30555 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:55.584893  1962 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:55.587179  1962 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.584753 30558 rpcz_store.cc:276] 0709 13:10:54.146087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.654243 (+508156us) service_pool.cc:224] Handling call
0709 13:10:54.654521 (+   278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:54.971373 (+316852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.971449 (+    76us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:54.972580 (+  1131us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.123031 (+150451us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:55.136980 (+ 13949us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.142613 (+  5633us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.142819 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.175355 (+ 32536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.268830 (+ 93475us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b48001c0158. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:10:55.312173 (+ 43343us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18002c4700. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc522 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:55.456591 (+144418us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:10:55.583903 (+127312us) raft_consensus.cc:1685] finished
0709 13:10:55.583926 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.584135 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72184,"prepare.queue_time_us":195000,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":4009,"raft.queue_time_us":157269,"raft.run_cpu_time_us":3394,"raft.run_wall_time_us":195986,"spinlock_wait_cycles":102830592,"thread_start_us":466006,"threads_started":2,"wal-append.queue_time_us":171194}
I20260709 13:10:55.588158  1962 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.567564  1972 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.589434  1993 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.585636 30374 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:55.579138  2001 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:55.592708  1971 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:55.593302  1712 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:55.593742  1909 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:55.597282 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.598716 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:55.584106  1961 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.623637 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.623663  1961 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.553823  1984 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:55.627427  1961 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.593297  1971 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:55.629525  1971 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.584332  1830 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.632714  1830 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.621649  1955 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:55.590291 30405 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.632627 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:55.635515  1988 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:55.626179 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 68203.2us
W20260709 13:10:55.621901 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 56979.2us
I20260709 13:10:55.640051  1909 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:55.660233  1825 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.660997  1825 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.665264 30406 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:55.655478  1984 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:10:55.675233 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:55.675948 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.651198  2029 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:55.682902 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.685407 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.687000 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.689172 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:55.693032 30480 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:55.696102 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:55.699539 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.701459 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.703341 30404 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:55.705255 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.663918  2042 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:55.707247 30525 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:55.708065  1738 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.707281 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:55.715550 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.716462 30554 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:55.712440 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:55.720329 30406 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:55.715623 30558 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:55.686229  2029 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:10:55.771030 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 63836.6us
I20260709 13:10:55.773005 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:55.721570  1738 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:55.740819  1712 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:55.764642  2029 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.778983 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.773308 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.772318  1932 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:55.779618 30554 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:10:55.791404 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 79095.4us
I20260709 13:10:55.800276  1880 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:55.802220  2042 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:55.827251 30556 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:55.828790  1743 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:55.809508  1874 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.840831  1916 raft_consensus.cc:3055] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:55.841720 30552 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:55.821913  1825 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:55.843644 30559 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:55.843562 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:55.844702 30551 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:55.850778  1736 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.852416 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:55.853363 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.875550 30558 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.854976  2029 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.799953  1891 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.862098 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:55.862802 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50130.5us
I20260709 13:10:55.856293 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:55.877604 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.889235 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 73508.1us
I20260709 13:10:55.893064  1891 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.895551 30404 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:55.896131 31148 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:55.897399 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.898573 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.899978 30560 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:55.900390  1736 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.900935 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.901703 30560 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:55.893537  2029 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.910596 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.911656 30554 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:55.912885 30554 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:55.927891 30560 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:55.934556  1712 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:55.935210  1712 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:55.936132  1712 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.864581  1743 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:55.947290  1994 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:10:55.947678  1743 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:55.948907  1743 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:55.949242 30557 pending_rounds.cc:85] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 5
I20260709 13:10:55.949533 30557 pending_rounds.cc:107] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:55.949810 30557 raft_consensus.cc:2889] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.886015 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:55.914592 30554 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:10:55.953717 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67772.6us
I20260709 13:10:55.856282  1880 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:55.958613 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:55.958871 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:55.863497  2042 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:55.885931  1874 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:55.978736  1736 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:55.983888  1972 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:55.990873 30554 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:55.875001  1916 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:55.991530 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.001857 30408 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:56.003114 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:56.005281 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49688.2us
I20260709 13:10:56.007194 30404 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:56.003476 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:56.008559 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:56.010087 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:56.016542 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:55.968873  1891 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:55.969223  1880 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:56.019222 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:56.021406 30486 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:56.021947 30480 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:56.031066 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.032315 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:56.034830 30559 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:56.035185  1916 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.036726  2042 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:56.037420 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.038168  2042 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:56.046814 30450 leader_election.cc:336] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.717s (SENT)
I20260709 13:10:56.047363 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.020701  1891 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:56.048614  1891 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:56.050866  1714 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.051680  1988 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:56.051402  1714 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.053931  1714 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:56.069664 30555 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:56.019326  1738 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:56.067098 30559 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
W20260709 13:10:56.023334 30376 connection.cc:256] RPC call timeout handler was delayed by -1.4882292519998828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:10:56.084988 30376 connection.cc:256] RPC call timeout handler was delayed by -1.2653642509999372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
I20260709 13:10:56.082865 30558 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:56.083482 30408 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:56.086405 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:56.086946 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.088713 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.089763 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.093133 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.068375  1947 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:56.125339 30558 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
W20260709 13:10:56.096741 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.126893 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:56.117936 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.094460  1738 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:56.093883  1984 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:56.134290 30554 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:56.099545  1714 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.101238  1961 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:56.135787 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.138460 30551 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
W20260709 13:10:56.139734 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69303us
I20260709 13:10:56.141731 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.142557 30560 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:56.143293 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.144459 30559 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:56.149699 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.150684 30558 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:56.158227 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.155465 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.159554 30554 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:56.166096 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.175420  1738 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.177280  1679 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:56.178033  1679 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:56.183785 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.151893  1984 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:56.131353  1947 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.187422 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.203588 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:56.205863 30554 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:56.209244 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.214481 30560 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:56.210482 31117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.022s
W20260709 13:10:56.221781 31117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.017s	sys 0.022s
W20260709 13:10:56.222119 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 533352us
I20260709 13:10:56.164317  1961 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.266119 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.267939 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.272123 30558 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:56.230746  1679 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:56.212721  1824 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:56.267508  1980 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:56.292167 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.294371 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.238138  2043 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:10:56.274050  1874 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:56.296283 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.301204 30408 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:56.306317 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.308813 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.271358  2029 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:56.312865 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.381685 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.303773  1980 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:56.387588 30407 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:56.278532  1984 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.389818 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.399704 30408 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:56.381596  1599 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.406860 30404 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:56.407040 30408 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:56.410763 30411 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:56.385668  1874 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:56.428054 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.432214 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.433928 31151 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:56.440659 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.444525 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 417665us
W20260709 13:10:56.445537 30450 leader_election.cc:336] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.523s (SENT)
I20260709 13:10:56.446141 30450 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:56.448705  2062 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:10:56.453557 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.457566 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.457828 30404 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:56.456071 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.467178  1824 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:56.467962 30450 leader_election.cc:336] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.653s (SENT)
I20260709 13:10:56.467774  1824 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.468438 30450 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.469704  1988 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:56.469914  1824 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:56.470526  1824 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:56.472559  1743 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:56.473224  1743 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.477803 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.480155 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:56.481737  1830 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:56.482060  1679 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:56.482219  1830 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:56.482758  1824 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:56.490427 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.495396  1824 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:56.495837  2059 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 13:10:56.491240 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.496501  1824 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.497541  1880 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.492501  1980 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.493096  1743 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:56.493923  1679 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:56.483346 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.430552  1599 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.498546 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.460496  1961 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:56.463200  1874 consensus_queue.cc:1243] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:56.499189 30410 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:56.503396 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.504386 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.505252  1955 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.506319 30404 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:10:56.492865  1916 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.527649 31149 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:56.508723 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.510326 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.512295 31148 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:56.518149 30407 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:56.525998 31151 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:10:56.529510  1955 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.531096 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.529647 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.530468 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.456928  1947 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:56.531143 31146 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:10:56.544195 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.548658 30411 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:56.549680 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.562554 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.568032 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.573557 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.597842 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.599915 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.600991 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.597500 30525 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.601575 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.567844  1712 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:56.609668 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.610278  1955 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:56.610725 31146 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 5 LEARNER]: Advancing to term 7
I20260709 13:10:56.612336 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.583042 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:56.615900 30408 raft_consensus.cc:2410] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:10:56.618162 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.547462  1830 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.619602 30403 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:56.631348 30478 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:56.633157 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.637598 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.638108 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 85420.6us
I20260709 13:10:56.639178 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.641978 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.642078 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.643623 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.644923 30478 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:56.654220  2073 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:56.654795  2073 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.655167  2073 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:56.657804 30477 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:56.659299 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.661500 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:56.662482 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:56.663163 30483 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:56.663494  1599 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:56.664325  1599 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:56.666981  2042 consensus_meta.cc:287] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.628s	user 0.002s	sys 0.012s
I20260709 13:10:56.669433 31146 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:10:56.671209  2075 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:10:56.672497  1880 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:56.674901 30408 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:56.677265 31153 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:56.678268 30407 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:56.670471 30411 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:56.680095 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.680902 30411 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:56.681936 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.682667 30403 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:10:56.693529 30411 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:56.691434 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:56.672494  2071 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:10:56.673717  1891 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.006s
I20260709 13:10:56.723951 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:56.727663 30411 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:56.624873  1712 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.738677 31146 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:56.738875 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:56.738873 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 100025us
I20260709 13:10:56.738375 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:56.739754 30402 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:56.739542 30557 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:56.746477 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 468) took 1041 ms. Trace:
I20260709 13:10:56.747325 30555 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:56.747786  1712 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:56.754204 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.754981 30551 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:10:56.758812 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:56.752440 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 356986us
I20260709 13:10:56.759613 30560 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:56.759840 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:56.731359  1993 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:56.729715  1891 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.732765  1998 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:56.777812 31146 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:56.781025 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.787129 30558 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
W20260709 13:10:56.788540 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 217816us
I20260709 13:10:56.792143 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.793049 30553 raft_consensus.cc:2393] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:56.793954 30525 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.796731 30553 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:56.797602 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:56.799022 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:56.799492  1738 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:56.801139 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:56.811409 31147 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:56.809923  1891 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:56.806018  2088 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:56.815403  1738 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:56.816031  2073 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.817297 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:10:56.806414  2076 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:10:56.818158  1738 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:56.818857  1738 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:56.819823  1738 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.805158  1984 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.834177 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:56.836725 31153 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 4.
I20260709 13:10:56.826473  2073 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:56.810482 31144 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
W20260709 13:10:56.848752 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49823.4us
I20260709 13:10:56.871085  2058 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:56.871574  2058 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:56.896927  2058 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:56.898528  2058 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.931481  2078 raft_consensus.cc:1027] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: attempt to promote peer 19556a24b91d452d98668a3709fbc29d: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:10:56.936841 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.968276  1825 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:56.968813  1825 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:56.969782  1825 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:56.970927  1825 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:56.993376 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:56.994282  2078 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:56.994891  2078 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:56.995872  2078 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:57.010357 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 542410us
W20260709 13:10:57.027047 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.027971 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2123) took 1232 ms. Trace:
I20260709 13:10:57.028398 30406 rpcz_store.cc:276] 0709 13:10:55.795873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.796006 (+   133us) service_pool.cc:224] Handling call
0709 13:10:55.804331 (+  8325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.820910 (+ 16579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.820956 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.868793 (+ 47837us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.391685 (+522892us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.391730 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.391802 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.027750 (+635948us) raft_consensus.cc:1685] finished
0709 13:10:57.027770 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.027908 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52316,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":19112,"thread_start_us":381618,"threads_started":1,"wal-append.queue_time_us":531051}
I20260709 13:10:57.036900 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2125) took 1170 ms. Trace:
I20260709 13:10:57.037367 30405 rpcz_store.cc:276] 0709 13:10:55.866725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.866875 (+   150us) service_pool.cc:224] Handling call
0709 13:10:55.887767 (+ 20892us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:56.020301 (+132534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.020346 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.122034 (+101688us) log.cc:844] Serialized 525 byte log entry
0709 13:10:56.508277 (+386243us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:56.508319 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.552999 (+ 44680us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.036649 (+483650us) raft_consensus.cc:1685] finished
0709 13:10:57.036672 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.036831 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9011,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12788,"thread_start_us":358853,"threads_started":1,"wal-append.queue_time_us":480340}
I20260709 13:10:57.044175  2078 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.045617  2078 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:57.048143 30450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.585s (SENT) [suppressed 60 similar messages]
W20260709 13:10:57.051301 30450 leader_election.cc:336] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.809s (SENT)
I20260709 13:10:57.052052  1738 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:57.055150 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:57.057669  2058 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:57.058224  2058 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:57.052037  1988 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:57.059136  2058 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.059470  1988 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.061791  1988 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.067945  2073 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:57.068887  2073 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:57.068795  1679 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.069356  2073 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:57.069720 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 345016us
I20260709 13:10:57.070258  2073 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.070895  2082 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:57.071431  2082 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.071794  2073 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.072300  2082 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.073625  2020 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.068154 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:57.081489  1988 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.093045  1824 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:57.093883  2094 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:10:57.094365  1824 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:57.094769  1824 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.088312  2020 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:57.095655  2093 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.248s	user 0.003s	sys 0.000s
I20260709 13:10:57.095753  1824 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.097210  1824 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.092926  1988 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.100337  1988 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.091586  1961 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.101018  1961 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.102998  1961 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.103294 30410 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:57.125514 30406 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:57.126986 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.109215  1988 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:57.127830 30406 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:57.128402  1988 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:57.128880  1988 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.129813  1988 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.095877  2020 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.133042  2020 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.164701 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:57.180236 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70830us
I20260709 13:10:57.191957 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2126) took 1523 ms. Trace:
I20260709 13:10:57.192447 30479 rpcz_store.cc:276] 0709 13:10:55.668040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.674904 (+  6864us) service_pool.cc:224] Handling call
0709 13:10:55.697996 (+ 23092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.029303 (+331307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.029347 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.029406 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:56.029451 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.191661 (+1162210us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400158e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:10:57.191714 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.191861 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746908928}
I20260709 13:10:57.199896  2090 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:57.201656  2090 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:57.205886 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 465645us
I20260709 13:10:57.206773 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.208636 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.228297  2105 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.229125  2105 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.230799  2105 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.229447 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:57.249948 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.251549 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.254067 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.260102  2084 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:57.261117  2084 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.261543  2084 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:57.261974  2084 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.268929  2083 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.269584  2083 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:57.270043  2083 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.746949 30481 rpcz_store.cc:276] 0709 13:10:55.677448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.677544 (+    96us) service_pool.cc:224] Handling call
0709 13:10:55.690034 (+ 12490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.721407 (+ 31373us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:56.015856 (+294449us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.694826 (+678970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.718780 (+ 23954us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.718846 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.718944 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.719108 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37900,"prepare.queue_time_us":97152,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":39774,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":787083,"threads_started":3,"wal-append.queue_time_us":497839}
I20260709 13:10:57.296373  2091 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:57.294469  1738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53476 (request call id 11) took 12328 ms. Trace:
I20260709 13:10:57.297058  2091 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.304647  1743 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:57.297755  1738 rpcz_store.cc:276] 0709 13:10:44.965967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.968247 (+  2280us) service_pool.cc:224] Handling call
0709 13:10:45.079016 (+110769us) log.cc:844] Serialized 499 byte log entry
0709 13:10:45.676646 (+597630us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54001efda0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045022142 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354 000000000038f199 00007fa041fbc475
0709 13:10:45.676925 (+   279us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180023c020. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045029b26 00007fa04502349a 00007fa045022714
0709 13:10:46.053911 (+376986us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b54001efda0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045029b26 00007fa04502349a 00007fa045022714 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354
0709 13:10:46.146307 (+ 92396us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b180023c020. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:10:57.294340 (+11148033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419,"raft.queue_time_us":17223,"raft.run_cpu_time_us":18256,"raft.run_wall_time_us":1361592,"spinlock_wait_cycles":52299904,"thread_start_us":99659,"threads_started":1,"wal-append.queue_time_us":173499,"wal-append.run_cpu_time_us":2188,"wal-append.run_wall_time_us":1127827}
I20260709 13:10:57.305274  1743 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.307641  1743 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.308437 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.311849 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.314348  2091 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.323232  1988 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.326478  1979 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.327116  1979 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.329279  1979 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.329562  2029 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.328178  2083 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.330092  2029 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.336779  2029 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.342991 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:57.343382  2092 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.495s	user 0.004s	sys 0.002s
I20260709 13:10:57.389706  1825 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.390229  1825 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.346131  2084 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.392313  1825 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.365688  2107 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.399511 30403 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:57.348322  1988 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.402489  1988 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.402913  1988 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.396723  2084 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.359369  2083 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.409818 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.410570 30402 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:57.412082 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:57.413071 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.413340  1738 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:57.339466 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 85447.1us
I20260709 13:10:57.415488  2083 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:57.429824  2103 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260709 13:10:57.413777  1738 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.431068  1738 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.437990  1714 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.439045  1825 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:57.439464  1825 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.440361  1825 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.442328 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.443239 30481 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:57.444265 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.445113 30479 raft_consensus.cc:2410] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:57.434366  1988 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.448249  1738 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.451687  1988 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.455575  1599 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.456316  1738 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.456187  1599 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:57.457086 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.458367  1599 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.459435  1738 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.466986  1738 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.468150 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.469097  2082 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.469318  1738 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.459656 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.470659 30557 raft_consensus.cc:2376] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11. Re-sending same reply.
I20260709 13:10:57.464694  1830 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.472954 30553 raft_consensus.cc:1217] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:10:57.473451 30553 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:57.474889 30552 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:57.476522 30552 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:57.465293 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.477497 30479 raft_consensus.cc:2368] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11.
I20260709 13:10:57.478209 30557 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:57.479748 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:57.479883 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:57.480558 31146 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:57.482079 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.483251 30525 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.484216 30525 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.482259 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.487144 30403 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:57.487350 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.487471 30552 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.488296  1738 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.489077  1599 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.489789 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.490381 30480 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:57.491052 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.492192 30483 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:57.494616 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:57.497400 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:57.498399 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.499424 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.501191 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:57.501883 30556 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:10:57.502753 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.501276 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.503021 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.549608 31146 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:57.540117 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:57.549966 30559 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.530943  1712 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.526976 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:57.552805 30556 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.518195 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.553988 30553 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:57.555753 30481 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:10:57.516885 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:57.557612 30405 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.503679 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:57.558856 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.558733 30554 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:57.551990  1825 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.563930 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.565173 30376 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.537992  2029 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:57.516798  1738 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:57.566164  2029 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.571504 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.569585  1714 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:10:57.572517 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.572988  1714 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:57.573347  1714 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.573968  2084 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.574754  2084 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.574918  2107 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.575263  2084 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.567709  1988 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:57.556123  2078 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:57.580214  2029 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.551256  1712 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.592489  1874 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.602124 30559 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:57.606241 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.571902  1738 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.574120  1714 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.610683 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.605110  1988 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:10:57.618505 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 53385.5us
I20260709 13:10:57.604657  1743 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:57.609261  1738 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.620648 30552 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:10:57.619385 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.620970 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.623512 30481 raft_consensus.cc:2368] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11.
I20260709 13:10:57.624910 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.625844 30479 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:57.626863 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.632230 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:57.636273 30523 leader_election.cc:336] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.669s (SENT)
I20260709 13:10:57.639251 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.631178  1599 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:57.640479 30483 raft_consensus.cc:2368] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:10:57.621909  2082 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.657845  1714 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.631102  1743 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.659364 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:57.660822  2082 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.661291  2082 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.667196 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:57.671308 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 51679.1us
I20260709 13:10:57.671761  2094 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.672228  2094 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.672592  2094 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.677417 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.678099 30486 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.679009 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.680179 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:57.680780  1824 consensus_meta.cc:287] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:10:57.681879 30480 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 11. Ops: []
I20260709 13:10:57.681610 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:57.683914 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.684760 30481 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:57.637966  1988 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.687853 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:57.689028 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.689342 30556 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:57.688687 30405 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:57.657225  2020 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.695485 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:57.696152 30411 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.687911 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:10:57.697041 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 509649us
I20260709 13:10:57.698194 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.698745 30483 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.699939 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.700610 30480 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:57.701968 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.702219 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.702833 30404 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:57.706008 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:57.696687  1824 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.722442 30411 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:57.707446  1874 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:57.734249  1972 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:57.735303 30486 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:57.735533  1743 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.735245  1972 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.739040 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:57.739292  1972 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.739779 31146 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 4: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:57.740803 30480 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:10:57.742587 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:57.744629 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.745062 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.743988 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.745250 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.744272 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.746627 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.743652 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.749137 30486 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:57.704123  1599 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:57.749897  1599 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:10:57.751233  2118 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:57.750864  1599 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.707772  1955 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:57.753737 30481 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:57.753762  1714 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:57.754134  1955 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.754829  1714 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.756060 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.754374 30482 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:57.757975 30525 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:10:57.734364 30523 leader_election.cc:336] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.748s (SENT)
I20260709 13:10:57.759294 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:57.756414 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50478.7us
I20260709 13:10:57.705907  2115 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:57.704270  2113 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:57.772416 30484 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:57.775041 30404 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:57.776245 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:57.733916  2020 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:57.780040 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47609.9us
I20260709 13:10:57.780967 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.767128  1743 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.763118  1984 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.785380 30482 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:57.785691 30486 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:57.786031 30486 pending_rounds.cc:85] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 5
I20260709 13:10:57.786218 30486 pending_rounds.cc:107] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:57.786422 30486 raft_consensus.cc:2889] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.787842 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.713615  2078 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:57.789575  1825 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:57.789978 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.776257  2113 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:57.780874  2020 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.794955  2082 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.780782  2115 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.797577  2115 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:57.802064 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73120.6us
W20260709 13:10:57.803432 30523 leader_election.cc:336] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.766s (SENT)
I20260709 13:10:57.803470 30482 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:57.804044 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.804991  2078 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.812073  2078 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:57.772102  2094 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.823392 30408 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:57.787837  1874 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.825562 30482 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:57.785214  1714 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.828395  1874 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.804703  2113 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:57.814033  2122 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.834285  2122 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.830192 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1888) took 1191 ms. Trace:
I20260709 13:10:57.765374 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.829582  2116 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:57.835558 30407 rpcz_store.cc:276] 0709 13:10:56.638598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.718048 (+ 79450us) service_pool.cc:224] Handling call
0709 13:10:56.740954 (+ 22906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.687534 (+946580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.687572 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.690107 (+  2535us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.707411 (+ 17304us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:57.707449 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.707525 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.829957 (+122432us) raft_consensus.cc:1685] finished
0709 13:10:57.829993 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.830132 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1000,"raft.queue_time_us":95786,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5320,"thread_start_us":16922,"threads_started":1,"wal-append.queue_time_us":85435}
I20260709 13:10:57.843637 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:57.850157 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65124us
I20260709 13:10:57.806013  2082 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.802143  2084 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.858798 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.848905  2020 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.860263  2089 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:57.844406  2116 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:57.863698  2116 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.864931  2116 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.859078  2124 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:57.865722  2113 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.866268  2124 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:57.867195  2124 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.867702 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.868198  2124 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.869742  2113 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.871975  2094 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.872838 30483 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:57.830298  1980 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:57.880067  1738 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.881299 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.883422 30480 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:57.883479 31153 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:57.883760 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.884095 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.881903 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.894065 30478 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:57.894786 30482 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:10:57.902842 30483 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:57.904717 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.892644  2113 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.905663  2134 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:57.908491 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.909504  2020 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.909929  2084 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.907632 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:57.911383 30477 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:10:57.910307  1980 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:57.911434  2073 consensus_meta.cc:287] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.000s
I20260709 13:10:57.916795 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:57.919514 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116119us
I20260709 13:10:57.922755 30479 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:10:57.923204 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.924679 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:57.926447 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 170439us
I20260709 13:10:57.931762 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.932538 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.933234 30555 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.933115 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:57.933880 30551 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.934242 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.934819 30477 raft_consensus.cc:2376] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11. Re-sending same reply.
I20260709 13:10:57.926163  2020 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:57.948295 30523 leader_election.cc:336] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.930s (SENT)
I20260709 13:10:57.949023 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.949218 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:57.929312  1743 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.938048  2113 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:57.951071  2133 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:57.934924  1980 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.954341 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:57.955955 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:57.954254  2134 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:57.956799  1980 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:57.957662  1980 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:57.958585  1980 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.962770 31144 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:10:57.964286  2084 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:57.965246 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.961555 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.967832 30477 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:57.954527  2113 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.970649  2113 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:57.967365  2133 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:57.976408  2133 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:57.976869  2113 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:57.979358  2113 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:57.980909 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:57.986506  2132 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:10:57.988749 30555 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:10:57.990972 30551 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:10:57.997099  2128 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
W20260709 13:10:58.011602 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 72879.1us
I20260709 13:10:58.015929 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.017400 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:57.970135  2116 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:57.969890  1599 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:58.023211 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67286.8us
W20260709 13:10:58.024504 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 70242.5us
I20260709 13:10:58.027240 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:58.027633 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.028960 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:58.035395 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:58.037292 30523 leader_election.cc:336] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.999s (SENT)
I20260709 13:10:58.037927 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.042130 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.044539 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:58.046463 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.049825 31116 leader_election.cc:400] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11.
I20260709 13:10:58.050853 31116 leader_election.cc:403] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:58.051093 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.026234  2020 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.040022  2083 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.041431  2084 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.033710  2116 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:58.057305 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.038769  1916 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.059661 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:10:58.060071 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.055898  1599 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.061441  2029 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.061970  2029 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.062340  2029 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.041463  1979 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:10:58.063534 30523 leader_election.cc:336] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 2.022s (SENT)
I20260709 13:10:58.064291  2137 raft_consensus.cc:2764] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:58.063979 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.065941  2128 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:58.066131 30523 leader_election.cc:336] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 2.046s (SENT)
I20260709 13:10:58.066656 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.059574  2058 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.057360  2073 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:58.074137 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.080639 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:58.085554 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50287.6us
I20260709 13:10:58.071882  2084 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.086882 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.072831  2124 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.107259  1980 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.090395 30405 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:58.138446 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51666.9us
I20260709 13:10:58.139722 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:58.140012 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.078200  2088 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:58.122248 30551 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:58.148770  2020 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.077986  2083 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:58.151413  2083 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.124354 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.153498  1962 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:58.127970 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 2135) took 1081 ms. Trace:
I20260709 13:10:58.129241 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:58.155014  1962 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:58.155333 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.155887  1962 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:58.155920 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.156719  1962 raft_consensus.cc:697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.156800 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.157126 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:58.154850 30411 rpcz_store.cc:276] 0709 13:10:57.046553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.659128 (+612575us) service_pool.cc:224] Handling call
0709 13:10:58.127762 (+468634us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b5400285fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:58.127875 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83237632}
I20260709 13:10:58.157670  1962 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.157711 30481 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.159890  2144 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:58.160290  2144 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.161118  2144 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.162613  2144 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.129794  2133 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:58.132686  1955 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.168527  2133 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:58.168897  2133 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:58.169642  2133 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:58.125865 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49586.5us
I20260709 13:10:58.172037  2117 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:58.172453  2117 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:58.173235  2117 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.174188  2117 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.079900  2116 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:58.135673 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:58.142889  2084 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.143353  2073 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.146025  1712 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:58.183668 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48132.3us
I20260709 13:10:58.188916 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:58.189728 30556 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.158314 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:58.191181 30483 raft_consensus.cc:2376] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10. Re-sending same reply.
I20260709 13:10:58.194085 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.194934 30404 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:10:58.196900 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57003.4us
I20260709 13:10:58.197319 30411 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 13. Ops: []
I20260709 13:10:58.197710 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.198137 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.198650 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.199666 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.199903 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.163180  2058 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11.
I20260709 13:10:58.201794 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.204362 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.203814 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:58.204731 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.205094 30559 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.205552 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.206136 30551 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:58.206533 30555 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:58.146248  2029 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.208835 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.209812 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:58.208434 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 128735us
I20260709 13:10:58.210134 30402 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:58.211324 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:58.212898 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.212911 30410 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:58.214372 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:58.274333 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.276896 30552 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.214557 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:58.214818 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800297540 after lost signal to thread 29283
W20260709 13:10:58.279259 30507 debug-util.cc:398] Leaking SignalData structure 0x7b080029a380 after lost signal to thread 30343
I20260709 13:10:58.216002  1824 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.216611  2094 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:58.220669 30555 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [9.5-12.8]
I20260709 13:10:58.195950  2133 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.224596 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.202790  2084 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.201299  2124 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.229421 30559 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:58.231734 30556 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:58.233789 30551 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:58.201601  2055 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:58.175173  2116 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.238304 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:58.243952  2029 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:58.245070  2073 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.234086  2122 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:58.247536  1738 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:58.238613  1830 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.253636 30481 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:58.259613 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.259760 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.261287 30558 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:58.262928 30553 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:58.267444 30486 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:58.270954 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.273265 30560 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:10:58.280469 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800245d20 after lost signal to thread 30435
W20260709 13:10:58.280834 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 69609us
W20260709 13:10:58.324512 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800245e40 after lost signal to thread 30436
I20260709 13:10:58.261723 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:10:58.282879 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.325227 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:58.283340 30483 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:58.288180 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:10:58.325676 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800240000 after lost signal to thread 30510
I20260709 13:10:58.282508  2117 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:58.295325 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:10:58.325346 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63691.2us
I20260709 13:10:58.295776  2147 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:58.296263  2091 raft_consensus.cc:2764] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:58.296764 30480 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:58.316335 31146 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:58.317618 30523 leader_election.cc:400] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11.
I20260709 13:10:58.323196 30479 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:58.327349 30552 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
W20260709 13:10:58.329471 30507 debug-util.cc:398] Leaking SignalData structure 0x7b0800201a40 after lost signal to thread 30511
I20260709 13:10:58.282825  2094 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.330224 30478 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:10:58.331079 30481 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:58.332170 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.305006  2088 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:58.343168 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:10:58.345139 30507 debug-util.cc:398] Leaking SignalData structure 0x7b080035bae0 after lost signal to thread 30584
W20260709 13:10:58.346444 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef8a0 after lost signal to thread 31180
I20260709 13:10:58.328289  2117 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.328351  2029 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.356412 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:58.361160 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:10:58.366392 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 80650.2us
I20260709 13:10:58.367445 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.369711 30483 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:58.371450 30478 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:58.363554  2117 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.373425 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:58.376827 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.377333 30402 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.340593  2131 raft_consensus.cc:2764] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:10:58.374897 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.375564  1955 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.384112 30483 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:58.343720  2088 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:58.387151 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.332851  1830 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.333735  2122 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.375808  2137 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:58.397388 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.408814 30450 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.410820 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.416327 30523 leader_election.cc:400] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:10:58.417518 30523 leader_election.cc:403] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:58.385922  1984 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.386426 31144 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:58.389685  2113 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:58.431252 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.388960  2088 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.379094  1961 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:58.371109  2029 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.438277  2123 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:58.411160  2137 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:58.468950 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 87913.1us
I20260709 13:10:58.436122  2143 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:58.422458  2148 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.397781  1979 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:58.387128  2124 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.438783  2130 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.385767  1962 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:58.432678  2114 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.338327  2147 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.388048  1874 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:10:58.473490 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 98676.3us
W20260709 13:10:58.473755 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76637.2us
I20260709 13:10:58.469170  2115 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.485237 30477 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:58.502223 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.465173  1980 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:58.507494 30478 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:58.501329 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.466288  2113 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.474659  2137 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.458170  2128 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:10:58.403158  2094 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.493086  1961 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:58.476979  2148 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:58.483047  1979 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.503938  2143 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.526638 30484 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:58.529969 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:58.511557  2058 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:58.533339 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 146293us
I20260709 13:10:58.524745  1979 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.537058 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.537678 30485 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:58.537487  1979 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.537881  2029 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.517097  1961 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.524506  2148 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.538936 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.531656  1738 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.546633 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.552964 30485 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:58.542604  2128 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:10:58.547150  2143 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.548408  2113 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.546588  1984 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.551172  2088 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.535027  2094 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.563789  1961 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.564982  1961 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.540872  1955 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:58.568773  1824 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.569732 30481 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:58.571070  2088 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:58.541157  2131 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.573102  2137 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.574440  2131 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:58.575337  2131 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.575866  2137 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.576779  2147 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:58.562480  1984 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.559775  1947 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.578459 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.578454 30402 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:10:58.579115 30485 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:10:58.533900  1599 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:58.579787 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:58.583303 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.584261 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:58.585640 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.546571  1979 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.579000  1947 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.541040  1962 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:58.596112 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.592746 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:58.597790 30485 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.594242 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.600452 30404 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:58.610824 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:58.611549 31144 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:10:58.613056 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.614326  1874 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.594645  2083 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.590912  1824 raft_consensus.cc:2764] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:58.627403 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:58.599864  1830 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.599640  2122 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:10:58.633457 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 53746.1us
I20260709 13:10:58.634200 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:58.638031 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 85158.4us
I20260709 13:10:58.641016 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:58.641870 30553 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.614749  1874 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.619891  2083 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:58.664603  2083 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.592177  1599 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.648619 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.635593  1714 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.642234  1712 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:58.650995  2128 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:58.641510  2114 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.656551  1980 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.658330 30553 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:58.664093  2122 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:58.671586 30560 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 6: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:10:58.650338 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:58.682179 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.686934 30408 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:58.699476 30405 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:58.700762 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.642656  2020 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.649094  1874 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.643078  2117 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:58.704982 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60605.9us
I20260709 13:10:58.649909  2159 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:58.648164  2115 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:58.709692 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.710855 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.713277 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:58.713488 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.711467 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.713049 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.712574 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.713799 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.716295 30404 raft_consensus.cc:2376] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11. Re-sending same reply.
I20260709 13:10:58.693177  2122 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:58.735600 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 180023us
I20260709 13:10:58.740792  2122 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.743454 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.748334 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.742192  2122 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:58.759588 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.706122  1712 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:58.689334  1714 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.718765  2131 raft_consensus.cc:1064] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:10:58.706828 31144 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:10:58.765215 30404 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:58.718313  2159 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:10:58.768858 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55902.5us
I20260709 13:10:58.695122  1980 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.777846 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.771953  2160 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.779186  2175 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:58.779382  1947 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:10:58.780081 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.782351 30553 raft_consensus.cc:2368] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11.
I20260709 13:10:58.759153  1824 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.783849 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.710367  2168 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:58.812564 30404 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:58.812954 30410 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:58.760234  2105 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:58.819813 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:58.779739  2159 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.703536  2114 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.755537  2143 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:58.823251 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:10:58.824755  2165 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:10:58.825081  2139 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:58.831910  2029 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:58.843025 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:58.760632  2113 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:58.839223 30408 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:58.857009  2154 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.392s	user 0.000s	sys 0.002s
W20260709 13:10:58.860219  2161 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:58.807695  2160 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.867069  2160 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.867424 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:58.868881  2143 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:58.869285  2143 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:58.869657  2143 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.871616  1714 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.899025 30485 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:58.901319 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:58.844197  2139 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.853382  2029 consensus_queue.cc:1243] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:58.938221 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.938755 30560 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:10:58.877918  1962 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:58.953305 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:58.942030  1962 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.927178  2094 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:58.965790 31118 leader_election.cc:400] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11.
I20260709 13:10:58.969022  1599 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:58.969830  2162 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:58.971032  2162 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:58.971390  2162 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:58.972179  2162 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.977998 30402 raft_consensus.cc:2410] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:58.978145  2169 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:10:58.956367  2117 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:58.878114  1712 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:58.914600  2148 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.980736  2148 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:58.981395  2105 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:58.981945  2105 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:58.985831 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:58.918808  2160 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:58.992693 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:58.991600 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:10:58.994410 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 247466us
I20260709 13:10:59.002867 30554 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:58.992712  2094 consensus_queue.cc:1243] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:10:59.017246 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.036623 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.021059  2176 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.021582  2088 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:59.022805  2114 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.023332  2167 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:59.024013  2091 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:59.024664  2175 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:59.022467 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 202714us
I20260709 13:10:59.049861 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.051046 30523 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.052080 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.052302  2177 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.053066  2177 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.053697  2177 raft_consensus.cc:2764] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:59.028131  2133 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:59.054940  2133 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.056968  2133 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:59.057754  2158 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.058203  2158 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.030844  2117 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:10:59.058531  2158 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.058944  2117 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.035452 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.008816  1916 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:59.016956  2139 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.039669 30405 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:10:59.045145 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:59.066498 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:59.006515  2160 consensus_queue.cc:1243] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:59.036928 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:59.045512  1824 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.064357 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:10:59.067157 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.062413 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 139148us
I20260709 13:10:59.072139 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.074517 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.076892  2105 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.077735  2157 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:59.078219  2157 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:59.082257 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45398.7us
I20260709 13:10:59.049095  2091 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:59.087729 30450 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.092914 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.095513 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:10:59.063387  1980 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.090641 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.128644 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.167513 30554 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:59.080540  2130 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:59.171497 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 99595.7us
I20260709 13:10:59.096911 30556 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:59.153554 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.152915 31153 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:59.128546 30480 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:59.155642 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.156471 30482 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:59.157548 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.127715 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.047403  2155 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:10:59.174844 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 102806us
I20260709 13:10:59.176002  2155 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.176589  2155 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:59.162344 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.162755 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48740.7us
I20260709 13:10:59.078596  2157 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.111335 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.074155  1916 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:59.076898  2043 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:59.182948  2043 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:59.183488  2043 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.081982  2175 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.129616  2091 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:59.196493  2182 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 13:10:59.080797  1824 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.202881  1824 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.152792  2123 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:59.131074  2128 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:10:59.048888  2176 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.098793  2133 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:59.188117 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 92715.1us
W20260709 13:10:59.187404  2083 consensus_meta.cc:287] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
W20260709 13:10:59.188980 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 61411.6us
I20260709 13:10:59.193331  2156 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.130833  2137 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:59.221870 30478 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:10:59.231659  2156 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.158926 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.232182  2156 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.224195 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:59.234107 30558 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:59.239928  2155 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.073387  1874 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.243875 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.096973  1599 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:10:59.171877  2130 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:10:59.204360  1712 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:59.249526 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 77268us
I20260709 13:10:59.259959 30551 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:59.153544  2116 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:59.173408  1825 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:10:59.224036  1738 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:59.265290 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.266345 30404 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:59.097097 30553 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:10:59.251997 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 169440us
I20260709 13:10:59.267889 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.097293 30559 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:59.241423  2167 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.273478 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:59.296489 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 120271us
I20260709 13:10:59.321427 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.245765  2134 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:59.322059 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64096.1us
I20260709 13:10:59.324290 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.326929 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.230863  2083 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:59.335290 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.349140 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:59.229233  2128 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.205219  1916 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.342984 30483 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:59.359248 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 90013.1us
I20260709 13:10:59.351584 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.374631 30479 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:59.368486  1962 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.371990 30405 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:10:59.373170  2187 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:10:59.373709 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.375156 30406 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:59.386430 30557 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 4.
I20260709 13:10:59.375952 30477 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
W20260709 13:10:59.350837 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.396195 30405 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:59.271005  2133 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:10:59.424700 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 165577us
W20260709 13:10:59.436151 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 158544us
I20260709 13:10:59.329042  2134 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:10:59.476541 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 152223us
I20260709 13:10:59.377882  1874 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.487190 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.487852 30557 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:59.471689  1962 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:59.480413  2134 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.332217  2167 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.346364  2190 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:10:59.479094  2091 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:59.490963 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 61369.4us
W20260709 13:10:59.510958  2188 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:10:59.511834  2179 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:59.516880  2083 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.397269  2130 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.519233  2124 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.539369  2124 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.519726  2157 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.535871 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.544731 30557 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:10:59.519739  2148 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:59.545346 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:10:59.536952  2167 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:59.538865  2091 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:10:59.495536  2122 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.001s
I20260709 13:10:59.549836 30557 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:59.551239 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.553669  2215 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.554229  2215 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.554646  2215 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.542227 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.556650  2167 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:59.557140  2167 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:59.558008  2167 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.561058 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.563580  2128 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:59.494731  1599 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:59.564702 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:59.565864  2156 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.571094 30410 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:10:59.571456 30410 pending_rounds.cc:85] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:10:59.571650 30557 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:59.571681 30410 pending_rounds.cc:107] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:10:59.572391 30410 raft_consensus.cc:2889] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.573701 30557 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:59.531396  2176 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.576924 30525 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.586836  2137 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:10:59.591228  2122 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:59.592962  2157 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.592854  2207 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:59.594095 31147 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:59.594125 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.496692  2158 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.598649  2197 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:59.600195  2156 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.601117  2043 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.547827  2179 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.569566  2094 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:59.603430  2143 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260709 13:10:59.588672  2124 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.604969  2176 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:59.609182 31151 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:59.609376 31148 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:59.610636 31149 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:59.635977 31153 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:59.688086 31148 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:59.639062 31146 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:59.711344 30308 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 10, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.640626  2094 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.641703  2128 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.719167 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:59.721583 31148 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.616657  2215 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.735054 31148 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:59.641350  2197 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.740250 31153 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:59.741050  2197 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.753090  2128 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.756775  2137 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.763370  2208 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.764168  2208 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.645593  2143 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.766914 30403 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:59.703074  2124 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:59.742228  2113 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:59.769685  2176 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:59.775321  2176 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:59.774796  2113 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:10:59.775710  2176 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:59.776592  2176 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.725448  2094 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.771975  2203 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:59.754336 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1912) took 1048 ms. Trace:
W20260709 13:10:59.770833 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.773401  2043 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:59.788205  2218 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:59.789639  2158 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.791782  2215 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.793237  2128 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.794848  2143 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.798728 31148 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:59.793385  2179 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:10:59.773934  2124 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.799732 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.800387 31153 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:10:59.801890  2124 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.754426  2175 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:59.802807  2175 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.803287  2175 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:59.784395  2203 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:59.807471  2203 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:10:59.808694  2203 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:10:59.811951  2058 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:59.812779  1962 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.813328  1962 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.814231 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.799372  2130 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.818011 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:59.825964 30525 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:10:59.780405 30406 rpcz_store.cc:276] 0709 13:10:58.707073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.761615 (+ 54542us) service_pool.cc:224] Handling call
0709 13:10:59.374791 (+613176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.398389 (+ 23598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.754061 (+355672us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54003999d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:10:59.754257 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378662784}
I20260709 13:10:59.845891 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:10:59.851012 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.845587 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.851732 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.784219  2217 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:10:59.856480 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 137176us
I20260709 13:10:59.856681 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:10:59.810348  2203 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.857180  2083 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:59.865342 30409 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:10:59.845551  2143 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.869004 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.872957 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:10:59.853012  2133 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.873660 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.875239 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:10:59.876116 31148 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:10:59.877827 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:10:59.857584  2113 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.857771  2208 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.880245 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:10:59.866082  2207 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.866791  2179 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.885623 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.886430 30552 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:59.871083  2134 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:10:59.868116  2217 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.883328  1824 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:59.888240  2113 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:59.912508  1824 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:10:59.913141  1824 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:10:59.915316 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.915918 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.881487  1874 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:59.876319  2143 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.889334 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.912359 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.875494  2133 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.932535 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.940562 30485 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.933513 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:10:59.908610 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.910283 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:59.942359 30559 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.919557 31118 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:10:59.888067 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:10:59.902272 30411 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:59.949190 30560 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:10:59.881765  2114 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:59.951717 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.952773 30486 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:10:59.952672 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.956882 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.957669 30483 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:10:59.958717 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.962005 30402 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
I20260709 13:10:59.967227 30485 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:10:59.977607 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.978053 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.978230 30484 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.891597  1962 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.968667 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:10:59.982196 30559 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:10:59.982411 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:10:59.983352 30560 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.983660 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:10:59.921798  2217 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.985939 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:10:59.943552  1874 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.954249  2158 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.994202  2158 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.994102  1874 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.994776  2158 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.903067  2199 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:10:59.996438  1874 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.994796  2156 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:59.997682 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.985661 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.998996 30486 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:00.000168 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:00.000736 30486 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:10:59.943301  2133 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:00.001751 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.899036  2083 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:10:59.997803  2156 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:10:59.900031  2179 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.004602  2156 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.006273 30478 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:00.006645 30478 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:00.007920  2143 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.010742  2134 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:10:59.990499  2173 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.002681 30486 raft_consensus.cc:2410] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:00.019037 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:00.020437 30483 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:59.906630  2175 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.023193  2175 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.023463  2094 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.025462  2094 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:10:59.980275 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:10:59.992473  2200 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:11:00.007494 30478 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.032624  2200 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.032698 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:00.033252  2200 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.033908 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.036669 30481 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:00.044198 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.044811 30556 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:00.039979  2200 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.047174  2200 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:00.047470 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:00.047775  2200 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:10:59.892131  2207 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.050185  2200 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.050588  2207 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.052428  2204 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:10:59.997617  1824 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.055513 30560 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:00.056636 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:00.058655 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 184248us
I20260709 13:11:00.059254 30484 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:10:59.992383 30485 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
W20260709 13:11:00.065687 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 125474us
I20260709 13:11:00.065856 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.053069  2204 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.066574 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:00.066612 30483 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:11:00.069451 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 186767us
I20260709 13:11:00.080091 30403 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:11:00.080509 30403 pending_rounds.cc:85] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 5
I20260709 13:11:00.080721 30403 pending_rounds.cc:107] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:11:00.065905 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:00.080941 30403 raft_consensus.cc:2889] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:00.074908 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 142487us
I20260709 13:11:00.072006 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:00.082309 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.084934 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:00.092145 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:00.094210 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:00.084275 30403 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:00.097867 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.103001 30410 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:00.105357 30560 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:00.108896 30407 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:00.110595 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:00.113853 30560 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:00.116149 30559 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:00.082945  2202 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.072232  1824 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.119752 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:00.118333 30560 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:00.083300  2207 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.122812 30560 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:00.067942  2133 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.106829  2130 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.106593  1874 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:00.107231  1916 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.124187  2230 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.125813 30376 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:00.069209  1962 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:00.112174  2217 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.130388 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:00.127035  2117 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.134719  2143 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:00.142665 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76172.3us
I20260709 13:11:00.114902  2199 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:11:00.128270  2094 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:00.124918  2202 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.144837  2231 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:00.149365  2143 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:00.151713  2202 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.152400  1916 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:00.153414  1916 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.126601  1824 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.147432  2215 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.155364  2215 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.156395  1824 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.157021  2175 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:00.157429  2175 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:00.157817  2175 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.147615  2130 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:11:00.118346  2156 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:00.151978  2143 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.135897  2230 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.125993  2158 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.161211  2204 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.131659 30559 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:11:00.163688 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.165978 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56275.8us
I20260709 13:11:00.167028 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:00.129043  2200 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:00.168231 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:00.168382 31152 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:00.132480  2207 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.169970 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:00.149739  2094 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.148955  2167 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:00.176426  1961 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:11:00.178175 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:00.175428  2156 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:00.169656  1824 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:00.183413  1824 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:00.183881  1824 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.144308  2217 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.177017  2094 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.192108  2167 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.203269 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:00.206024  2231 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:00.165524  2230 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.184873  2233 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:00.176607  1962 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:00.176306  2124 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:00.228142 30559 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:00.237962 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64960.6us
I20260709 13:11:00.243029 31146 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
W20260709 13:11:00.246390 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.225101  2207 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.240998  2247 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:11:00.264019 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 171045us
I20260709 13:11:00.248935  2173 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:00.271029  2238 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:11:00.270871 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:00.271476 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:00.273809 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:00.275574  2236 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.250059  2117 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:00.276335  2236 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.280442  2117 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.282043  2240 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.279278 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:00.282835  2199 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.289573 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:00.297895 30559 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:00.299610 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.268446  2197 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:00.307617 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 215534us
I20260709 13:11:00.301959  2233 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.276425  2156 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.287590  2199 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.313373  2173 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.313205 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:00.314427  2162 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:00.306974  2237 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:11:00.315122 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.321902 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.304343  2231 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:00.305699  2158 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.320377 30552 raft_consensus.cc:2410] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:11:00.306221  2200 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:00.322476 30559 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:00.312570  2133 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.328294 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.329734 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.330850 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.331836 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:00.332355 30410 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:00.333457 30410 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:00.334733 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:00.335386 30559 raft_consensus.cc:2368] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:11:00.336148 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.337085 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.338002 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.338668 30559 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:11:00.328301 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:00.319284  2173 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.342031  2173 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.323946  2203 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.345724  1824 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.345661  2175 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.351413 30555 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:00.358134 30559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:00.360348 30559 raft_consensus.cc:606] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:00.360672 30559 raft_consensus.cc:614] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:00.360826  2167 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:00.312791  2197 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.365489  2217 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.339823  2124 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.366276  2230 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.317749  2233 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.366238  2124 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.369787  2233 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.372126  2124 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.372439  2139 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.377271  2168 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:00.377797  2168 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:00.369904  2094 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.377341  2175 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:00.378613  2168 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.389973  2094 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.391124  2168 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.391337 30552 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:00.396662  1824 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.400859 30552 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:00.386902  2230 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.419881 30552 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [9.5-12.8]
I20260709 13:11:00.426240 30411 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:11:00.590113 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.760697  2215 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.834355 30405 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:11:00.834898 30405 pending_rounds.cc:85] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 7
I20260709 13:11:00.835191 30405 pending_rounds.cc:107] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:11:00.835486 30405 raft_consensus.cc:2889] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:00.846501 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.879777  1824 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.880442  1824 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.882673  1824 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.883407  1824 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.883975  1824 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.886113  1824 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:00.892930  2173 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:00.893585  2173 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:00.894963 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 566670us
I20260709 13:11:00.894454  2173 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:00.899101 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.899595 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.902309  2243 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:00.908915  2236 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.908291  2243 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.911139  2243 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:00.912658 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.913733 30552 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:00.914803 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.915980 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.916855 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.916980 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:00.917683 30552 raft_consensus.cc:2410] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:11:00.918273 30555 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:11:00.918675 30552 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:00.919580 30555 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:00.920946  1874 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:00.921371  1874 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:00.922211  1874 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.923290  1874 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.931953  2105 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:00.934921  2105 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:00.935792  2105 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.937038  2105 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.938462  2243 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.938967  2243 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.941191  2243 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:00.960548  2218 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.961229  2218 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.963697  2160 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:00.964329  2160 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.973094  2179 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:00.972455 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.976531  2117 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.977185  2204 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:00.966508  2160 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.983561  2218 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:00.986161 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.988320  2243 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.988893  2243 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:00.991007  2159 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.991590  2159 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:00.992089  2243 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:00.993721  2159 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:00.994238  2159 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:00.999176 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:01.000047  2159 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.000912  2243 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:01.004017 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 1865) took 1913 ms. Trace:
I20260709 13:11:01.004400 30551 rpcz_store.cc:276] 0709 13:10:59.090803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.090903 (+   100us) service_pool.cc:224] Handling call
0709 13:10:59.156248 (+ 65345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.260350 (+104102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.003753 (+1743403us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400338bd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:01.003923 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237776256}
I20260709 13:11:01.003708  2243 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.010540 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:01.013124  1825 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:01.013716 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 2185) took 1209 ms. Trace:
I20260709 13:11:01.014124 30402 rpcz_store.cc:276] 0709 13:10:59.804443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.813924 (+  9481us) service_pool.cc:224] Handling call
0709 13:11:01.013529 (+1199605us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002f67d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:01.013642 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295339904}
I20260709 13:11:01.014923  2159 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.018327  2243 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:01.020375 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:01.022683 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.026506  2197 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.027086 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.030315 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.030740 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2194) took 1086 ms. Trace:
I20260709 13:11:01.031224 30404 rpcz_store.cc:276] 0709 13:10:59.943967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.945255 (+  1288us) service_pool.cc:224] Handling call
0709 13:10:59.945644 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.994860 (+ 49216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.994891 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.995321 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.108005 (+112684us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.108052 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.108143 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.030492 (+922349us) raft_consensus.cc:1685] finished
0709 13:11:01.030514 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.030663 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16234,"raft.queue_time_us":52601,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":112189,"threads_started":1,"wal-append.queue_time_us":181887}
I20260709 13:11:01.038821  2234 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.039294 30407 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:01.044255 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.045112 30407 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:11:01.051710  1980 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.052284  1980 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:01.054872 30410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.008s	sys 0.004s
W20260709 13:11:01.055333 30410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.004s
I20260709 13:11:01.060180  2176 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:01.063925 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.066047 30404 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:01.065217 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 542) took 1442 ms. Trace:
I20260709 13:11:01.066854 31150 rpcz_store.cc:276] 0709 13:10:59.622478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.640222 (+ 17744us) service_pool.cc:224] Handling call
0709 13:10:59.696173 (+ 55951us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:59.696504 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.696542 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:59.741125 (+ 44583us) log.cc:844] Serialized 52 byte log entry
0709 13:11:01.056394 (+1315269us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18003fa000. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:01.064579 (+  8185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:01.064704 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.064774 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.064815 (+    41us) raft_consensus.cc:1685] finished
0709 13:11:01.064828 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.065028 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8379,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7759,"spinlock_wait_cycles":2416896,"thread_start_us":8019,"threads_started":1,"wal-append.queue_time_us":1322080}
I20260709 13:11:01.054589  1980 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.072655  2248 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.073184  2248 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.075227  2248 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.075719  2248 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.076125  2248 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.078083  2248 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.079404  2159 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:01.080138  2159 consensus_queue.cc:1243] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:01.080219  2208 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:01.080654  2159 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:01.081032  2159 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:01.081799  2159 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.090065  2159 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:01.093091 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:01.094151  1980 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:01.096238 31149 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:01.096922 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.097064  2160 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:01.097507  2160 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:01.097918 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.098328  2160 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.099434  2160 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:01.102240 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.103143 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.103176 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.103667 31148 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:01.104725 31150 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:01.116822 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:01.118878  2240 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:01.119532  2240 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.121817  2240 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.123557  1825 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.124050  1825 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.126025  1825 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.127732  1738 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.128196  1738 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.129868 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.130496 30558 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:01.130911  2114 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.131844 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.131528 30558 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:01.132498 30551 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 7.
I20260709 13:11:01.094843  2218 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:01.133239 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.105587 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:01.133423  2234 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.106410 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.134121  2234 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.133460  2218 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:01.136962 30479 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:01.105386 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:01.095595  2157 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.138398  2157 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.131505  2114 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.139406 31146 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:01.108294  1743 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.136570  2218 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.140200  1743 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.143692 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 2187) took 1316 ms. Trace:
I20260709 13:11:01.144044 30409 rpcz_store.cc:276] 0709 13:10:59.827574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.827755 (+   181us) service_pool.cc:224] Handling call
0709 13:11:01.143529 (+1315774us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b54002f71d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:01.143641 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6236032}
I20260709 13:11:01.144464 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:01.145553  2197 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:01.145958  2197 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.146281  2197 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.131053 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.153700 30552 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:01.154565  2157 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.157958  2114 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.126519  1825 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:01.160089 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2191) took 1274 ms. Trace:
I20260709 13:11:01.160368 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.160506 30406 rpcz_store.cc:276] 0709 13:10:59.885360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.886173 (+   813us) service_pool.cc:224] Handling call
0709 13:10:59.892497 (+  6324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.911533 (+ 19036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.911564 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.911604 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:59.918738 (+  7134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.159868 (+1241130us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b540012a7d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:01.159916 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.160033 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43348224}
I20260709 13:11:01.106386 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:01.162848 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.767817 30479 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
W20260709 13:11:01.767982 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 661640us
I20260709 13:11:01.768213  2204 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:01.768924 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.170976 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.769872 30483 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:01.769548 30479 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:01.770728 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.771709 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:01.179106 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.772324 30479 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:01.772583  2173 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.773113  2173 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.769577  2204 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:01.775218  2173 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:01.179601 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60916.6us
I20260709 13:11:01.180244 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.775997 30477 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:01.776288  2204 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:01.180518 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.172385  2234 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.771797 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:01.182492 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 103307us
I20260709 13:11:01.781309 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:01.182545 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:01.782935 30480 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:01.183838 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.185889 30478 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:01.211084 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 190760us
I20260709 13:11:01.784373 30374 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:11:01.264951  2271 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:11:01.388252 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.389911  2261 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:01.393199  2203 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.404026 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.534114 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2042) took 1667 ms. Trace:
I20260709 13:11:01.776741  2204 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.536600 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:01.847678 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:01.848078 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 311569us
I20260709 13:11:01.544669 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.848845 30556 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:01.850224 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.850966 30556 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:11:01.852290 30479 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:01.551004 30308 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 6, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:01.562847  2233 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.567533  2248 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.568171  2197 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.569168 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:01.864403 30551 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:01.569427  2227 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:01.575548 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.576900 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.593236  1824 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.593611  2117 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.594470 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2035) took 2342 ms. Trace:
W20260709 13:11:01.596854 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.598186  2177 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.609912  2243 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.614557 30406 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:01.617188 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.899284 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.617574 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.617985 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.620651 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.621719 30407 raft_consensus.cc:1240] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:01.622505  2091 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.626113  2147 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.629304 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.631126 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.908133 30559 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:01.632905  2190 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:01.637956  2128 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:01.638460 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.869006  2228 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:01.676191  2131 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:01.687463 30307 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 200) took 35946 ms (client timeout 15000 ms). Trace:
I20260709 13:11:01.699462  2157 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.727375  1599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.009s
I20260709 13:11:01.732151  2199 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.735803 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1922) took 2468 ms. Trace:
I20260709 13:11:01.920379 30405 rpcz_store.cc:276] 0709 13:10:59.267639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.401628 (+133989us) service_pool.cc:224] Handling call
0709 13:10:59.402151 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.836162 (+1434011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.735485 (+899323us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003994d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:01.735704 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292927744}
W20260709 13:11:01.739238  2160 consensus_meta.cc:287] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.009s
I20260709 13:11:01.158138  1738 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.926973 30559 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:01.928161  1738 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:01.739703  2130 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.928898  2130 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.931013  2130 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.930899  2157 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.932076  2130 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:01.932763  2130 consensus_queue.cc:1243] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:01.933218  2130 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:01.933323  2157 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:01.933588  2130 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:01.740206  1825 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.742622  2116 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.934967  1825 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.935065  2116 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.752046  2240 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.937153  2116 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.937188  1825 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.937660  2240 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.938184 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:01.757958  2218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.007s	sys 0.011s
W20260709 13:11:01.938894  2218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.008s	sys 0.011s
W20260709 13:11:01.761430  2176 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.701s	user 0.015s	sys 0.005s
W20260709 13:11:01.765599 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.172065 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:01.939416 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.940119 30486 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:11:01.776839 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.940652 30477 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:01.940966 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.941581 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.942027 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.777130 30484 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:01.942682 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.777375  2083 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:01.920286  2215 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.777556  2260 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:01.945303  2215 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.776844 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:01.946710 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:01.947250 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 170476us
I20260709 13:11:01.947376  2176 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:01.947510  2215 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.182138 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.780323 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.947896  2176 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.902954  1824 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.791303 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:01.545336  2020 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:01.949806  2020 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.950600  1824 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.950809  2176 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.852151 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.558621  2179 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.853163 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.857120  2204 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.858016 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.845113  2122 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:01.957468 30482 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:01.871464  2203 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.959766 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.860524 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:01.862051 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.846895 30560 rpcz_store.cc:276] 0709 13:10:59.867067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.123586 (+256519us) service_pool.cc:224] Handling call
0709 13:11:00.123861 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.303796 (+179935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.303842 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.309583 (+  5741us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.326814 (+ 17231us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.326856 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.326923 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.533852 (+1206929us) raft_consensus.cc:1685] finished
0709 13:11:01.533873 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.534047 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10351,"raft.queue_time_us":36520,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":176205,"threads_started":2,"wal-append.queue_time_us":78271,"wal-append.run_cpu_time_us":1825,"wal-append.run_wall_time_us":1001860}
I20260709 13:11:01.961702 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.877372 30480 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:01.882083 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.884269 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:01.845583  2261 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.963896 30560 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:01.963994  2261 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.902933  2208 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:01.919023  2168 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:01.952174  2197 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.905689 30551 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:01.916818  2226 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:01.975783  2226 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:01.915470 30307 rpcz_store.cc:269] 0709 13:10:25.740651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.740973 (+   322us) service_pool.cc:224] Handling call
0709 13:11:01.687182 (+35946209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:54.718375 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:54.856286 (+137911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:54.856324 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:10:54.856347 (+    23us) tablet.cc:662] Decoding operations
0709 13:10:54.857472 (+  1125us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:54.857556 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:54.857587 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:10:54.858386 (+   799us) tablet.cc:701] Row locks acquired
0709 13:10:54.858407 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:54.858554 (+   147us) write_op.cc:270] Start()
0709 13:10:54.863430 (+  4876us) write_op.cc:276] Timestamp: P: 1783602654858502 usec, L: 0
0709 13:10:54.863452 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:54.864172 (+   720us) log.cc:844] Serialized 4114 byte log entry
0709 13:10:55.458747 (+594575us) op_driver.cc:464] REPLICATION: finished
0709 13:10:55.739365 (+280618us) write_op.cc:301] APPLY: starting
0709 13:10:55.774258 (+ 34893us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:55.810946 (+ 36688us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:55.837224 (+ 26278us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:55.838988 (+  1764us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:55.839544 (+   556us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:10:55.839612 (+    68us) write_op.cc:312] APPLY: finished
0709 13:10:55.840170 (+   558us) log.cc:844] Serialized 77 byte log entry
0709 13:10:55.853024 (+ 12854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:55.853233 (+   209us) write_op.cc:454] Released schema lock
0709 13:10:55.853304 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:55.891574 (+ 38270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:55.891623 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":274705,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":208650,"apply.run_cpu_time_us":5305,"apply.run_wall_time_us":197589,"num_ops":10,"prepare.queue_time_us":157541,"prepare.run_cpu_time_us":17448,"prepare.run_wall_time_us":446798,"raft.queue_time_us":132705,"raft.run_cpu_time_us":13309,"raft.run_wall_time_us":93065,"replication_time_us":594983,"thread_start_us":496413,"threads_started":4,"wal-append.queue_time_us":309119,"wal-append.run_cpu_time_us":17598,"wal-append.run_wall_time_us":1668106}]]}
I20260709 13:11:01.952386  2020 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.977870  2226 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:01.907024 30478 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:01.908165 30408 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:01.974591  2240 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.850950  2159 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:01.979034 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.979379  2159 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:01.979696 30408 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:11:01.979849  2159 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.980540 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.981297  2203 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:01.631733 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:01.970968  2168 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:01.648494  1743 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:01.845386  2173 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.978724 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2227) took 2043 ms. Trace:
I20260709 13:11:01.982999  2173 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.983271 30478 rpcz_store.cc:276] 0709 13:10:59.935675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.005876 (+ 70201us) service_pool.cc:224] Handling call
0709 13:11:00.006147 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.023358 (+1017211us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b180011a660. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450e4646 00007fa04501e58e 00007fa04509ff9e 00007fa0450a17de 00007fa0450abb49 00007fa0450ac416 00007fa0450a8d8f 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4
0709 13:11:01.185338 (+161980us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b580055d3d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450050aa 00007fa045087447 00007fa04509ffe7 00007fa0450a17de 00007fa0450abb49 00007fa0450ac416 00007fa0450a8d8f 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4
0709 13:11:01.978432 (+793094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.978644 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141838464}
I20260709 13:11:01.984642 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.985190 30478 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:01.986207 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:01.902387  1984 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.918422 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.921347  2228 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:01.987579 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.883508  2227 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:01.923115  2134 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:02.008366  2134 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.009609 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.923530  2184 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.924111 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.010974 30407 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:02.011845 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.012552 30407 raft_consensus.cc:2410] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:11:01.902237  1961 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:01.960891  2215 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:02.014655  1961 consensus_queue.cc:1243] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:01.902624  2117 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.925854 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.014958  2215 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.015648 30403 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:02.010515  2184 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.017479  2184 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.017863  2117 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.018378  2215 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:01.934507  2130 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.019519  2130 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.021396  2159 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:02.022535 30410 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:01.985124  2173 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:02.010469  2134 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.023697 30402 raft_consensus.cc:2410] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:11:02.027297  2261 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.028463 30485 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:02.030047 30485 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.033563 30485 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:02.036098 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.947757  2114 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:01.948217 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:02.038949 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.047997 31146 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:11:01.953433 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 162189us
I20260709 13:11:01.903107  2088 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:01.954830 30556 raft_consensus.cc:2410] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:01.954825 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.049718 30477 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:01.947978 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:02.052263 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:01.956761 30486 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:01.921558 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:01.858916 30308 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 12, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 12 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:01.916867  1599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.009s	sys 0.009s
I20260709 13:11:01.914196  2043 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.880210  2233 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.903288  2177 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.966970 30553 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:02.070176 30308 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 10, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.967238 30411 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:01.961524  2179 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.967991  2189 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:01.910176  2091 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.968644 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:01.968993 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.079479 30479 raft_consensus.cc:2410] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:11:02.079788 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 110876us
I20260709 13:11:02.077744 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:01.959488  2139 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:01.906998  2137 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:01.880029  2248 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.076215 30308 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 4 to 5, term changed from 6 to 8, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to <none>, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:02.069090  2088 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.084303  2248 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.084128 30308 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.084960  2248 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.085230  2137 raft_consensus.cc:3055] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:02.085381  2248 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.912580  2147 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:01.974588  2208 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:01.981559 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.907147  2243 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.997390 30478 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:02.128787 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.161798 30408 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
W20260709 13:11:01.909389 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 144920us
I20260709 13:11:02.087141 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.067919  2203 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:01.978510 30554 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:02.003327 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.003192  1984 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.004112 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:01.982583  2168 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.005870  2228 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:01.996904 30406 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:02.087896  2190 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:02.043581 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.223805 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:02.224751 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:01.885270 30557 rpcz_store.cc:276] 0709 13:10:59.252338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.574436 (+322098us) service_pool.cc:224] Handling call
0709 13:10:59.574664 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.697861 (+123197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.697905 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.697964 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.698008 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.594260 (+1896252us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000384d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:01.594295 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.594421 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282768128}
I20260709 13:11:02.226879 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.228190 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.228792 30410 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:02.045207 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.046303 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:02.052675 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 104773us
I20260709 13:11:02.057996 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:02.047828  2114 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.210207 30485 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:02.165611  1972 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.054052  2197 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:02.083580 30479 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:02.084218 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:02.239133 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 154977us
I20260709 13:11:02.240387 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.241917 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:01.978843  2115 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:11:01.914016 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 129080us
I20260709 13:11:02.085726 30308 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 10 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:01.991192 30404 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:02.080684 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:02.246111 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 165498us
I20260709 13:11:02.085743  2137 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:02.164539 30551 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:02.244949 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.250839 30409 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:02.247339 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:02.250645 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:02.256340 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.080883  2157 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.166s
W20260709 13:11:02.166656 31117 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.920s (SENT) [suppressed 13 similar messages]
W20260709 13:11:02.264626 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97998.6us
I20260709 13:11:02.080832  2189 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.265190 30308 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 8 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:02.266651  2189 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.266990  2234 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.256418  2020 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:02.266726 30308 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 8 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:02.267551  2234 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.256856  2131 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:02.268378 30308 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 2 to 5, term changed from 5 to 9, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to <none>, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:02.268983  2137 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.269694  2234 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.270149  2137 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.252058  2226 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:02.269959 30308 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.271354  2226 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:02.271761  2226 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:02.272182 30308 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.273664 30308 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:02.275197  2284 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:02.275077 30308 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.085902  2088 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:02.192087 30581 debug-util.cc:398] Leaking SignalData structure 0x7b08000c31e0 after lost signal to thread 29283
I20260709 13:11:02.249640  1972 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.071051  2134 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:11:02.081019  1961 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:11:02.085875  2248 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.038002 30480 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:11:02.220443 30478 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:01.885663 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:02.324493 30477 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:11:02.230556 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:02.059171  1743 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:02.161418  2208 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:02.233598 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 175706us
I20260709 13:11:02.328105 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:02.328763 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 443146us
I20260709 13:11:02.329213 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.259173 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:02.259968 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:02.330004 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70917.2us
I20260709 13:11:02.330894 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:02.330555 30308 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.087172 30559 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:11:02.334930 30559 pending_rounds.cc:85] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 8
I20260709 13:11:02.335237 30559 pending_rounds.cc:107] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:11:02.335513 30559 raft_consensus.cc:2889] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.255844 31144 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 5: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:02.234848  2114 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.275933  2147 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.164204 30555 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:02.280216 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:02.237408  2168 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.256754  2160 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:02.259052  2122 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.263217  2173 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:02.319942 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080009be20 after lost signal to thread 30343
I20260709 13:11:02.075384  2184 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:11:02.277153  2218 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:02.325783 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 95311.5us
I20260709 13:11:02.277447  2197 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:02.075802  2043 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.261057 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.337920 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:02.340576 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.340378 30308 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 7, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 7 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:02.341038 30376 leader_election.cc:400] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7.
I20260709 13:11:02.320724  2159 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.321120  2131 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:02.349502 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080018c320 after lost signal to thread 30435
W20260709 13:11:02.363543 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080018c2c0 after lost signal to thread 30436
I20260709 13:11:02.339862  2281 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.352216 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:02.346805  2128 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.359113 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.344338  2260 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:02.364688 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.365020 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080032bfa0 after lost signal to thread 30510
I20260709 13:11:02.333707  1980 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.344937  2160 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.345204  2122 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.333420  2189 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:02.348487  1599 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.381872 30308 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.346736  2173 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:02.421576  1980 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:02.382972  2128 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.438221  1980 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.377257  2197 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:02.440950  2233 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.440816  2197 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:02.443241  2289 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:02.380481  2281 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.443892  2281 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.353075  2218 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:02.444976  2283 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:11:02.446082  2122 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:02.446681  2291 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:11:02.447988  2288 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:02.451860  2179 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.355587  2203 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.452669  2203 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.352149  2261 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.385632  2083 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.363575  2208 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.443077  2131 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:02.387519 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080032d0a0 after lost signal to thread 30511
I20260709 13:11:02.422066 31148 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:02.455883 30308 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:02.482383 30581 debug-util.cc:398] Leaking SignalData structure 0x7b08003e20c0 after lost signal to thread 30584
W20260709 13:11:02.482759 30581 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9300 after lost signal to thread 30585
W20260709 13:11:02.416740 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58812.4us
W20260709 13:11:02.423321 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 162328us
W20260709 13:11:02.484665 30581 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce6a0 after lost signal to thread 31180
I20260709 13:11:02.437449  2160 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.437894  2173 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:02.430516 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 71458us
I20260709 13:11:02.520082 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:02.521026 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.522625  2233 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:02.523990  2233 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.524369  2233 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.524681  2233 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.466876 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.526118 30405 raft_consensus.cc:2410] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:02.437575 30482 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:11:02.526707 30482 pending_rounds.cc:85] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 6
I20260709 13:11:02.526963 30482 pending_rounds.cc:107] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:02.527257 30482 raft_consensus.cc:2889] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.420434  1825 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:02.417411  2260 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.489398  2248 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.431937  1984 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.431564  1824 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.486133  1980 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.528517 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:02.438200  2128 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.563688  2208 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.485529  2083 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.550472  2240 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:02.485536 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:02.568032 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 82568.4us
I20260709 13:11:02.568948 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.482923 30308 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:02.444986  2218 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:02.496363 30554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 676) took 2563 ms (client timeout 2111 ms). Trace:
I20260709 13:11:02.437103  2043 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.501411  1972 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:02.505868 30558 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:11:02.438184  1599 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:02.505856  2177 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:02.485112 30581 debug-util.cc:398] Leaking SignalData structure 0x7b080009fd80 after lost signal to thread 31181
I20260709 13:11:02.433069  2117 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:11:02.527633  2203 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.433497  2088 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.421094  1961 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:02.418439  2227 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.466504  2243 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:02.570806 30554 rpcz_store.cc:269] 0709 13:10:59.933263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.047245 (+113982us) service_pool.cc:224] Handling call
0709 13:11:02.496150 (+2448905us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003395d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:02.496268 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4357585792}
W20260709 13:11:02.432219  2287 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:11:02.572404 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 43941.5us
I20260709 13:11:02.578745 30308 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 7, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:02.486758  2020 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:02.596928 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.594841  1599 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.386046  2091 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.610248  2139 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:02.612725 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 273918us
W20260709 13:11:02.613437 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.669874 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.613344 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.558195  2226 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.615808 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.679334 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:02.680579 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.552083  2260 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.584816  2190 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:02.643291 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.567444  1824 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.645244 30308 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 8, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 8 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:02.648368 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.551967  1712 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:02.700205 30481 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:02.659678 30478 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:11:02.664386 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 409329us
I20260709 13:11:02.671325 30483 raft_consensus.cc:2410] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:11:02.614609 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.674551 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2200) took 1489 ms. Trace:
I20260709 13:11:02.681772 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.612051  2088 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:02.707804 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.678138 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:02.580164  2215 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:02.689054 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.712105 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.699350 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.657627 30480 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:11:02.728195 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131319us
I20260709 13:11:02.708956 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.730065 30410 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:02.702270 30482 rpcz_store.cc:276] 0709 13:11:01.184877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.030599 (+845722us) service_pool.cc:224] Handling call
0709 13:11:02.030870 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.527647 (+496777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.674241 (+146594us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540034a8d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:02.674479 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934472960}
I20260709 13:11:02.731453 30479 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:02.731415 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.711486 30308 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 9, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:02.733767 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 310226us
I20260709 13:11:02.734175 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:02.734841 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.690497  2243 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.735694 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.742920 30402 raft_consensus.cc:2410] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:11:02.736502 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.736841 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.736886 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:02.726099  2088 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.746984 30480 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
W20260709 13:11:02.708323 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.710621 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.747658 30525 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.711005 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.723687 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2063) took 1135 ms. Trace:
I20260709 13:11:02.753286 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.712283 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.753827 30555 rpcz_store.cc:276] 0709 13:11:01.567218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.576202 (+  8984us) service_pool.cc:224] Handling call
0709 13:11:02.694582 (+1118380us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54002b1bd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:02.702073 (+  7491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642553728}
I20260709 13:11:02.726667 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:02.745616 30308 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.754839 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.755568 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.756820 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.757468 30478 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:02.759094  2203 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.699903  1712 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:02.732537  1738 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:02.795852 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 117798us
I20260709 13:11:02.796423 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.701249  2227 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.685603  2190 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:02.806800 30411 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:02.703156  2020 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:02.726648  1972 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:11:02.810189 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.731478  2131 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:11:02.685843  2043 consensus_queue.cc:1059] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:11:02.816154  2311 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:02.819350  2114 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:02.820374  2137 consensus_meta.cc:287] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 13:11:02.812867 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.813133  2243 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:02.822808  1984 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:02.823541  2091 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.824342  1980 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:02.826790  2307 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.826630  2122 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.759624  2203 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.829022 30410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:02.896119 30410 raft_consensus.cc:606] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.896600 30410 raft_consensus.cc:614] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:02.760222  2130 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.829071 30308 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 9, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 9 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:02.799106  1825 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.826267  2088 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.847987 31149 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:02.738139  2279 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:11:02.793835  2083 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:02.866890 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59413.2us
W20260709 13:11:02.868487 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 137132us
I20260709 13:11:02.873207 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.918159 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:02.918572 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45419.2us
I20260709 13:11:02.919667 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.921025  2083 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:02.921571  2083 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.922236  2203 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.923722  2083 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.924281  2083 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:02.924753  2083 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.828400  2233 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.901958  1984 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:02.671788  2184 consensus_queue.cc:1175] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "027e191e31da4af2bc83c5ddc0c15d05" responder_term: 12 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.9-11.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:02.927160  1984 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.928233  2233 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.929191  1984 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:02.882104 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 72566.1us
I20260709 13:11:02.870518  2190 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.930626 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:02.930812 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:02.932004  2147 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.932965 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.933264  2295 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:02.869933  2020 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.872787  2234 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.874590  2300 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.877496  2215 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:02.908855 30308 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.858165  1712 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:02.885550  2248 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.919353  2197 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.965766 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:02.967629 30479 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.968925  2261 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:02.969372  2261 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:02.975589 30484 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:11:02.976392 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:02.965132  2197 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:02.979676  2309 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.368s	user 0.002s	sys 0.003s
W20260709 13:11:02.939905 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.892843  2307 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:02.985428  2307 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.885776  2313 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:02.942206 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 205429us
I20260709 13:11:02.941836 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:02.895991  2305 raft_consensus.cc:3055] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:02.899381  2130 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.992058  2305 raft_consensus.cc:740] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:02.993204  2305 consensus_queue.cc:260] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.903434  1980 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.992198  2130 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.898619  2299 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.995016  1980 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.995590  2299 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:02.997449  2204 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:02.999223  2305 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:03.000217 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:02.997535  1980 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.001827  2204 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:03.000437 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:03.004647  2308 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 13:11:03.004832 30481 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:03.005894 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 510) took 1121 ms. Trace:
I20260709 13:11:03.006580 30486 rpcz_store.cc:276] 0709 13:11:01.884764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.217784 (+333020us) service_pool.cc:224] Handling call
0709 13:11:02.218047 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.218376 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.218417 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.236622 (+ 18205us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.678650 (+442028us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:02.678685 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.678769 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.003943 (+325174us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:03.005587 (+  1644us) raft_consensus.cc:1685] finished
0709 13:11:03.005604 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.005819 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13492,"spinlock_wait_cycles":4246400,"thread_start_us":391972,"threads_started":1,"wal-append.queue_time_us":474391}
I20260709 13:11:02.997624  2299 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:02.890259  2243 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.921048  2043 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:03.015524 30308 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 10, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.945230  2020 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:02.899108  2281 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.956835  2226 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:02.904572  2173 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:02.955005  2192 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:03.036468 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 60795.8us
W20260709 13:11:03.037839 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 96082.9us
I20260709 13:11:03.038339  2131 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:03.039585  2175 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:03.080691  2175 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.043051 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.044351  2176 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.083498 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.083953  2176 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.084604 31149 raft_consensus.cc:2410] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:03.027202 30308 catalog_manager.cc:5697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.962044  2315 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:03.086671  2176 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.086881  2175 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.087724 30308 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.090070  1712 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.077127 30479 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:03.091084  2301 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.962038  2198 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:03.093024  2147 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:03.094478  2310 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:11:03.094836  2317 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.961531  2234 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.095995  2261 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.097509  2173 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.098130  2197 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:02.962951  2300 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.099653  2215 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.157945 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.046140  2159 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:11:03.102010  2281 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.102887  2122 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.055814 30298 maintenance_manager.cc:419] P 47740a6b78644dffa37c97c591d3d3e7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033391
I20260709 13:11:03.103991  2088 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.029245  2248 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:03.106371 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91804.7us
I20260709 13:11:02.959491  2298 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
W20260709 13:11:03.105973 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 113110us
I20260709 13:11:03.035266  1824 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.117321 30308 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:03.122714 30407 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:11:03.189472 30407 pending_rounds.cc:85] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 8
W20260709 13:11:03.148123 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67974.7us
I20260709 13:11:03.189736 30407 pending_rounds.cc:107] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:11:03.190021 30407 raft_consensus.cc:2889] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:03.153750 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 219262us
I20260709 13:11:03.154947 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.157230 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.157389 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.100831  2190 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.116518  2226 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:11:03.078670  2307 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.116575  2137 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:03.147912  2177 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:03.165112 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.186444 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:03.154836  2114 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:03.131943 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.161669 31144 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.193862 30410 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:03.224819 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 732) took 1242 ms. Trace:
I20260709 13:11:03.224642 30308 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 7, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 7 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:03.225201 30407 rpcz_store.cc:276] 0709 13:11:01.982664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.019168 (+ 36504us) service_pool.cc:224] Handling call
0709 13:11:02.019416 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.190495 (+1171079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.224627 (+ 34132us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001225d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:03.224765 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536623872}
I20260709 13:11:03.226051 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.217368 30559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:03.197305 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.164302  2261 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.150991  2198 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.200287  2298 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:03.234319 30554 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.201475  1712 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.188980  2248 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.191481 30403 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:03.245632 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.245760 31149 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:03.246490 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.199482  2299 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:03.226989 30559 raft_consensus.cc:606] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.214357 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.226783 30409 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:03.226487 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.233700 30410 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:03.233901 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.152031  2301 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.152204  2322 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:11:03.242965 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:03.197211  2128 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 13:11:03.244423 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.276436 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.277067 30407 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:03.247916 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:03.277271 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50857.9us
W20260709 13:11:03.279083 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 81829.1us
I20260709 13:11:03.250767  2248 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:03.251612  2334 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:11:03.252441  2324 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:03.280133 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.290132 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:03.253871  2139 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.001s
I20260709 13:11:03.255475 30411 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:03.259127 30404 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
W20260709 13:11:03.235620 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49279us
I20260709 13:11:03.259300 30405 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:03.259593 30559 raft_consensus.cc:614] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:03.234783  2208 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.001s
I20260709 13:11:03.269555 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.294744 30409 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.267994 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:03.204973  2088 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:11:03.305130 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:03.292201 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.247221  2083 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.245250  2173 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:03.300203 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.301010 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.301817 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.310494 30402 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:03.303076 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.305805 30405 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:03.316213 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.317633 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.306468 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.235570  2177 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.334896 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.336248 30481 raft_consensus.cc:2410] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:11:03.330087 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.341077 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.293046  2228 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:03.341234 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.292308  2204 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:03.310433  1599 consensus_meta.cc:287] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.001s
I20260709 13:11:03.327384 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.352270 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.342020 30553 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:03.346343 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.331583 30407 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:03.356398 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.357227 30555 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:03.304898  2122 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:03.305327  2139 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.365000 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.336819  1743 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:03.305397  2281 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:11:03.378144 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.367285 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.381012 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.370002  2215 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:11:03.382001 30411 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:03.382128  2139 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:03.382545  2139 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:03.382843 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.383334  2139 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.384953  2139 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.369264 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.366570 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.371889  2333 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:03.372619  2179 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.386945  2333 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:03.387367  2332 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:11:03.376839 30559 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:03.361896  2134 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:03.368407  2292 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:11:03.348238  2308 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:03.401114 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.291623  2128 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.383868 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.415189 30557 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.374578 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.388778 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.386065 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.387238  2179 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.416424 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.417008 30553 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
W20260709 13:11:03.417742 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.305188  2147 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:03.396837 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.348466  2228 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:03.363014  2299 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:03.431267 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.431412 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.377367  1743 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:03.418424 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.413105  2134 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.366937  2243 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.424526 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.424872 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.419294 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.457543 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.367388  2328 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 13:11:03.427321 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.430171 30557 raft_consensus.cc:2410] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:11:03.369952 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.393291  2199 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.387379  2333 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:03.438480 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.434468  2299 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:03.443213  2179 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.484974 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.485617 30552 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.486476 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.486634  2199 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.443733  2319 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:11:03.444865  2212 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:03.488327 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.488536  2212 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:03.488942  2212 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.489049  2199 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.489516 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:03.445891  2335 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:11:03.491833  2248 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.494226 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.494930 30560 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:03.495800 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.496833 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.497351 30560 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:03.460330  1961 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:03.498723  2179 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:03.499073 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:03.449369  2260 consensus_meta.cc:287] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.003s
I20260709 13:11:03.449756  2177 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.457376  2134 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.507218 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.509703 30555 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:03.458315 30559 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
W20260709 13:11:03.439568  2168 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.093s	user 0.006s	sys 0.005s
I20260709 13:11:03.368268  2130 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.465780 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.515082 30483 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:11:03.466079 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.433570  2228 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.483711 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.483860 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.487108 30552 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.519060 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.518548  2020 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.520051  2248 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.520238 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.438581  1743 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.499239  2179 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:03.525822  2020 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.526636  2179 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:03.450852  2160 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.930s	user 0.006s	sys 0.005s
I20260709 13:11:03.364248  1599 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.527895  2160 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:03.528601  2218 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.000s
I20260709 13:11:03.528983  2218 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.529421  1599 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.420909 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.530256  2160 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.530637 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.530937 30408 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:03.531502 30405 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:03.531594 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.531870 30404 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:03.532582 30556 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:03.488332 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.533299 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.534130  2281 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:03.534439 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.534585  2281 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:03.535264  2281 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:03.418959  2173 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:03.536473  2173 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.531096  2198 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:03.538203  1825 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.602s	user 0.000s	sys 0.006s
I20260709 13:11:03.507874  2260 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.540005  2128 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:03.540998  2260 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.506209 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.542325 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.542685  2218 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.542994 30486 raft_consensus.cc:2368] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:03.543411 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.543831 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.544654 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.544910 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.513021 30559 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.499100  1961 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:03.521245 30406 raft_consensus.cc:2368] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
W20260709 13:11:03.506080  2332 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:03.467881  2234 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:03.513336  2330 log.cc:927] Time spent T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:11:03.521263  1984 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.525657 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:03.533403 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45167.5us
I20260709 13:11:03.557144 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.535538 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.560341 30407 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:03.511997 30560 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:03.545349 30484 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:03.560842 30483 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.510819 31148 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.521107 30478 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:03.547569 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.534346  2190 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.517496  2307 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.555444 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.565057 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.565764 30484 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:03.567567 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.568986 31148 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:03.568912 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.569701 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.524260  2300 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.538610  1825 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:03.571079 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:03.562429 30559 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:03.576089 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.553691 30409 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:03.572825 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.577138 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.577462 31150 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:03.577903 30484 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:03.570797 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.578526 30405 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.580772 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.579398 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.467355 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.582267 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.585273 30557 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:03.585175 31146 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.576788 30559 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:03.583101 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.586292 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.583192 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:03.587231 30557 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:03.588814 30559 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:11:03.583092 30409 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:03.584286 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.589545 30557 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:03.583899 30486 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.590684 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.594580 30552 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:03.595243 30480 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:03.594063 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:03.594559 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.595116 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.593248 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.596242 30483 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.595939 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.596692 30411 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:03.597887 30559 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:03.597440 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.609094 30551 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.592419  2299 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.575037  2260 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:03.594563  2197 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:03.610751 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.611882 30484 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.613166 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.574584  2234 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:03.635815 30411 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.592813  2300 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:03.624778 30559 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:03.639425 30483 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:03.639017 30484 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:03.566890  1984 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.642298 30560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:03.643308 30551 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:03.646519 30560 raft_consensus.cc:606] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.647074 30560 raft_consensus.cc:614] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:03.628108  2260 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.648417  2260 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.629662  2197 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:03.651309  2197 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:03.584286  2281 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.622834  1825 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:03.636463  2234 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.619108  2199 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:03.668618 30558 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.668695 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.642338  2301 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.594137  2307 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:03.669565 30409 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.669404  2234 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:03.642125  2134 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.685791 30552 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:11:03.696334  2307 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:03.696664  2134 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.696823  2307 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:03.697467 30402 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 17: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:03.697700  2307 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:03.698626  2091 consensus_meta.cc:287] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.808s	user 0.008s	sys 0.003s
I20260709 13:11:03.699174  2091 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:03.635799  1961 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.694042  1743 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.671036  1825 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:03.707485 30552 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.742875  1743 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:03.749303 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.752209 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 516) took 1003 ms. Trace:
I20260709 13:11:03.751739  2333 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:03.755681 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.752599 30480 rpcz_store.cc:276] 0709 13:11:02.748688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.752504 (+  3816us) service_pool.cc:224] Handling call
0709 13:11:03.752050 (+999546us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400020b54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:03.752147 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667161856}
I20260709 13:11:03.712949  2307 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:03.716140  1961 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.756667 30411 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:03.754345 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:03.766109 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:03.766103 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:03.770061 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.771466  2091 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:03.773635 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.771485 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.775596 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.756666  2333 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.778375 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2224) took 1070 ms. Trace:
I20260709 13:11:03.783077 30408 rpcz_store.cc:276] 0709 13:11:02.707912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.709386 (+  1474us) service_pool.cc:224] Handling call
0709 13:11:02.709648 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.531434 (+821786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.778156 (+246722us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002f71d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:03.778320 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888414976}
I20260709 13:11:03.774374 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:03.778787 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:03.775382 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:03.784340 30552 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.785724 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:03.787387 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:03.787698 30410 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.789458 30480 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:03.788096 30411 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:03.772171  2261 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.794486 30405 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.797191 30410 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:03.778623  2199 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.783002  2114 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:03.788987  2083 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:03.774080  2091 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:03.791479  2281 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:03.847447 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.953853 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.954190 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.811483  2114 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.900681  2130 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:03.896492 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.905092 31150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:03.957377 31150 raft_consensus.cc:606] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.917482 30481 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:11:03.921145 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.959038 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.923308  1738 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:03.921074 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.920718 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.925972 30560 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:03.927953 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.924340 30410 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:03.772531  1825 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:03.960608 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 79744.4us
I20260709 13:11:03.930382 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.965451 30552 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:03.933012 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:03.940616  2352 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:11:03.941262  2349 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:11:03.942003  2348 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:11:03.920631 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.947690 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:03.948187 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:03.949272 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:04.025238 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 76073.5us
W20260709 13:11:03.952558 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 175375us
I20260709 13:11:03.812615 30411 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:03.962582 30410 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:03.979418 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:03.831516  2261 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:11:03.978195 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.023149 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.034039 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:04.035059 30481 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:04.035166 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 87063.2us
I20260709 13:11:04.036036 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:04.039665 30486 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:04.030635 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:03.960445  2114 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.956532  2315 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:04.050414 30479 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:04.052059 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 73955.1us
I20260709 13:11:04.052436 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:04.037017 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:04.055879 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:04.058954 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:04.062155 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:03.961254  2192 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:11:03.971285  2159 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:03.965898  1738 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:03.959436  2083 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:04.065812  2315 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.039599  2193 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.064165 30483 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:04.024163  2134 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:04.024361  2300 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.960356  2128 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:11:04.071367 30481 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:04.073971 30410 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.043658  2131 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.049422  2346 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.045225  2199 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:04.097545 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 318830us
I20260709 13:11:04.084012 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:04.080108  2261 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:04.127281 30410 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.070385  2248 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.102228 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.068946  2173 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.119006 30406 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:11:04.139602 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.109503  2159 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:04.104369  2322 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:04.114107  2193 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.070340  2226 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:04.136519 30450 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:04.131024 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.127578  2131 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.145184  2122 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:04.135488  2261 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:04.138613  2248 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:04.181058 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44637.3us
I20260709 13:11:04.182394 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.138312  2173 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:04.157198  2353 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:11:04.158057 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2218) took 1489 ms. Trace:
I20260709 13:11:04.188930 30478 rpcz_store.cc:276] 0709 13:11:02.668676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.757996 (+ 89320us) service_pool.cc:224] Handling call
0709 13:11:02.758319 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.561679 (+803360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.157802 (+596123us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540017b1d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:04.157998 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753692544}
I20260709 13:11:04.127352  2346 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:04.173578 30410 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:04.174865 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.196933 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:04.197232 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 143255us
I20260709 13:11:04.175823 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.180092 30477 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:04.176633  2193 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.184507 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:04.183946  2305 consensus_meta.cc:287] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 1.184s	user 0.010s	sys 0.003s
I20260709 13:11:04.109524  2365 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:04.173283  2300 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.166666  2159 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:04.181208  2131 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.175333  2328 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.185508  2248 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.189257  2173 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.181671  2122 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:04.124331  2134 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.218442  2218 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:04.219710  2212 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.003s
I20260709 13:11:04.211269  2299 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:04.221315  2318 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:04.194420  2091 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:04.199369  2346 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.196187  2128 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:04.164605  2199 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:04.244781  2193 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.242897  1743 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.241441  2122 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:04.186625  1738 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.223706  2365 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:04.224504  2159 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:04.232564  2367 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:04.226104  2300 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:04.281117  2234 consensus_meta.cc:287] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.000s
I20260709 13:11:04.280896  2131 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.281430 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.282133  2300 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.250835  2212 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.284740  2212 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.278950  1738 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:04.287401  2260 consensus_meta.cc:287] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:11:04.287794  2260 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.288748 30486 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:04.289273 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.289767  2260 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.290482 31147 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:04.290575 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.291360 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 521) took 1243 ms. Trace:
I20260709 13:11:04.291468 30484 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.222448  2261 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.291769 30482 rpcz_store.cc:276] 0709 13:11:03.048373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.048521 (+   148us) service_pool.cc:224] Handling call
0709 13:11:03.048815 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:03.184901 (+136086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.184937 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:03.185475 (+   538us) log.cc:844] Serialized 52 byte log entry
0709 13:11:03.271647 (+ 86172us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b1800171ac0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:03.480608 (+208961us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:03.480650 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.291057 (+810407us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003449d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:04.291108 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.291154 (+    46us) raft_consensus.cc:1685] finished
0709 13:11:04.291167 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.291305 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1294,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":4276,"spinlock_wait_cycles":325433472,"thread_start_us":208752,"threads_started":1,"wal-append.queue_time_us":375699}
W20260709 13:11:04.250365  2197 consensus_meta.cc:287] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.006s
I20260709 13:11:04.257882  2091 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:04.289940 30478 raft_consensus.cc:2368] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:04.266830  2301 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:04.308007 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.283003  2131 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.257033  2128 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.209856  2083 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.260362  2366 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.277922  2193 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:04.319721  2361 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:11:04.347882  2315 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.350294  2199 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.360112 30484 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:04.360544  2248 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.337163  2128 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.305637  2365 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:04.258515 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 174612us
I20260709 13:11:04.316835  2197 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.281549  2234 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.377125  2159 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.380571  2228 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.007s
I20260709 13:11:04.408949  2226 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:04.431842 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.402177  2147 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.437434 30480 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:11:04.371157 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 188827us
I20260709 13:11:04.370644  2261 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:04.413030  1738 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:04.411492 30524 leader_election.cc:400] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:04.440392 30524 leader_election.cc:403] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.401646  2322 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:04.436712 30485 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:04.402256 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 199705us
I20260709 13:11:04.448508 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:04.448904 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:04.370611  2366 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.443982 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.445715  2159 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:04.452728 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.454151  1712 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:04.454715  2322 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.458189  1599 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:04.461215  2091 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:04.461024  2173 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.461931  2226 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.463616  2248 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:04.465075  2197 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.466152  2179 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.467155  2122 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.431658  2131 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:04.471068 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:04.471163  2134 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:04.471644 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.471807  2114 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.428463  2228 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.472914  2307 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.005s
I20260709 13:11:04.441149  2147 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.442234 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:04.533208 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 93395.3us
I20260709 13:11:04.521935  2091 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:04.476672 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:04.487540  2189 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.488502  1743 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:04.488910  2234 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.489430  2366 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.495833  2295 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:04.496040  2128 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.555902 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.542902  2189 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.563377  1984 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.563812  2091 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.565194  2091 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.566177  2193 raft_consensus.cc:993] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:04.569973  2147 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.571199 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:04.571885 30551 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:04.573011  2173 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.573757  2193 raft_consensus.cc:1081] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:04.575102 31118 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:04.576617  2325 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:04.577024  2325 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:04.577158 30484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:43256
I20260709 13:11:04.485711  2300 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.499320  2377 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:04.507019  2159 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:04.507998 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64092.5us
I20260709 13:11:04.513734 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:04.514554 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:04.589742 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:04.517247  2373 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:04.521055 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 336595us
I20260709 13:11:04.525636 30560 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:04.520704  1599 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:04.531309 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.534008 30450 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:04.591456 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.477293 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 280458us
I20260709 13:11:04.535122 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:04.529856  1961 consensus_meta.cc:287] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:11:04.596779 31116 leader_election.cc:400] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:04.596632 30552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:04.597129 31116 leader_election.cc:403] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.597388 30552 raft_consensus.cc:606] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.597858 30552 raft_consensus.cc:614] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:04.498610 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:04.563380  2189 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:04.578419 31149 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:04.583645 30409 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:04.517031 30553 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:04.542783  2378 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:04.592314 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.609460 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.592783 31118 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.610801 30407 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
W20260709 13:11:04.592908 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 57873.7us
I20260709 13:11:04.591485 31144 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:04.597581 30376 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.577912 30484 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.613231 30484 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:04.598526 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 99998us
I20260709 13:11:04.617080 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:04.619793  2371 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.605846 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:04.591853 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57946.4us
I20260709 13:11:04.625504 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:04.625710 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.542449  2295 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:04.589877  2043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.011s	sys 0.019s
I20260709 13:11:04.535916  2197 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.626070 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:04.627295 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.630465 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.631244 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:04.535224  2304 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:04.634764 31147 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:04.598507  2281 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:04.643513 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.640372 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.609591  2366 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.649225 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:04.635614  2159 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.632743  2131 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.647394  2128 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.629186  1712 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.625345  2189 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:04.620296  2321 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.644089 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:04.620636  2261 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.621519  2378 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:04.620373  2198 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:04.620653  1825 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:04.632822  2043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.012s	sys 0.020s
I20260709 13:11:04.634210 30484 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.652840  2366 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.656599 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.655030 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:04.657845 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.657485 30482 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:04.684742 30480 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:04.685197 30523 leader_election.cc:400] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:04.632468  2192 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.641947  2304 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:04.670379 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:04.672431 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.631994  2382 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.670123  2248 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:04.636749  2083 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:04.695703 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:04.696242 31150 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:04.696576 31150 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:04.577831  2325 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.636214  2303 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:04.647275  2173 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.606822  2373 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.649365  2020 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:04.681792  2260 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:04.657207  2131 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.654590  2301 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:04.656800 30478 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:04.686223 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.648535  2199 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:04.654224  2197 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.632779  1961 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:11:04.654956  2122 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.689697  1712 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:04.693768 30484 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:04.696344 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.672575  2137 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:04.697587 31150 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.679593  2372 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:04.688918  2366 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.676684  2134 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:04.690902  2377 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.676473  2218 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:04.676200  2261 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.730474 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44374.7us
I20260709 13:11:04.736280 30478 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:04.737839 31150 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.755906 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.722725  2303 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:04.707401  2248 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:04.723214  2325 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:04.679301  2346 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.759511 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.764899 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.734928  2395 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:04.733196  2322 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.770869 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.772117 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.774498 30477 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:04.740497  2301 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:04.769393 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:04.776109 30481 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:04.778002 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.728987  2260 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.758728  2228 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.766567  2173 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.781994 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.765805  2131 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:04.781368  1743 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.784314  2248 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.083501  2179 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:05.084286 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:04.785166  2198 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.085384  2198 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.085515 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.086270 30411 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.786834  2301 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.785991  2399 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:04.890509  2333 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.938232 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.095745 30410 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.095664  2333 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.097842  2333 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:05.098618 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.101073 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 319130us
I20260709 13:11:04.860711  2365 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.811592  2303 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.779217  1961 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.881999  2328 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:04.781770  2189 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.874221  2260 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:04.873234 30404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 1949) took 1567 ms (client timeout 1764 ms). Trace:
W20260709 13:11:05.128057 30404 rpcz_store.cc:269] 0709 13:11:03.306131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.306243 (+   112us) service_pool.cc:224] Handling call
0709 13:11:04.872970 (+1566727us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001207d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:04.873174 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488936192}
I20260709 13:11:05.129572 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.130395 30404 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:05.133075 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.134399 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.135655 30404 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:04.803712  2387 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:04.873941 30408 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:04.873324  2261 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.881263  2083 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.858657 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 162367us
I20260709 13:11:05.150228 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:04.916672 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:04.845539  2228 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.756642  2372 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:04.924973 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.920428  2373 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.151183 30403 raft_consensus.cc:2393] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:04.764411  2377 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:04.917801 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:05.152878 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 235184us
I20260709 13:11:04.884639  2346 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:04.774212  1712 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:04.901659 31150 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:04.739643  2304 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.883200  1980 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:04.780215  2300 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:04.951751  1599 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:04.848811  2391 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.060s	user 0.002s	sys 0.003s
I20260709 13:11:04.731943  2378 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:04.955561 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:04.957686 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:04.885725  2134 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:04.956911  2384 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.288s	user 0.000s	sys 0.012s
W20260709 13:11:04.963239 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 110903us
I20260709 13:11:05.084095  2179 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.165825 30404 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:05.102671 30410 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:04.920921  2299 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:05.106632 30523 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:05.116506  2218 consensus_queue.cc:1243] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:05.117177  2383 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:11:05.127338 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:04.739388  2381 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:11:05.109122  1743 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:05.107658  2319 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:05.109433  2147 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.121116  2328 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:04.778513  2395 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:05.151976 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.154235 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:05.168274 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:05.175417  1972 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:05.123900  1961 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:05.172770 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70810.3us
I20260709 13:11:05.174717 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2260) took 1239 ms. Trace:
I20260709 13:11:05.181301  2378 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.181885 30411 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:05.156095  1712 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.158614  2159 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.199914  2333 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:05.216557  2159 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.203401  1743 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:05.216730  2333 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.155902  1980 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.217307  1743 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:05.218031  1980 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.218202  1743 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.219496  1980 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.219769  2401 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:05.220335  2401 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.158104  2137 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:05.169353  2404 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:11:05.142576  2157 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:11:05.188968 30410 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:05.145195  2307 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:05.222517  2401 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.224798 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:05.223235 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 69069.9us
W20260709 13:11:05.225842  2371 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.003s
I20260709 13:11:05.226227  2371 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:05.223261  2399 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.228719  1961 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.218040  2333 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.230360  2333 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.231273  2346 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.231791  2346 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.162542  2365 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:05.201150 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.236300 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2235) took 1283 ms. Trace:
I20260709 13:11:05.202925  2147 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.236752 30485 rpcz_store.cc:276] 0709 13:11:03.953067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.959907 (+  6840us) service_pool.cc:224] Handling call
0709 13:11:03.960171 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.443356 (+483185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.236091 (+792735us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54000ce4d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:05.236245 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095516416}
W20260709 13:11:05.237372 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.238567  1961 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.239048  1961 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.240885  1961 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.162509  2134 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.273265  2134 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.274973 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 746) took 1818 ms. Trace:
I20260709 13:11:05.275456 30408 rpcz_store.cc:276] 0709 13:11:03.456408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.785678 (+329270us) service_pool.cc:224] Handling call
0709 13:11:04.873781 (+1088103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.145206 (+271425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.274739 (+129533us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001207d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:05.274902 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501887744}
I20260709 13:11:05.276997 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.277916 30408 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:11:05.281932 30407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 2254) took 1717 ms (client timeout 1667 ms). Trace:
W20260709 13:11:05.282496 30407 rpcz_store.cc:269] 0709 13:11:03.564718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.590408 (+ 25690us) service_pool.cc:224] Handling call
0709 13:11:05.281720 (+1691312us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540012a2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:05.281857 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335357312}
I20260709 13:11:05.283874 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.284830 30407 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:05.285724 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.287297 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 1966) took 1908 ms. Trace:
W20260709 13:11:05.176506 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49240.9us
I20260709 13:11:05.287982 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.156391  2083 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.156271  2228 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.214660 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.295310 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:05.188424  2091 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.003s
I20260709 13:11:05.217061  2159 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.168326  2304 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.203826 30406 rpcz_store.cc:276] 0709 13:11:03.935216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.951058 (+ 15842us) service_pool.cc:224] Handling call
0709 13:11:03.951459 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.138546 (+187087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.174353 (+1035807us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540020a154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:05.174625 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384709504}
I20260709 13:11:05.223057  1712 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.184242  2315 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:05.298972 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.266547  1961 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:05.296456  2366 consensus_meta.cc:287] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:11:05.268216  2395 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.268980 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.309068 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.309306  1961 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:05.270555 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.309682  1961 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.287714 30409 rpcz_store.cc:276] 0709 13:11:03.378733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.673678 (+294945us) service_pool.cc:224] Handling call
0709 13:11:03.678443 (+  4765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.604810 (+926367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.287090 (+682280us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400286ed4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:05.287244 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081418496}
W20260709 13:11:05.311129  2405 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:11:05.311251 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.312283 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.312822 30409 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:05.290083 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:05.186225  2212 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.315879  2197 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:05.316432  2197 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:05.327409  2386 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.595s	user 0.005s	sys 0.000s
I20260709 13:11:05.293212 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.328083 30485 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:11:05.295861 30408 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:11:05.291654 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.329203  2295 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.329777 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.295732 30483 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:05.287191  2248 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:05.330860 30559 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:05.331154  2248 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.317910  2197 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.333284  2248 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.304042 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.334628  2192 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:05.267962  2160 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.335073  2192 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:05.335332  2160 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.335932  2192 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.337141 30410 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:05.337427  2160 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.306115 30402 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:05.194314  2319 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.327241  2373 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:05.310423 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.293689 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.344941 30480 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:05.338802 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.339748 30406 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:05.340234 30409 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:05.340569 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.347534 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.300470 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.345914 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:05.348233 30485 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:05.337438  2328 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.350879  2328 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.350944  2160 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.351476  2160 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:05.343408  2192 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.351877  2160 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.352936  2377 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.348807 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:05.356386  2333 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.356833  2333 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.357218  2333 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.358363  2372 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.360834  2319 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.350978 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.365481  2299 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:05.365980  2299 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.366983  2299 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.368330  2299 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.304288  2147 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.370848  2402 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.371418  2402 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.373253  2198 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.373641  2402 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.310453  1961 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.375130  1961 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.375855  2228 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.339257  2366 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.379233  2366 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.380316 30483 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:05.382972  2373 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.382146  2382 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:05.387229  2382 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.388504  2382 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.389703  2382 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.392079 30409 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:05.393105 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.393865 30406 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:05.396525 30525 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:05.399085  2375 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:05.405197 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.405637 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.406455 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.407091 31151 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:05.401055  2375 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.415120 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:05.417109 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.418063 31144 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:05.403788  2319 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.420014 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.408767  2147 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.423939 31144 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:11:05.410349  2204 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.433705 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.439081 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.421132  2319 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:05.448490  2319 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.446341  2198 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.437206  2204 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.445302  2373 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.508579 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:05.532583 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 136785us
W20260709 13:11:05.533977 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.532614 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 318401us
I20260709 13:11:05.534377 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.536736 30406 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:05.540099 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.542601 30551 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:05.543219 30560 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:05.547566 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.548158 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.549187 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.549588 30551 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:05.549922 30559 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.551316 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.551785 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.552597 30406 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.552903 30557 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
I20260709 13:11:05.555338 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.556738 30402 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:11:05.559331 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.559733 30557 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:05.560263 30557 pending_rounds.cc:85] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 4
I20260709 13:11:05.560616 30557 pending_rounds.cc:107] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:05.561038 30557 raft_consensus.cc:2889] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.564111 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.565352 30551 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:05.567971 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.568338 30525 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:05.571411 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.571949 30557 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:05.575495 30525 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:05.577607 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.577960 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:05.578807 30554 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:05.580699 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.580935 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:05.581453 30554 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 5.
I20260709 13:11:05.583170 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.584173 30554 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:05.587774 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.589048 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:05.589743 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.590080 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.590670 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.591056 30560 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:05.593124 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.593962 30552 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.597512  1743 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:05.601733  1743 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.626017 30552 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:05.430235  2147 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.634799  2091 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:05.636709  2147 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.636937  2401 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:05.637585  2402 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.638031  2402 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.638351  2402 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.638581  2328 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:05.639068  2248 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:05.639433  2328 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.642218 30406 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:05.624394  2203 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:05.655182  2420 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:11:05.657284  2218 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.658000  2218 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.454973  2114 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.660054  2375 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:05.654439 30551 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:05.658519  2218 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.664240 30560 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:05.669544 30559 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:05.674064  2233 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.674808  2233 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.629544  1743 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:05.683172 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.683660 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.685030  1743 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:05.654220  2203 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:05.686818  2203 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:05.690105 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:05.654055  2091 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:05.694993  2307 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.695856  2307 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.698304 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:05.702987 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.703301 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.707168 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.709350 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.663947  2147 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:05.719076  1599 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.721408  2083 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.721624  2159 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.723215 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:05.724051 30409 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.724601 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.725800 30555 raft_consensus.cc:2410] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:05.727253 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.693625  2091 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.735011 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:05.743405 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.734614 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.746019 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.751003 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:05.758195 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 68291.3us
I20260709 13:11:05.728068  2307 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:05.773721 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.775758 30406 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:11:05.778941 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.782482 30559 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:05.782474 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 196076us
I20260709 13:11:05.766417  2328 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.789364 30552 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.793763 30551 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:05.802892 30478 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:05.802781 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.803368 31117 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:05.803982 30477 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:05.805099 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:05.805918 30482 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.806066  2424 raft_consensus.cc:2804] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:05.806708  2424 raft_consensus.cc:697] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:05.807788  2424 consensus_queue.cc:237] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.808995 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:05.810894 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.811918  2159 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.814231 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:05.820806 30409 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
W20260709 13:11:05.822247  2304 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.006s
I20260709 13:11:05.823043  2131 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:05.803949 30485 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:05.825944 30403 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:05.824124 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:05.849752 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:05.853634 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.827286  2130 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.866164 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:05.868036 31150 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:05.867120  2131 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:05.870501 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.872776 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:05.876302  2159 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.876727  2159 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:05.876585  2203 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.877677  2422 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.878178  2422 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.878579  2422 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:05.850317  2160 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:05.880184  2378 consensus_meta.cc:287] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.005s
W20260709 13:11:05.880628 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.881441  2367 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.882098  2367 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.883615 30405 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:05.885020  2367 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.877138  2159 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.826436  2083 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:05.895004  2130 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.896106 30486 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:05.895582 31151 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:05.897441  2130 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.898448  2131 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.900116  2319 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:05.901149 30554 raft_consensus.cc:3060] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.903308  2203 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:05.904614  2393 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:05.905143  2393 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:05.916961 30554 raft_consensus.cc:2468] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:05.917991  1712 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.919591  2179 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:05.922850 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:05.946187  2233 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:05.946480 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:05.947606  2204 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:05.910241 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:05.914053 30409 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:11:05.957928 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 60140.2us
I20260709 13:11:05.947549 30555 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
W20260709 13:11:05.964978 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 150055us
I20260709 13:11:05.962589  2233 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.985854 30483 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:05.985348  2356 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:11:05.986186 30407 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
W20260709 13:11:05.987462  2382 consensus_meta.cc:287] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.597s	user 0.017s	sys 0.001s
W20260709 13:11:05.988579  2299 consensus_meta.cc:287] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.620s	user 0.017s	sys 0.000s
I20260709 13:11:05.988837 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:06.002065 30553 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:06.005080  1599 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.006383 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:05.906486  2393 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:05.929636  2083 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.007478 30410 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:05.962208  2304 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:06.080591 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.084133 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.087935 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.090018 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.091178 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.067690  2233 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.088346 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.096364 30556 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:06.103309  2282 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.107358 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.134204  2282 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.108465 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.134650  2282 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.135097 30477 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:11:06.109412 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.136117 30478 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:06.112165 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:06.115485  1712 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.090180  2382 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:11:06.117825  2402 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.131646 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.132141  2083 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.144387 30405 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:06.147939 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:06.155025 30482 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:06.147543  2393 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:06.157856 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.147173  2319 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:06.143527  2333 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.786s	user 0.015s	sys 0.003s
I20260709 13:11:06.159463  2293 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:06.159992  2333 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.160235  2293 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.162516  2333 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.164129  2160 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.151006 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.166093 30406 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:06.148340 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:06.145783 30376 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
I20260709 13:11:06.169195 30376 leader_election.cc:403] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.170212 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.173238 30410 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:06.177096 30406 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:06.175191 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.146003  2304 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:06.182391 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.147668  2402 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.142648  2422 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.197365  2226 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.199047  2233 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.199426 30485 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:06.199827  2399 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
W20260709 13:11:06.201220 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 55667.6us
I20260709 13:11:06.201968 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.182168  2083 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:06.202319 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.203050 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 145459us
I20260709 13:11:06.178565  2218 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.205694  2293 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.221973 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.223675 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.217612  2192 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:06.194420  2282 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.229511  2192 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.230369 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.231148 30482 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:11:06.231938  2192 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.233011 30450 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.234943  2373 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.235080  2197 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:06.235713  2197 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.221884  2226 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.237623  2130 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:06.238386 30486 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:06.238845 30407 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.237869 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:06.243310  2130 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:06.243755  2130 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.244124  2218 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.249836 30480 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:06.251075 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.217975  2233 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.237917  2197 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.258872  1712 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.259142  1599 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.260686 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.261468  1599 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.262651 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.216503  2382 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:11:06.238410  2226 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.266405 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.267870 30485 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:06.267093 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.269328 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.271100 30485 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.271687  2422 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.272468 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.272922  2159 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.274086  2399 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.251376  2083 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.275740 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.276399 30481 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.244683  2130 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.278824 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.279959  2204 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:06.280395 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.278890  2233 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.274324 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.279531  2130 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.284454 30485 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:06.278661 30557 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:06.283814 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.281158  2424 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.287086 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.286846 30483 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:06.291955  2282 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.292881 30477 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:06.295882 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.297323 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.283052  2293 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:11:06.300587  2402 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.300901 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.301097  2402 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.301563  2402 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.302202  2315 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.302646  2315 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:06.303067  2315 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.304056  2233 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.304685  2159 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:06.306618 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.302649 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64896.1us
I20260709 13:11:06.289090  2226 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.312462  2083 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:06.313170 30479 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:06.307960 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.317430 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.317963  2367 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:06.318274 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.328060 30558 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.324167 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.328846 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:06.329145 31151 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:06.330304  2367 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:06.330667  2367 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.331353 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.331609  2367 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.333063  2367 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:06.324724 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.319499 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.316834 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.336011 30486 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.326761 30481 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:06.327358 30556 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
W20260709 13:11:06.338789 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52560.8us
I20260709 13:11:06.339775 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.341398  2328 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:06.344424 31149 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:06.344574  2328 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.345149  2328 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.343997  2157 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.351471  2157 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.353816  2157 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.338708  2373 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:06.354671  2373 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:06.355070  2373 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.358349 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.358809 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.359694  2226 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.373588 30558 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:06.344652  2424 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.377545  2346 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.377851 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:06.377827 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 103575us
I20260709 13:11:06.379348  1599 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:06.379770  1599 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.380147  1599 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.384807 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.387194 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.387862 30485 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.388576 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:06.389693 31118 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.391714 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.392716 30551 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:06.399351 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:06.400243 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.409894 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.410774 30558 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:06.411474 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.412602 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.413089 30559 raft_consensus.cc:2368] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:11:06.408957 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.358400  2328 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.395216  2218 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:06.416572 30560 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:06.418388 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.419771 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.422344 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.423020 30551 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:06.421307 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:06.429708 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.427026  1599 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.431365  2426 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:06.431486  2193 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:06.431902  2426 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:06.432155  2193 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:06.432343  2426 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.432381 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.433133 30480 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 7.
I20260709 13:11:06.433169  2193 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.409691  2160 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.421834  2173 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.451650  2197 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:06.453235 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.454162 30409 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:06.453258 30410 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:06.436074 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.439035 30484 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:06.439311 30560 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:11:06.439934 30559 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:06.440528 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.440949  2382 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:06.441286  2083 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:06.443629  2432 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:11:06.443994 31147 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:06.457175 30560 pending_rounds.cc:85] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 6
I20260709 13:11:06.473182 30560 pending_rounds.cc:107] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:11:06.473462 30560 raft_consensus.cc:2889] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.446913  2395 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:11:06.457592 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.434475  2218 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:06.465984 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.466264 30557 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:11:06.467741 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 79253.6us
I20260709 13:11:06.471787 30486 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:06.475728  1599 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.479672 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.481482 30481 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:06.485137  2157 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:11:06.493062 30485 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:06.500996 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.501808  2299 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.503142 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.505623  1961 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:06.506148  1961 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:06.507228 30410 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:06.507905 31148 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:06.504422 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.514200  2333 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:06.514928  2333 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:06.515045 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.515964 30558 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:06.517166  2218 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.520476 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.521205 30560 raft_consensus.cc:2368] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:06.515903  2333 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.483513  2147 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.521891 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 753) took 1564 ms. Trace:
I20260709 13:11:06.522266 30404 rpcz_store.cc:276] 0709 13:11:04.957134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.168263 (+211129us) service_pool.cc:224] Handling call
0709 13:11:05.168539 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.267090 (+ 98551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.267126 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.267172 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.267204 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.521480 (+1254276us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b54002f5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:06.521544 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.521727 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226028800}
I20260709 13:11:06.524252 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.524893 30484 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.509581  2299 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.509380  1961 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.509951 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.479000  2159 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.529129  2159 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.531512  2159 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.480438  2395 consensus_queue.cc:1243] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:06.497015  2160 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.511577 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:06.535204  1599 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:06.512507  2226 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.548379 30523 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.482196  2399 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.483518  2382 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:06.566962 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55467.4us
I20260709 13:11:06.567934 30478 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:06.579514  1599 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:06.581087 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.583988 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.585143 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.586681 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.586221  1599 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:06.596298 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.596611  1599 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:06.595963 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.585963 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.600937 30559 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.597016 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:06.581022  2197 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:06.599251 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:06.605333  2226 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:06.599680  2179 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:06.580060  2307 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:06.606943 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.611670 30478 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:06.561959  2373 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.580637  2159 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.582024  2319 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:06.580802  2304 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:06.625131 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:06.612232  1599 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:06.613430 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 162221us
I20260709 13:11:06.604125 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:06.615482 30551 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:06.599326  2122 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.638891 30481 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:06.620021 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:06.607491  2197 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.578576  2160 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.610932  2179 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.614413  2307 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.624068  2226 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:06.623179  2319 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.652232 30560 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:06.610602  2422 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:06.654004  1599 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.613973  2315 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.664184  1743 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.664641  2315 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.664791  1743 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.647290  2179 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.666155 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:06.652437  2307 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.626076  2159 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.679608 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:06.681196 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.667011  2319 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.686906 30559 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:11:06.694622 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:06.700700 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:06.703966 30478 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:06.704166 30407 raft_consensus.cc:2410] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:06.704260 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.706820 31144 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.687980 31152 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
W20260709 13:11:06.691665 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 111502us
I20260709 13:11:06.648722  2122 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.691758  2328 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.715860 30406 raft_consensus.cc:2410] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:06.666735  2382 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.717216 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.717993 30407 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:06.715332  2380 raft_consensus.cc:2764] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:11:06.720983  2393 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:11:06.722589 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.723806 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.724303 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:06.725116 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:06.724960 30405 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:06.726325 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:06.726874 30484 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:06.730595 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.737845 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:06.744581 30407 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:11:06.755543 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 221392us
I20260709 13:11:06.691890  2402 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.706775  2443 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:06.713547 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 242289us
I20260709 13:11:06.781433 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.763819 30402 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:06.782797 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.766209  2444 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:06.784101 30451 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.786062  2367 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:06.786567  2367 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.787555  2367 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.766745  1972 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:06.768170  2447 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:06.769994 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:06.771906  2159 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.774106  2402 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.780252  2373 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.797710  2373 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.802019  2122 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.803740 30411 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:06.792912 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:06.706085  2426 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.757941  1712 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.805203 30405 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.811098 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2267) took 1855 ms. Trace:
I20260709 13:11:06.812556 30403 rpcz_store.cc:276] 0709 13:11:04.955514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.164611 (+209097us) service_pool.cc:224] Handling call
0709 13:11:05.164892 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.849883 (+684991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.806424 (+956541us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54002a67d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:06.811039 (+  4615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361573248}
I20260709 13:11:06.819134  2197 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.821918  2197 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:06.824662  2426 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:06.825771 31151 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:11:06.811894  2443 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.826980  2422 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:06.827632  2422 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.828749  2456 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:06.829303  2456 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.830005  2422 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:06.827973 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58165.6us
W20260709 13:11:06.843149 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.843446  2160 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:06.764578  2226 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.847030  2179 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.848930 31144 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 6.
I20260709 13:11:06.852320 30402 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:06.830276  2456 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.870034  2173 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:06.877163  2173 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:06.878026  2173 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:06.891027 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 106987us
I20260709 13:11:06.891806 30405 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:06.896649  2179 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.900081  1743 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:06.902289  2373 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:06.916942 30559 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:06.917403 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.931273 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.879282  2173 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.939755 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.940768 30485 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:06.942687 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:06.943966 30560 raft_consensus.cc:1275] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:06.949245 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.936061  2444 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:06.952291 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.959506 30485 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:06.959550 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.960857 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.930989  2299 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:06.958993 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.958175 30479 pending_rounds.cc:85] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:11:06.964964 30479 pending_rounds.cc:107] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:11:06.965304 30479 raft_consensus.cc:2889] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:06.967017 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49757.2us
I20260709 13:11:06.968874 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.971648 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:06.972188 30480 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.976704 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:06.949784  2468 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.957257  2328 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.939306  2179 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:11:06.979502 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 253249us
I20260709 13:11:06.963204  2422 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:06.977679  2233 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:07.002872  2373 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:06.987093  2328 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.004168  2373 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.004532  2373 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:07.006034  2307 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.956475  1712 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:11:06.990859  2462 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.019397  2462 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:06.970556  2426 consensus_queue.cc:1048] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:07.022981  1743 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:06.972788  2299 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.986506 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:07.005318  2373 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:06.990839  2295 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.993031 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:06.963907  2160 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:07.035898 30480 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:07.039767  2218 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.040184  1599 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.061264  1599 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:07.045312 30478 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:07.045405 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:07.047592  1972 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:07.050091  2422 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:07.069954  1599 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.071152  1599 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.000281  2443 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:11:07.072788  2468 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:07.073182  2468 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:07.064055  2218 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.075327  2218 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.076022  2380 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:07.065421 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 79006.6us
I20260709 13:11:07.076556  2380 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.077505 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:07.069790  2147 consensus_meta.cc:287] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:11:07.070775  2422 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.066578 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:07.072926 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:07.090250 31148 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:07.058612  2160 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:07.092474 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 99524.3us
I20260709 13:11:07.093072 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:07.105793 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.110469 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.114797 30486 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:11:07.078578  2226 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.120561  2307 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.121862 31149 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:07.118760 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:07.091634  1972 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:07.104472  2465 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:07.074193  2468 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.104023  2160 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.098485  2147 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.103935  2204 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:07.153434 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 53272.8us
I20260709 13:11:07.164415 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:07.158407 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 77172.6us
I20260709 13:11:07.152333  2122 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:07.145891  2443 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:07.152025  2319 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.178084 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.173874  2233 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.167487  2380 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:07.179385  2122 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:07.180701  2319 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:07.170487  2204 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.181679 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.182387 30486 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 9: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:07.182921  2204 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.158028  2373 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.186432 30405 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:07.173906  2371 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:11:07.173967  2399 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.176826  2393 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.181103  2198 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.180351  2122 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.218189 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.219641 30405 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:07.221114 30451 leader_election.cc:400] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:11:07.221517 30451 leader_election.cc:403] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.225797 30404 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:07.227903 30407 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:07.232257 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.233098 30405 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.238181 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:07.243971 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 53766.3us
I20260709 13:11:07.245267 30403 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:11:07.245997 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:07.246835 30486 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:07.191476  2346 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.262800 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.258322 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:07.111873  2444 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.224000  2233 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:07.268194 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.265864 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.280325 30407 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:11:07.236722  2382 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.252548  2468 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.240052  2443 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11.
I20260709 13:11:07.291455 30486 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:07.292671 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.292975 30405 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:07.223426  2393 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.223611  2399 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.260933  2218 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.299340 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:07.229888  2198 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:07.320106 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.320024  2467 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:07.320011  2443 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:07.323182 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.323932 30408 raft_consensus.cc:2368] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:07.325075 30408 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:07.329746 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.330555 30410 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:07.338040  2299 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.340956  2328 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.347059 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.347711 30477 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:07.349676 30486 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:07.351941 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.353223 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.354061 30482 raft_consensus.cc:2410] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:07.355324 30484 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:07.279233  2456 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:07.367794 30483 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:07.369316 30481 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:07.374060 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:07.310796  2204 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.289500  2367 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:07.289960  2233 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:07.421479 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 128916us
I20260709 13:11:07.423386 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.314643  2159 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:07.312739  2197 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:07.414143  2455 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.587s	user 0.005s	sys 0.000s
I20260709 13:11:07.294346  2382 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.414882  2380 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.425504  2478 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.105s	user 0.000s	sys 0.005s
I20260709 13:11:07.415711  2402 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:07.411366  2479 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.056s	user 0.005s	sys 0.000s
I20260709 13:11:07.415161  2204 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:07.459189 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.422585  2367 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:07.452759  2456 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.418571  2299 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:11:07.475037 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.490499 30451 leader_election.cc:400] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:07.491106 30451 leader_election.cc:403] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.462421  2204 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:07.497203 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 378531us
I20260709 13:11:07.456077  2380 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.501736  2456 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:07.492290  2367 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:07.489444  2083 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.458083  2443 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:07.511166  2399 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:07.518446  2483 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:07.493919  2373 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:11:07.521147  2382 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.456815  2402 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.523808  2393 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.525421  2233 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:07.460420  2328 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:07.417821  2465 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:07.531905  2462 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:07.535012 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.526182  2492 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:07.545537 30481 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:07.543016 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 95089us
I20260709 13:11:07.555927 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.558655 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.559494 30558 raft_consensus.cc:2368] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9.
W20260709 13:11:07.561138 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 303328us
W20260709 13:11:07.562110 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.557859 30478 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:07.561800 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:07.534338  2402 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:07.568198 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.571280 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.574173 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.575721 30484 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:07.572659  2382 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.584357  2443 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:07.585137  2443 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:07.585955 30450 leader_election.cc:400] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:07.586897  2468 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:07.587699  2468 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.587994  2468 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:07.588843  2468 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.589985  2468 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.591194 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.591872 30560 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.595857 30402 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:07.597396  2373 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:07.597990  2373 consensus_queue.cc:1243] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:07.598937  2380 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:07.568764  1712 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:07.561528  2492 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.602358  2492 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.603287 30402 pending_rounds.cc:85] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:11:07.603633 30402 pending_rounds.cc:107] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:07.603870 30402 raft_consensus.cc:2889] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.586580  2443 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:11:07.567752  2462 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:07.567492  2299 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:07.595857 30554 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:07.569432  2422 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:11:07.598826 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:07.616426  2282 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:07.616950  2282 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:07.617822  2282 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.619619 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.623958  2465 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.624356  2204 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.627517 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:07.628283 30554 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:07.628374 31118 leader_election.cc:400] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9.
I20260709 13:11:07.628677 31118 leader_election.cc:403] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:11:07.629294 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56788.9us
W20260709 13:11:07.629398 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 139021us
I20260709 13:11:07.647795 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:07.598306  2160 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:07.638517 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 77823.7us
I20260709 13:11:07.662994 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:07.664011 30411 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:07.663817 30560 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:07.666967 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.662712 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:07.570072  2159 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:07.636888  2382 raft_consensus.cc:697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:07.703025 30559 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:07.708976 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:07.709640  2443 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.710060  2083 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:07.714871 30554 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:07.637284  2346 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:07.696684  2204 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:07.716171 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68476.2us
I20260709 13:11:07.719282 30560 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:07.646780  2371 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:11:07.721393 30479 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:11:07.723876 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 61264.6us
I20260709 13:11:07.726785 30374 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:07.729982 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.730350 30411 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:07.731237 30554 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:07.710469  2373 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.736011 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:07.728747  2122 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:07.726991  1743 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.723425  2468 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.745347 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.751978 30410 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:07.746086 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.746492 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:07.752584 30408 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.747177  2130 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:07.747975  2043 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:07.743916  2444 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:07.749509  1743 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.722172  2083 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.759984  2487 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:07.760327  2382 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.736862  2489 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:07.722957  2443 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.727866  2402 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:07.734385  2497 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:07.773758 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.801787 30409 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:07.774505  2462 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:07.810928  2462 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.811368  2462 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:07.813194  2443 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.815056  2402 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.779843 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.818773 30410 raft_consensus.cc:2368] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10.
I20260709 13:11:07.819820 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.769487  2469 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:07.783326 30408 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:07.750967  2380 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.771010 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:07.738147  2373 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:07.795276  2502 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:07.792155  2159 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:07.804500 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:07.898593 30479 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.792855  2489 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.809556  2367 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:07.828774 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 58549.2us
I20260709 13:11:07.829741 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:07.830225 30409 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:07.831022 30560 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:07.901151 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.875949 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:07.907472 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.907209 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:07.910586 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:07.912864 30554 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:11:07.915045 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:07.917411 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:07.917472 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 87868.2us
I20260709 13:11:07.922516 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:07.771019  2456 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:11:07.926079 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:07.842506  2043 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9.
I20260709 13:11:07.935667 30559 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:07.828708  2380 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:07.938361 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:07.937201 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.011610 30483 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:08.013836 30411 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:11:07.899106  2402 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.997821 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:07.998718 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.017457 30409 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:08.024087 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:07.896602  2160 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:07.906248  2489 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.935266  2179 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.000893  2469 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:07.917102  2130 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:07.930109 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.005844  2399 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.936872  2492 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:08.026386 31151 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:11:08.026907 30555 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:11:08.025524 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 99565.5us
I20260709 13:11:08.038287 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.090775 30560 raft_consensus.cc:2410] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:08.042421 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:08.092015 30486 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:08.058128 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.058404 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.096894 30551 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:08.059634 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:08.098814 30559 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 7.
I20260709 13:11:08.052096 30558 raft_consensus.cc:2410] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:11:08.076104 30408 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:11:08.066471 30554 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:08.058846 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:08.121765 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:08.123952 30551 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:08.162438 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:08.163249 30553 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:08.169907 30559 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:08.045523  2197 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:08.053505  2469 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:08.191208 30560 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:11:08.194923 30560 pending_rounds.cc:85] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:11:08.195278 30560 pending_rounds.cc:107] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:11:08.195592 30560 raft_consensus.cc:2889] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.127605  2160 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:08.203441 30555 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:08.061008  2179 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:08.215055 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 129078us
I20260709 13:11:08.104434  2130 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:08.201078  2455 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:08.200251  2469 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.224141 30551 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
W20260709 13:11:08.223842 30402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.014s
I20260709 13:11:08.135576  2497 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:11:08.243886 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:08.123015  2399 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.235069 30486 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:08.212877 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 179026us
W20260709 13:11:08.242408 30402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.006s	sys 0.015s
I20260709 13:11:08.203267  2197 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:08.172658  2492 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.036890  2456 consensus_queue.cc:1243] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:08.171581  2444 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:11:08.254228  2501 log.cc:927] Time spent T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
I20260709 13:11:08.247212  2465 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.265347  2515 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:11:08.265472  2293 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:08.272109 30480 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:08.277024  1599 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.279119 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 156928us
I20260709 13:11:08.286727  2503 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:08.207736  2160 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.172921  2380 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.260897 30553 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:08.322273  1599 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.404536  2160 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.405182  1599 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:08.406028  2510 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:11:08.377270  2399 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.379050  2505 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:08.407214  2505 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:08.407853  2509 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:11:08.409374  2511 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:11:08.409518  2505 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.385712 30404 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:08.048008  2402 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:08.399190  2462 consensus_meta.cc:287] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:11:08.365144  2496 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:08.373714  2373 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.370606  2233 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:08.414322  1743 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.499432 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:08.501960  2520 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:08.479167  2456 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.503202  2516 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:11:08.503510  2456 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:08.504779  2513 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:11:08.505796  2456 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.443302  2503 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.508661  2503 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.441833  2462 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.510393  2179 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.442390  2465 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.510923  2462 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.511654 30410 raft_consensus.cc:2368] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12.
I20260709 13:11:08.512459  2465 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.514782  2402 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.472260  2233 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.516042  2529 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:08.516952 30479 consensus_meta.cc:287] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:11:08.516637  2529 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.517234  2233 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.519065  2529 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.519683 30479 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:08.554069 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:08.555886 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 197731us
I20260709 13:11:08.477458  2489 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.477033  2197 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.574334  2198 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.536551  2529 raft_consensus.cc:476] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:11:08.563458  2487 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.556317  2465 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.555639  2319 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.594782 30481 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:08.596622 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.603931 30477 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:08.604365 31148 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:08.597220 30410 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:08.604911 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:08.596678 30524 leader_election.cc:400] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10.
I20260709 13:11:08.599759 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.600374 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:08.606550 30486 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:08.596361 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.606923 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.607173 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.605448 30477 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.600080 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.605453 30524 leader_election.cc:403] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.619768 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.621161 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.622622 30484 raft_consensus.cc:2410] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:08.614487 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:08.707433 30486 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:11:08.724901 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 110480us
I20260709 13:11:08.725807 30524 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:08.726761 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:08.586881  2489 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.728603 30524 leader_election.cc:400] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12.
I20260709 13:11:08.597347  2198 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.580773  2130 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.732657 30524 leader_election.cc:403] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.734230 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.596019  2480 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:08.742815 30481 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:08.738109  2233 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.595216  2179 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:11:08.732479  1743 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:08.752034 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 259102us
I20260709 13:11:08.737637  1712 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:08.591156  2487 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.618391  2319 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.594313  2465 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.594024  2469 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.725829  2538 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10.
I20260709 13:11:08.742234  2198 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.739135  2537 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:11:08.778218 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 457594us
W20260709 13:11:08.778322  2530 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:11:08.785637  2233 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.780818  1712 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:08.787441  2198 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.788204  2319 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.789851 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.798826  2491 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:08.800586  2130 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.807767 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2316) took 1015 ms. Trace:
I20260709 13:11:08.779775  2480 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:11:08.810312 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.810890 30478 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:08.814461  2130 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.817236  2233 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.819329  2491 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:08.819782  2491 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:08.820199  2233 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.820745  2491 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.825353 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2313) took 1059 ms. Trace:
I20260709 13:11:08.825603 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.827575 30480 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:08.808357 30409 rpcz_store.cc:276] 0709 13:11:07.792310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.040806 (+248496us) service_pool.cc:224] Handling call
0709 13:11:08.083451 (+ 42645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.293132 (+209681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.293180 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.415497 (+122317us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.606831 (+191334us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:08.606864 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.606928 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.807481 (+200553us) raft_consensus.cc:1685] finished
0709 13:11:08.807527 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.807692 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12191,"raft.queue_time_us":81184,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13994,"thread_start_us":338044,"threads_started":2,"wal-append.queue_time_us":321947}
I20260709 13:11:08.822345  2491 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.826454 30411 rpcz_store.cc:276] 0709 13:11:07.765809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.034802 (+268993us) service_pool.cc:224] Handling call
0709 13:11:08.035230 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:08.105321 (+ 70091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.105352 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:08.166088 (+ 60736us) log.cc:844] Serialized 52 byte log entry
0709 13:11:08.339612 (+173524us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:08.385896 (+ 46284us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.824331 (+438435us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800304660. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:11:08.824749 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.824948 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.825024 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.825140 (+   116us) raft_consensus.cc:1685] finished
0709 13:11:08.825155 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.825294 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48806,"prepare.queue_time_us":52656,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1435,"raft.queue_time_us":515607,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":31118,"spinlock_wait_cycles":43251584,"thread_start_us":127879,"threads_started":1,"wal-append.queue_time_us":303963}
I20260709 13:11:08.844712  2130 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.836093  2319 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.845666  2319 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.846545  2489 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.847090  2489 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.848917  2489 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.848976  1961 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.849548  1961 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.851548  1961 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:08.851760  2346 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:08.852276  2346 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.834319  2538 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:08.854099 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:08.829562  2293 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:08.853130 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:08.887063 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2317) took 1092 ms. Trace:
I20260709 13:11:08.894994 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 583) took 1017 ms. Trace:
I20260709 13:11:08.897154 30484 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:08.864375  2319 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.898253 31149 rpcz_store.cc:276] 0709 13:11:07.877709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.906061 (+ 28352us) service_pool.cc:224] Handling call
0709 13:11:07.996740 (+ 90679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.996970 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:08.255687 (+258717us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.578087 (+322400us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18002024e0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:08.738584 (+160497us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.868029 (+129445us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.894523 (+ 26494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:08.894591 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:08.894644 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.894733 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.894931 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76134,"prepare.queue_time_us":429444,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":121,"raft.queue_time_us":145369,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":213,"spinlock_wait_cycles":14489728,"thread_start_us":778820,"threads_started":4,"wal-append.queue_time_us":330371}
I20260709 13:11:08.899056 30408 rpcz_store.cc:276] 0709 13:11:07.795115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.162185 (+367070us) service_pool.cc:224] Handling call
0709 13:11:08.162508 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.167109 (+  4601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.167141 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.177127 (+  9986us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.411225 (+234098us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:08.610089 (+198864us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.886236 (+276147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.886344 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.886782 (+   438us) raft_consensus.cc:1685] finished
0709 13:11:08.886802 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.886974 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271792,"prepare.queue_time_us":68918,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":319929,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":24832,"thread_start_us":331925,"threads_started":2,"wal-append.queue_time_us":369315}
I20260709 13:11:08.898913  2382 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:08.922415 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 142865us
I20260709 13:11:08.923629 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:08.905025  2542 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:08.926594 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:08.928261 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 199777us
I20260709 13:11:08.939996 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 784) took 1720 ms. Trace:
I20260709 13:11:08.940419 30404 rpcz_store.cc:276] 0709 13:11:07.219986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.290887 (+ 70901us) service_pool.cc:224] Handling call
0709 13:11:07.305568 (+ 14681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.410101 (+1104533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.939775 (+529674us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002f5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:08.939942 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479698816}
I20260709 13:11:08.941140 30477 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:08.964457 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:08.967574 30525 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:08.972939 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:08.973730 31149 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:08.938868  2382 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:08.942355  2469 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:08.943424  2487 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.906807  1712 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.905882  2538 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:08.979950 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:08.989034  2551 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:11:08.989805  2546 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:08.990141 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:08.966989  2465 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:08.975343  2512 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:09.009375 31146 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:09.014907 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2011) took 1791 ms. Trace:
I20260709 13:11:08.988276  2422 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.941915  2555 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:11:09.015493 30407 rpcz_store.cc:276] 0709 13:11:07.223399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.304628 (+ 81229us) service_pool.cc:224] Handling call
0709 13:11:07.318363 (+ 13735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.488053 (+169690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.488084 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.493253 (+  5169us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.567208 (+ 73955us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:07.567259 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.000055 (+1432796us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400122854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:09.000135 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.000196 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:09.000218 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.014814 (+ 14596us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23958,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":56,"spinlock_wait_cycles":330700544,"thread_start_us":62213,"threads_started":1,"wal-append.queue_time_us":144157,"wal-append.run_cpu_time_us":1982,"wal-append.run_wall_time_us":1096720}
W20260709 13:11:09.030544 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63748.9us
I20260709 13:11:09.027797  2505 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:09.039036  2505 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:09.039368  2552 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:09.039455  2505 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:09.031455  2512 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:08.935696  2542 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:08.969192  2293 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.053113  2542 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.049389 30374 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.043557  2512 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.089524 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.090175 30482 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:11:09.091503 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 124056us
I20260709 13:11:09.092643 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.093524 30482 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:09.087949  2495 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:09.093989  2542 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.097158  1961 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.123296  2562 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:09.136269 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:09.137385 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:09.100637  2233 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:09.085767  2382 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:09.152204  2561 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:09.138671  2542 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.154856  2542 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.105161  2495 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:09.155970  2495 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.157883  2480 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12.
I20260709 13:11:09.140156  2422 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.159320  2422 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.159699  2422 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.160396  2492 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.162112  2083 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:09.162616  2510 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:09.105173  2465 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:09.149325  2560 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:09.174336 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.174968 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.175359 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:09.182898 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.168143  2555 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.169868  2537 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.189471 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.233423 30551 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:09.170957  2204 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.139093  1961 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.234750 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.247378 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:09.248018 30552 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.247871 30557 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:09.245154 31144 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:09.255384 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:09.261505 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.262636 30554 raft_consensus.cc:2393] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:09.269461 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.269783 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:09.247110  2560 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:09.274362 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.221803  2173 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:09.233434  2526 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.180541  2465 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:09.260995  2524 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:09.251495  2346 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.184751  2233 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.246456  2542 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.257771  2380 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:09.315418 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.317188 30479 raft_consensus.cc:2410] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:09.232853  2537 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.325244 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:09.325392 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 55675.5us
I20260709 13:11:09.258047  2204 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.282939  2469 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:09.331249 30560 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:09.326639 30479 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:09.327036 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.329651 31149 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:09.332887 30552 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:09.334116  2204 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.282637  2503 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.336561  2503 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.319739  2179 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.325455  2537 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.340807 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.293273  2526 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:09.343544  2563 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:11:09.343840  2539 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:09.344376  2465 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:09.344744  2566 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:11:09.366874  2539 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.326678  2505 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.339854  2204 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.374020  2503 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.289615  2173 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.338310  2574 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.319026  2542 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.379487  2576 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:09.386628 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.280301  2555 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.393541 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.338765  2469 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.405346 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.420040 30484 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:09.366874  2572 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.405865  2505 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.434769 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:09.437019  1961 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.351567  2179 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.447490  2469 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.448153  2469 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:09.448539  2469 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.450481 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.406250  2204 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.438031  2576 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:09.450621  2469 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.425488  2422 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.555512 30560 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:09.556334 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.556893  2422 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.494014 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.557255 30556 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:11:09.557739 30556 pending_rounds.cc:85] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 6
I20260709 13:11:09.558008 30556 pending_rounds.cc:107] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:11:09.558204 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.553761 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.559455 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.560472 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.561684 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.562223 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:09.562486 31151 raft_consensus.cc:2410] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:11:09.575819 31148 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.502960  2157 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.492640  2583 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.419641  2574 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.433773  2572 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.509352  2539 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.512882  2295 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:09.513335  2538 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.514760  2496 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:09.515662  2179 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.519891 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.520658 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.521430 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.533437 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2295) took 1979 ms. Trace:
I20260709 13:11:09.673182 30483 rpcz_store.cc:276] 0709 13:11:07.553817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.553949 (+   132us) service_pool.cc:224] Handling call
0709 13:11:07.573855 (+ 19906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.020680 (+446825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.533132 (+1512452us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540017c0d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:09.533338 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991333248}
I20260709 13:11:09.534399 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.548408  2173 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.551836  2576 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:09.668303 30376 connection.cc:256] RPC call timeout handler was delayed by -1.5007602460002545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:11:09.553669  2506 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:09.554400 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.554826 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.681876 30557 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:09.681979 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.558297 30556 raft_consensus.cc:2889] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.496043  2577 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:09.499213  2579 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:09.500876  2542 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.575059 31149 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:09.562760 30554 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.565768 30552 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.674029  2496 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:09.444164  2555 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.524501 30410 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:09.694432 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.563701 30559 raft_consensus.cc:2368] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15.
I20260709 13:11:09.582219 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.695669 30560 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:09.576375  2204 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.584380 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.668596  2583 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.586506 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.704993 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.705394  2583 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.666950  2157 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.706079 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.587778 30409 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:09.707518 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.708240  2157 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:09.708600 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.709636 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:09.591243  2567 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.337s	user 0.000s	sys 0.003s
I20260709 13:11:09.688628  2577 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.592494 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.711910 30558 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:09.712750 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.593196 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.714112 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.714347  2572 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.714715 30404 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:09.690846  2465 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.715556 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.715342  2465 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.685022  2422 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.716621 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.717163 30404 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:09.717023  2422 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.717993 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.593855 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.491789  2233 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.594748 30408 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:09.595681 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.601020 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:09.602357 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43256 (request call id 578) took 1004 ms. Trace:
I20260709 13:11:09.606467  2469 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.577841 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:09.607821 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.616351  2537 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.623504 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:09.729058 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 105619us
I20260709 13:11:09.625867  2218 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:09.626499  2299 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:09.626602 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.627766 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.640640  2443 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:09.645972  1743 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.647655 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 320690us
I20260709 13:11:09.659878 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 790) took 1863 ms. Trace:
I20260709 13:11:09.669250 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.678967 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:09.739239 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131502us
I20260709 13:11:09.554102 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:09.738812 30403 rpcz_store.cc:276] 0709 13:11:07.796603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.362339 (+565736us) service_pool.cc:224] Handling call
0709 13:11:08.379545 (+ 17206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.403422 (+ 23877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.403466 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:08.403524 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:08.403565 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.659645 (+1256080us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5400209c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:09.659691 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.659817 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54346112}
I20260709 13:11:09.734385 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:09.681442 30376 connection.cc:256] RPC call timeout handler was delayed by -1.3963602460000857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:11:09.683022 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.686713 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.743026 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.743765 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.738974 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.744570 30551 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:09.745349 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.745476 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.524508  2367 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.712824  2577 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.699904 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.700479 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:09.753366 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:09.755414 30376 connection.cc:256] RPC call timeout handler was delayed by -1.267660246000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:11:09.718515 30404 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:09.725371 30405 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:09.757807 30376 connection.cc:256] RPC call timeout handler was delayed by -1.030960246000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:11:09.721175 30402 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:09.722126 30478 rpcz_store.cc:276] 0709 13:11:08.597943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.606946 (+  9003us) service_pool.cc:224] Handling call
0709 13:11:09.602148 (+995202us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001c5a54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:09.602274 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466992384}
I20260709 13:11:09.730401 30481 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:09.727008 30480 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:09.746387 30551 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:09.737859 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.743831 30407 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:09.743923 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.674321  2295 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.753202 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.710611 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.759100 30405 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:09.762491 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.770524 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.777091 30555 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:09.770792 30556 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:09.771170 30559 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:09.725802  2542 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:09.783278 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.785596 30554 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:09.786224  1599 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:09.786991  1599 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.787683  1599 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.782662 30477 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:09.777956 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:09.798434 30553 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:09.800359 30553 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:09.809185 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:09.817113 31147 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.815563 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.804800 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.738529  2443 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:09.819566 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:09.749599  2554 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:09.735646  2328 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:09.822551 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 44664.5us
I20260709 13:11:09.826612 31152 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:09.827802 30555 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:09.757808  2512 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.779716  2572 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:09.746857  2565 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:09.756049  2538 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:09.852114 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:09.774407  2382 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.782791  2539 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.781598  2503 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:09.832304  2512 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.818768  2399 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:09.869639  2399 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.870095  2399 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:09.870764  2539 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.871199  2539 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.833483  2367 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:09.871644  2367 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.747764  2299 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.855370 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:09.816720  2480 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.791952  2130 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:09.758049  2588 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.859699 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.864481 31147 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:09.883154 30451 leader_election.cc:400] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15.
I20260709 13:11:09.861948  2233 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:09.862121  2572 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:09.862259  2319 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:11:09.874063 30402 raft_consensus.cc:2410] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:11:09.755744  1743 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:09.829175  2554 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.883469 30403 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
W20260709 13:11:09.879142 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.842723  2526 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:09.862788  2453 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:11:09.849792  2159 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.845927  2328 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:09.833329  2157 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:11:09.874871  2367 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:09.806318  2542 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.916949 30558 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 10: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:09.885313  2588 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.916954 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.888481  2554 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:09.894333 30411 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:09.901746 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:09.883796  1599 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.892035 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.900851  2147 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:09.974269 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.883061  2537 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.006783 30559 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:10.013654 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:10.014261 30559 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:09.972656 30404 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:09.846107  2565 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.887490  2130 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:10.009841 30297 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.489s	user 0.006s	sys 0.011s
I20260709 13:11:09.862860  2538 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.027786 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:10.033670  1599 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.076076 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:10.077006 30553 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:10.081875 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:09.918156  2574 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:09.873644  2382 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.088982 30482 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:10.090569 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.144130 30407 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:09.890146  2480 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.094169 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:09.974396  2588 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.006043  2147 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.189031 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:10.080466  2130 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:09.972297  2572 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:09.915201  2159 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.212030 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:10.212285 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 458994us
I20260709 13:11:10.212785 30551 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:09.894129  2443 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.215695 30407 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:10.090214  2533 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.205416  2147 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:10.287210 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 435135us
I20260709 13:11:10.313956 30407 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:10.316948 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.238189  2574 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.240787  1743 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.297034  2577 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.313791  2443 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:10.299803  2469 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.328910  2380 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.246882  2533 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.365301 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.366513 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:10.367214  2592 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:11:10.368467  2159 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:10.368834  2595 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:11:10.371343  2480 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.343135  2577 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.373673  2577 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.243044  2328 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.376153  2533 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.333076  2319 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:11:10.376153  2382 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.383299  2542 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.367235 30406 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:10.332652  2574 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.387421  2574 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.388739 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.389572 30406 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.299746  2295 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.322247 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:10.376345  2299 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.374461  2512 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.376617  2538 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:10.400573 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 78451.5us
I20260709 13:11:10.330487 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.405107  2577 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.406868  2577 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:10.407413  2496 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 13:11:10.407884  2496 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.408905 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.409215  2577 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.409904  2496 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.410082 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.413810 30408 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:10.361310 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 458938us
I20260709 13:11:10.416785 30409 raft_consensus.cc:2410] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:11:10.415474 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 85094.8us
I20260709 13:11:10.419090 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.419394 30406 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:10.410408  2577 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.421424 30411 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:10.405252  2159 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:10.425446  2538 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.405527 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.432426 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.427294  2371 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:10.481854 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 76441.9us
W20260709 13:11:10.483150 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50844.3us
I20260709 13:11:10.484414 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:10.461126 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.485592 31117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.017s	sys 0.018s
W20260709 13:11:10.486886 31117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.017s	sys 0.018s
W20260709 13:11:10.487764 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 596559us
W20260709 13:11:10.428640  2399 consensus_meta.cc:287] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.005s
I20260709 13:11:10.489043 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.542905  2399 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:10.543442 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 54486.1us
I20260709 13:11:10.544283 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:10.544554  2367 consensus_meta.cc:287] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.571s	user 0.000s	sys 0.008s
I20260709 13:11:10.545039  2367 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.545825 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.545648  2130 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.441493  2159 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.496820 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:10.495697 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.547137 30411 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:10.547741 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52133us
I20260709 13:11:10.509945  2319 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.490487  2299 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.522331  2441 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:10.524956  2147 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.480777  2371 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:10.482445  2577 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.429453  2197 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.482501 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:10.441367  2380 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.559532  2043 raft_consensus.cc:2764] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:11:10.560529 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 78092.7us
I20260709 13:11:10.490798  2542 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.548946 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.563257 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.441787  2295 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:10.564375 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.564615  2295 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.565114  2602 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.565338  2577 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.565869  2602 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:10.566884  2602 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:10.549810 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 53065.9us
I20260709 13:11:10.550726 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.557925  2399 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.556454  2496 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.558506  2197 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.437650  2574 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.583572 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:10.583657 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:10.587747 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.588867 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:10.591092 30477 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:10.549094  2159 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:10.551819  2526 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:10.570746 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:10.591850 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.551988  2600 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.594961 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.555691  2538 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.552489  2605 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.598730 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.602181 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.563261  2371 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.605407  2371 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:10.553176  2554 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.571800  2295 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.599537  2380 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:10.607870  2380 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.608242  2380 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.608299  2554 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:10.593619  2539 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.000s
I20260709 13:11:10.553021  2588 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.590482  2299 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.599490  2382 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.583010  2542 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:11:10.595942  2577 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:10.618868  2295 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:10.621622 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.617626  2147 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.627576 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:10.615589 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.636435 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.600950  2583 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:10.646164 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.648553 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.649660 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.615597  2346 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.594175  2574 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.620942  2538 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:10.673138 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 57619.8us
I20260709 13:11:10.617651  2130 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.675410 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.679428 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:10.680199 30477 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:10.690318  2505 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:10.664685  2526 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.674896  2598 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:10.704655  2346 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:10.664270  2367 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.664505  2600 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.615916  2539 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.664382  2399 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.624825  2496 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:11:10.667665  2609 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.672477  2495 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.716728 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:10.673907  2299 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:10.711540 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.671641  2583 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.724858 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.642350  2577 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.735899 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.737272 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.738857 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.701757  2542 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:10.742534 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76535.1us
I20260709 13:11:10.699813  2572 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.768159 30409 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:10.753842 31152 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:10.624675  2382 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:10.762203 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.711975  2443 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.753849  2609 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:10.775884  2197 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.767431  2422 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.767527  2584 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:10.776463  2572 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.724597  2130 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:10.782626 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 13:11:10.596316 30297 maintenance_manager.cc:643] P 47740a6b78644dffa37c97c591d3d3e7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.230s	user 0.156s	sys 0.084s Metrics: {"bytes_written":30794,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":102481,"dirs.run_cpu_time_us":545,"dirs.run_wall_time_us":109003,"drs_written":1,"lbm_read_time_us":9812,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":205808,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":299562,"threads_started":2,"update_count":30,"wal-append.queue_time_us":360688}
I20260709 13:11:10.797082 30404 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:10.786924 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 190007us
I20260709 13:11:10.759025  2573 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:10.762183  2346 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:10.795470  2382 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.801551 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.803020 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.803481 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:10.839740 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2022) took 1036 ms. Trace:
I20260709 13:11:10.804843 30409 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:10.831858 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.893707 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.816850 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.783526  2609 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:10.892954 30405 rpcz_store.cc:276] 0709 13:11:09.803635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.821701 (+ 18066us) service_pool.cc:224] Handling call
0709 13:11:09.821989 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.323785 (+501796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.323819 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.329001 (+  5182us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.562546 (+233545us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b48000030d8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:11:10.671414 (+108868us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:10.671469 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.671553 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.839392 (+167839us) raft_consensus.cc:1685] finished
0709 13:11:10.839411 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.839675 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28040,"raft.run_cpu_time_us":9650,"raft.run_wall_time_us":703843,"spinlock_wait_cycles":35048192,"thread_start_us":790775,"threads_started":2,"wal-append.queue_time_us":438677}
W20260709 13:11:10.892970 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90095.1us
I20260709 13:11:10.828053  2620 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.846108  2539 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.854254  2583 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.898200  2620 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.900847  2465 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.901113  2620 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:10.902280 30411 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:10.856276 30298 maintenance_manager.cc:419] P 47740a6b78644dffa37c97c591d3d3e7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7799 bytes on disk
W20260709 13:11:10.924515 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.837850 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:10.940896 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.941511 30405 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.812821 31152 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:10.941905 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:10.912359 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.942734 31147 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 6.
W20260709 13:11:10.938095 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 134762us
W20260709 13:11:10.943683 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 105916us
I20260709 13:11:10.826210  2577 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.902601  2295 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.833588  2572 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.940809  2585 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.846932  2346 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:10.960444  2585 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:10.824601  2574 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:10.946307  2367 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:10.963379  2367 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.966423 31152 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:10.970644 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.942746  2583 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.973268  2583 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.949368  2465 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.945956  2382 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:10.943070  2533 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.978389  2533 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.982790 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:10.983623 31144 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:10.983806 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.984925 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.985795 31149 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:11:10.986470 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2021) took 1227 ms. Trace:
I20260709 13:11:10.986975 30402 rpcz_store.cc:276] 0709 13:11:09.759058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.759472 (+   414us) service_pool.cc:224] Handling call
0709 13:11:10.986209 (+1226737us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b540012a2d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:10.986374 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127917312}
I20260709 13:11:10.988363 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:10.981813 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:10.995419 30406 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:11.002785 31118 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.030s (SENT) [suppressed 4 similar messages]
W20260709 13:11:11.007789  2589 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 1.125s	user 0.008s	sys 0.003s
I20260709 13:11:10.939225  2506 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:11.023859 30405 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:11.029142  2539 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:11.029683  2539 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.030857  2627 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.031365  2627 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.031836  2179 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:11.032397  2179 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.033502  2627 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.034312  2179 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.039461 30406 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:11.045727  2565 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.047374  2585 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.047740  2539 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:11.048298  2597 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.704s	user 0.002s	sys 0.000s
I20260709 13:11:11.053431  2602 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:11.053869  2602 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:11.055481 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.056686 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.061463  2399 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:11.061931  2399 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:11.066246  2591 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 1.147s	user 0.000s	sys 0.001s
I20260709 13:11:11.075719 30525 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:11.076931 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:11.076982 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:11.085191 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:10.948287 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:10.909984  2503 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.951910 30297 maintenance_manager.cc:643] P 47740a6b78644dffa37c97c591d3d3e7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":330,"lbm_reads_lt_1ms":4}
I20260709 13:11:10.952561  2598 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:10.814327  2496 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:11:10.895813  2629 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.805612  2299 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:11:10.895627  2197 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:10.945870  2526 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.956028 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:10.959471  2572 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:10.835234  2588 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:10.983438 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.089870  2503 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.099160  2179 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:11.131147  2179 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:11.132062  2179 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.132651  2503 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.789692  2443 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.135033  2495 raft_consensus.cc:2764] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:10.801357  2130 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.091236 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.139011 30481 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.093626 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.140183 30482 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:11:11.095539 30478 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:11.098835 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.142271 30486 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:11.092164 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.101752 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.107277 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:11.110742 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:10.849188  2380 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.106132 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:10.798776  2584 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:11.151829 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59785.8us
I20260709 13:11:11.087817  2319 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.904238  2159 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.115000 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:11.115948 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 159979us
I20260709 13:11:11.115978 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.117293 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.087121 30409 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:11.117935  2197 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.100620  2371 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:11.088884  2602 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.099664  2565 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.805935  2573 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:10.739869 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.158540 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:11.180917 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.147596 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:11.166267 30552 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:11.185273  1599 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.188659 31146 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:11.188902 30481 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:11.190953 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.191552 31147 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:11.193778 30411 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:11.194860 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.195442 31148 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:11:11.164208  2295 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.157943  2554 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:11.201344 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.202605 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.213796 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.204165 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.214426 30406 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:11.213269 30409 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:11.214845 30403 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.139251  2503 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.191742 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:11.217387 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 273686us
I20260709 13:11:11.218161 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.168880  2319 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:11.221442 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.189383  2496 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:11.209930 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:11.168015  2565 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.242647 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.243024 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.206810 30479 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:11.168478  2371 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:11.203835 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.215293 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.248036 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.189530  2629 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:11:11.248869 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.215341 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.248606 30557 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:11.251472 30409 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:11.254964 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.255981 30408 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.257143 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.258339 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.252240 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.181675  2609 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.225790 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.266377 30402 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:11.267109 30551 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:11.217214  1599 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:11.267876  1599 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:11.228891 30559 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:11:11.216953 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.268323 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.232424 31146 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:11.269522 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.269701 30403 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:11.270042 30403 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:11.270495 30557 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:11.270750 30403 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.271878 30403 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.268708  1599 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.236480 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.110913  2399 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.224710  2295 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:11.276656  2523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.002s	sys 0.018s
I20260709 13:11:11.212663  2554 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:11.277776  2523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.002s	sys 0.018s
I20260709 13:11:11.194362  2538 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:11.265017 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.279011 30405 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.214502  2443 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.278091  2554 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.277832  2295 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:11.239794 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 237071us
W20260709 13:11:11.268282 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 83639.2us
I20260709 13:11:11.285765 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.288869 30403 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:11.290503 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.293835 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.218084 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:11.299540 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 81526.7us
I20260709 13:11:11.209722 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:11.300429 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:11.250473  2565 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:11.233078  2496 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:11.219144  1961 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:11:11.315136 30404 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.316289 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:11.337594 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:11.319867 30552 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:11.320156 30554 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:11.209134  2422 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:11:11.251710  2371 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.216513  2382 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 13:11:11.312455 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 102803us
I20260709 13:11:11.356456 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:11.348526 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.323266  2503 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:11.315570  2443 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:11.325412  2588 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:11.329373  2496 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.346998  2585 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:11.347185  2574 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.381278 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.355402  2367 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.367074  2512 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:11.362251  2503 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.383708  2295 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:11.398133  2631 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:11.399506 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.403441  2573 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.409512  2584 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.367594  2443 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:11.457108  2443 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:11.457926  2610 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.733s	user 0.000s	sys 0.002s
I20260709 13:11:11.376470  2588 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:11.458786  2588 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:11.428596  2632 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:11.461361 30560 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:11.425678  2503 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.430226  2609 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.366786  2626 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:11:11.433080  2319 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:11.434437 30374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.016s	sys 0.020s
W20260709 13:11:11.479090 30374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.017s	sys 0.021s
I20260709 13:11:11.383637  2585 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:11.424522  2295 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.481226  2295 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:11.479449 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 1.26312e+06us
I20260709 13:11:11.483379 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.484591 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.411362  2512 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.486915  2512 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.488649  1961 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.489343  1961 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.439252  2574 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.491393  2574 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.493177  2583 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.493599  2574 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:11.453262 30556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 757) took 1798 ms (client timeout 2030 ms). Trace:
I20260709 13:11:11.477420 30559 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:11.479921 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.494359  2585 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:11.499590  2636 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:11:11.502941  2382 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.502851  2465 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:11.505162  2539 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:11.494817 30556 rpcz_store.cc:269] 0709 13:11:09.644094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.691082 (+ 46988us) service_pool.cc:224] Handling call
0709 13:11:11.441813 (+1750731us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b5400070dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:11.441983 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13692800}
I20260709 13:11:11.507458  1961 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:11.508074  1961 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.510258  1961 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.512352  2621 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:11.518503 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.534303 30477 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:11.534997  2130 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.537065 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:11.543381 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44940.6us
W20260709 13:11:11.544166 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 229682us
I20260709 13:11:11.548470 30477 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:11.550475 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.551478 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.552209 30486 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:11.556978 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.558125  1599 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:11.576887 31151 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:11:11.542608  2526 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:11.521276  2380 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:11.580255 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 239490us
I20260709 13:11:11.580708 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.584939 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:11.586898 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.584815 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:11.547166  2495 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:11.588457 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.589073 30486 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.591884 30557 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:11.587788 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.588393 30558 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:11.593413  1599 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:11.588285  2159 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.591665 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:11.597496 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 304966us
I20260709 13:11:11.599951  1599 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:11.606225 30486 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:11.596261  2583 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:11.607996  2656 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:11.609807  2130 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:11.610750  2539 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:11.601536  2204 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.612735 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.613415 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.614100 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.615411  2632 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.616907 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:11.590319  2380 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.629807  2554 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.632513  2503 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.632851 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.635388 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.638945 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.646106  1599 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.650023 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.612435 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:11.660811 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.602660  2577 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:11.665300 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:11.768986 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 103777us
I20260709 13:11:11.667933 30560 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:11.764266 30486 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:11.771327 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.771777 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.772346 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.772779 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.773343 30486 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:11.773375 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.774016 30560 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:11.678299 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.586202  2526 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.682653 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.777180 30483 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:11.688001 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.690949 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.747205 30405 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.679694  1961 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:11:11.684697  2204 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.692584  2632 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.749788  2602 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.749904  2443 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.679003  2656 consensus_queue.cc:1243] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:11.644650  2574 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:11.600961  2495 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.752385  2503 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.752388 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.754016 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:11.754841 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 156140us
I20260709 13:11:11.755486  2620 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:11.760821  2399 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:11.761389 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86776.7us
I20260709 13:11:11.689904  2505 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:11:11.698302 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.821933  2526 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.637128  2583 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:11.824836  2583 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.824460  2588 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.826109 30484 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:11.828325 30484 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:11.767061 30482 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:11.829191 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.815826 30480 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:11.832623 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.833292 30409 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.799101  2130 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:11.840368 30485 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:11.843483 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.843976  2506 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:11.842496 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.844550  2506 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.846973 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:11.847848  2632 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.848378  2495 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.849262  2506 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.774202 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.778280 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.854385 30486 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:11.780781 30560 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:11.787762  2512 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.643718  2585 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.794166 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.805594  2584 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:11:11.795291 30557 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:11.859709  2512 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.661428  2371 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.813046  2574 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.861941  2371 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.862110  2574 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.863593  2496 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.865804  2496 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:11.678957  2539 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.866992  2443 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.868673  2539 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.869426 31148 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.870113  2204 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.810986  2554 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.811417  2299 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:11.770422 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:11.874929 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 104565us
I20260709 13:11:11.875854 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:11.666043  2295 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.857127 30409 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:11.854321 30483 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:11.859494 30481 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:11.879707  2159 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.880271  2159 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:11.880326  2295 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.881213 31152 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:11.878281  2512 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:11.881110  2159 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.885093 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.885707  2585 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.804571  2533 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:11.889026 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.889593 30483 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.890529 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.891424 30411 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:11.892082 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:11.894446 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 277623us
I20260709 13:11:11.898630 31147 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:11.898885 31148 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:11.900339  1743 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:11.900817  1743 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.895182 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:11.908409 30485 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:11.908965 30485 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:11.919157 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.915206 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:11.921821  1743 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:11.909937 30485 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.928241 30485 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:11.928632 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.929473 30560 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:11.929590 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.930573 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:11.905098  2588 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:11.936214  2565 consensus_meta.cc:287] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.014s
I20260709 13:11:11.937722  2583 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:11.924296  2130 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:11.945317 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.951730 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:11.951977 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.952569 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.953332 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.953833 30409 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:11.954388 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:11.945948 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.946492 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.947665 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.956012 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:11.958171 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:11.959533 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:11.960863 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.969619 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.975615 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:11.990626 30485 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:11:11.991281 30485 pending_rounds.cc:85] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 10
I20260709 13:11:11.991581 30485 pending_rounds.cc:107] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:11:11.991882 30485 raft_consensus.cc:2889] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.992779 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.933456  2319 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:11:11.995497 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.995927 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:11.974328  2495 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:11.999519 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:11.998438 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 135589us
I20260709 13:11:11.943089  2539 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:11.971282  2598 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.001504 30559 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:12.007401 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:12.009506 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:12.015506 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.953203  2565 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:11.979161  2577 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:11.977185  2503 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:11:12.030869 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.025115 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.004134  2495 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.039896 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.048475 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.000834  2505 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:12.056566 30555 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:12.053014 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:12.064181 30450 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.065672 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:12.072355  2577 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.076985  2656 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:12.059547  2632 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:11:12.066066 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:12.066574  2572 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:12.080752  2572 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:12.081115  2572 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.081430  2572 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:12.084920  2651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:11:12.085393  2651 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:12.085753  2651 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:12.067250 30553 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:12.067255  2443 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.088120 30374 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:12.089251 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.051169  2495 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.051853  2130 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.099757 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:12.093267 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:12.103539 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:12.106096 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:12.107558 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:12.095155 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.098065 30483 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:12.056913  2588 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:12.060017  2662 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.090485  2367 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.131273  2367 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.131666  2367 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:12.141803 30308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 197) took 23938 ms (client timeout 15000 ms). Trace:
I20260709 13:11:12.144055 30305 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:12.146307 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:12.118454  2533 raft_consensus.cc:2764] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:12.148952  2539 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.152686  2565 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:12.153788  2583 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.158186  2192 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:12.158607  2192 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:12.159436  2192 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.160233  2197 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.160939  2192 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.163998  2299 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:12.164601  2299 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.114722  2293 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.167881  2159 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:12.108824  2496 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:11:12.169605  2496 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:12.169952  2496 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:12.170650  2496 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.171576  2496 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:12.167258  2293 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.086608  2651 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.179754  2651 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.182308 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:12.183825 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:12.090247  2380 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:12.185842  2380 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.101190  2399 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.101362  2422 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:12.187680 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:12.116914 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:12.118266 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 108292us
I20260709 13:11:12.187883  2399 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:12.188438 31148 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.188695 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.189481 30485 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:12.191088  2600 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.191694  2600 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:12.187958  2422 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:12.192328  2422 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.194849  2503 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:12.195545  2503 consensus_queue.cc:1243] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:12.195978  2503 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:12.196282  2503 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:12.197033  2503 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.122293 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.118554  2588 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:12.199839 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.201993 31148 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:12.204730 30557 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
W20260709 13:11:12.204895 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 82711.2us
I20260709 13:11:12.188525  2399 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.198101  2503 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:12.208264 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:12.121008 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.228318 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:12.213649 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.228966 30481 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:12.229369  2627 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.233449 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.234297  2542 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.222278 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.237388 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:12.237773 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116845us
I20260709 13:11:12.240221 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.241444 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.243983 30479 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:12.238780 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:12.242517 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:12.205812  2588 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:12.250571 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.179756  2293 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.227522  2204 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.245565 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.218235  2380 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:12.241667 30305 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 8 to 7, leader changed from <none> to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 7 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:12.226861  2465 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:12.269796 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.253852 31118 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.254366 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:12.272271  2626 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:12.272663  2626 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:12.273083  2626 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:12.272871  2179 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:12.142202 30308 rpcz_store.cc:269] 0709 13:10:48.202969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.216519 (+ 13550us) service_pool.cc:224] Handling call
0709 13:11:12.141562 (+23925043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:03.701466 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:03.964938 (+263472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:04.023769 (+ 58831us) write_op.cc:435] Acquired schema lock
0709 13:11:04.033108 (+  9339us) tablet.cc:662] Decoding operations
0709 13:11:04.355180 (+322072us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:04.355263 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:04.355291 (+    28us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:11:04.402086 (+ 46795us) tablet.cc:701] Row locks acquired
0709 13:11:04.431186 (+ 29100us) write_op.cc:260] PREPARE: finished
0709 13:11:04.446170 (+ 14984us) write_op.cc:270] Start()
0709 13:11:04.474318 (+ 28148us) write_op.cc:276] Timestamp: P: 1783602664438386 usec, L: 0
0709 13:11:04.474347 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:11:04.487756 (+ 13409us) log.cc:844] Serialized 11778 byte log entry
0709 13:11:05.462373 (+974617us) op_driver.cc:464] REPLICATION: finished
0709 13:11:05.475782 (+ 13409us) write_op.cc:301] APPLY: starting
0709 13:11:05.475877 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:05.478043 (+  2166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:05.478125 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:05.909726 (+431601us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:06.065675 (+155949us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=60
0709 13:11:06.065745 (+    70us) write_op.cc:312] APPLY: finished
0709 13:11:06.097089 (+ 31344us) log.cc:844] Serialized 200 byte log entry
0709 13:11:06.097406 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.102939 (+  5533us) write_op.cc:454] Released schema lock
0709 13:11:06.103032 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:06.103622 (+   590us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.103649 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2427346,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":11850,"apply.run_cpu_time_us":15164,"apply.run_wall_time_us":627769,"num_ops":30,"prepare.queue_time_us":161575,"prepare.run_cpu_time_us":51390,"prepare.run_wall_time_us":981523,"raft.queue_time_us":556507,"raft.run_cpu_time_us":8822,"raft.run_wall_time_us":28741,"replication_time_us":981942,"thread_start_us":640602,"threads_started":4,"wal-append.queue_time_us":200334,"wal-append.run_cpu_time_us":151954,"wal-append.run_wall_time_us":2419756}]]}
I20260709 13:11:12.236276  2600 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:12.282416  2626 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.282617 30305 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:12.284494  2626 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:12.284696 30305 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 8, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.286653 30305 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 8, leader changed from <none> to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:12.293576 30305 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.297348 30305 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:12.305181 30305 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:11:12.314920 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.243291  2598 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.317324 30553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 1981) took 1200 ms. Trace:
I20260709 13:11:12.317765 30553 rpcz_store.cc:276] 0709 13:11:11.116905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.117041 (+   136us) service_pool.cc:224] Handling call
0709 13:11:12.317151 (+1200110us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54003f2d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:12.317265 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071082752}
I20260709 13:11:12.319537 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2183) took 1059 ms. Trace:
I20260709 13:11:12.319944 30555 rpcz_store.cc:276] 0709 13:11:11.260520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.394463 (+133943us) service_pool.cc:224] Handling call
0709 13:11:11.410441 (+ 15978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.087175 (+676734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.319281 (+232106us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400309dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:12.319468 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480556928}
I20260709 13:11:12.313728 30305 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.325505 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.247614  2599 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.321105  2572 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.260509  2465 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.359122 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.360018 30406 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:12.365372 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.366176 30406 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:12.348933 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.257928  2371 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:12.380861 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 309394us
I20260709 13:11:12.394162 30411 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:12.395715 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:12.400940 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47234.5us
I20260709 13:11:12.403290 30404 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:12.406911 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.343567  2526 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:12.402243  2621 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:12.422619 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.344022  2465 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:12.344152  2598 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.424556  2665 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:12.425812 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.452173 30406 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:12.343832  2542 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:12.453460 30402 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:12.453366  2542 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:12.429508 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.456722 30404 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:12.429874 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.339550  2605 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:11:12.432631 30403 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
W20260709 13:11:12.457955 30585 heartbeater.cc:646] Failed to heartbeat to 127.28.152.62:45705 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.152.62:45705 timed out after 15.000s (SENT)
I20260709 13:11:12.458209 30403 pending_rounds.cc:85] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 9
I20260709 13:11:12.458539 30403 pending_rounds.cc:107] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:11:12.436275 30409 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:12.452215  2665 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:12.459324  2665 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:12.458909 30403 raft_consensus.cc:2889] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.459895  2299 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.460212  2665 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.461651  2665 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.392452  2584 consensus_queue.cc:1059] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:12.440332 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.463420  2584 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:12.463887  2584 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:12.464915 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.415087  2675 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:12.442749  2197 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.340889  2218 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:11:12.439363 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.465155  2480 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:12.458353  2605 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:12.444955 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.286859  2495 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.472105  1599 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:12.462360  2299 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.480602  1599 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:12.483783 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:12.488859  1599 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.492079 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.508592 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.512981 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.473193  2675 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:12.518167 31151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.036s
W20260709 13:11:12.519316 31151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.037s
I20260709 13:11:12.497515 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.477313  2480 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:12.479882  2204 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:12.524638 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 283255us
I20260709 13:11:12.480288  2605 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:12.505275  2197 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:12.503640  2496 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.466780  2367 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.507542  2651 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:12.520570  2609 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:12.477042  2422 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.521057  2506 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:12.553669 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 310993us
I20260709 13:11:12.554560 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.530077 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.531317  1599 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.517737  2656 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:12.464952  2584 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.511478  2632 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.527495 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.503383  2441 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:12.454562  2542 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.528283 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.544292  2572 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.527266  2480 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:12.523618  2574 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:12.551323  2598 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:12.538589  2496 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.520772  2533 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.540836  2651 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:12.475725  2565 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:12.592450  2495 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.593493  2651 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:12.561766 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 289891us
I20260709 13:11:12.565371  1743 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:12.568845 30450 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.574939 30559 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:12.532472  2197 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:12.581429 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:12.596783 30554 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.585201 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:12.587592  1599 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:12.590169  2584 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.535738  2130 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:11:12.554031  2554 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.608199  2496 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.585048  2598 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:12.609375  2598 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.600636  2197 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:12.610868  2598 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:12.612506  2609 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:12.613029  2609 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.614871  2572 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:12.617924 30554 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:12.620972  2554 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.622385  2675 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.624333  2197 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.633332  2656 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.600965 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.635917 30408 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.601495 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:12.638777 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.575452  2512 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.576710  2602 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:12.644629 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116415us
I20260709 13:11:12.648257 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.654896  2679 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.659001  2399 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.660272 30411 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:12.661204  2399 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.662384  2130 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.579648  2678 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.666792 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.672920 30408 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:12.682426 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:12.680092  2554 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:12.676913  2588 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.674849 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:12.715950 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 77441us
I20260709 13:11:12.580313  2538 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:11:12.708994 30481 raft_consensus.cc:2368] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14.
I20260709 13:11:12.676539  2686 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.709110 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:12.710966 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52169us
I20260709 13:11:12.711753 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:12.716379 30480 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:12.718580 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:12.667660  2572 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:12.727231 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:12.727583 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47691.7us
I20260709 13:11:12.730978  2130 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.731714  2685 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:12.715636  2526 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:12.737320 30478 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:12.717365  2632 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.725862  2665 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:12.734166  2583 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.597199  2605 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.732941  2319 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:12.732846  2480 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.813875 30477 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:12.815747 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:12.816841 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:12.817711 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:12.736145  2526 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.826967 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:12.783768  2665 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:12.832214  2665 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.771023  2685 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:12.839849  2693 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.840453  2693 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:12.843299 30485 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 13:11:12.844679  2687 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:11:12.856261 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.862483  2293 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:12.870167  2600 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.870400  2480 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:12.870906  2600 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.874549  2600 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.878087  2651 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.880659  2651 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.889680  2422 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:12.808210  2299 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.830685  2605 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.893038 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:12.898219 30411 raft_consensus.cc:606] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:12.874289  2465 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.885259  2693 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:12.909806  2495 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.911031 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 193871us
W20260709 13:11:12.907827 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 180704us
I20260709 13:11:12.914950 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.915664 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.916186 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.916888 30405 raft_consensus.cc:2368] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:12.918475 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.922047 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:12.925457 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.927335 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.929037 30405 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:12.931706 30558 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:12.933380 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.936939 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.937676 30410 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 9: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:12.937808 30450 leader_election.cc:400] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
I20260709 13:11:12.941042 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.941250 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:12.942796 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:12.900342  2299 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:12.975642 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:12.982952 30407 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:12.910490  2495 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:13.036163 30359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64603.6us
I20260709 13:11:13.036361 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.037142 30410 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.039166 30483 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:13.048691 30410 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:13.048485  2626 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:11:13.052947  2676 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
I20260709 13:11:13.056831  2688 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.057250  2465 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.057380  2537 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.058144  1599 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:13.129338  1599 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.067101  2627 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.070335 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.071040 30406 raft_consensus.cc:1240] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:12.967200  2588 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.073349  2480 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:13.083913 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 171937us
I20260709 13:11:13.085173  2538 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:12.972314  2702 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.105809  2299 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:13.106426 30404 raft_consensus.cc:2376] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16. Re-sending same reply.
I20260709 13:11:13.109849 30411 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
W20260709 13:11:13.116293 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.128046 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.071281 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.135388 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.135998 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.028285  2599 raft_consensus.cc:3055] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:13.144821 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:13.125556  2688 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.135439 31151 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:13.168992 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:13.158176  2584 consensus_meta.cc:287] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.005s
I20260709 13:11:13.197031 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:13.175386  1599 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.202488 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:13.203997 30450 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:13.206049 30410 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:13.179325 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 108128us
I20260709 13:11:13.182303 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.209093 30407 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.194190 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:13.154258 30403 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:13.207269 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.232277 30553 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:13.232465 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.233599 31146 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:13.235915 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:13.239478 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.240095 30555 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:13.163724  2599 raft_consensus.cc:740] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:13.259613 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2357) took 1372 ms. Trace:
I20260709 13:11:13.315716 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 614) took 1104 ms. Trace:
I20260709 13:11:13.316170 30478 rpcz_store.cc:276] 0709 13:11:12.211524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.211693 (+   169us) service_pool.cc:224] Handling call
0709 13:11:12.212050 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.737731 (+525681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.315419 (+577688us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54001bf3d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:13.315651 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207592832}
I20260709 13:11:13.137418  2537 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.319670  2537 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.179061  2692 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:13.199774  2554 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.321329 30407 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:13.225579 30376 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:13.144793  2627 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.323868  2627 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.222499  2702 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.155740  2480 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.326998  2480 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.270803 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 773) took 1119 ms. Trace:
I20260709 13:11:13.329382  2293 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:13.329991  2293 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:13.268605  2706 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.331466 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.259320  2584 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:11:13.332921  2702 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:13.333403  2702 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:13.334368  2702 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.335866  2702 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.347936 30552 raft_consensus.cc:1240] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:13.352932 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.314724 30486 rpcz_store.cc:276] 0709 13:11:11.886982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.889963 (+  2981us) service_pool.cc:224] Handling call
0709 13:11:11.890247 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.903345 (+ 13098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.903373 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.911193 (+  7820us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.375346 (+464153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:12.375400 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.375490 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.052275 (+676785us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:13.222182 (+169907us) raft_consensus.cc:1685] finished
0709 13:11:13.222212 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.259539 (+ 37327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2810,"raft.queue_time_us":13342,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8576,"spinlock_wait_cycles":18627968,"thread_start_us":432354,"threads_started":1,"wal-append.queue_time_us":561013}
I20260709 13:11:13.230732 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:13.287667  2526 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:13.305496 30405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:13.357640 30405 raft_consensus.cc:606] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.358012 30405 raft_consensus.cc:614] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:13.358918 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:13.359755 30407 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:13.321187  2554 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.232090  2588 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.327803 30560 rpcz_store.cc:276] 0709 13:11:12.145621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.149384 (+  3763us) service_pool.cc:224] Handling call
0709 13:11:12.149720 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.189999 (+ 40279us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:12.190275 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.531448 (+341173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.531516 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:12.531576 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.264568 (+732992us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540039fb54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:13.264620 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.264724 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":655,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":22972,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5410,"spinlock_wait_cycles":92131584,"thread_start_us":340829,"threads_started":1,"wal-append.queue_time_us":436497}
W20260709 13:11:13.274051  2609 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
W20260709 13:11:13.355219 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 129730us
I20260709 13:11:13.355489 30557 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:11:13.356161 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 125633us
I20260709 13:11:13.356278  2574 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:13.361172 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:13.365079 30555 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:13.367539 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:13.370196 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:13.375566 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:13.379151 30553 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:13.361614  2495 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.361732  2399 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:13.383315 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:13.386106  2710 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:11:13.386953  2703 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:11:13.389978  2705 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:11:13.399152  2690 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:11:13.377084  2574 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:13.423055  2574 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.400987  2688 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.361742  2692 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:13.402740 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:13.469048 31152 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:13.374254  2700 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.406404  2588 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.473287 30525 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:13.421713  2673 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:13.462184 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 173037us
W20260709 13:11:13.402637  2691 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:11:13.414381 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46939us
I20260709 13:11:13.413434  2422 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:13.491421 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 125356us
I20260709 13:11:13.460439  2480 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:13.502509 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:13.374811  2609 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.469844  2399 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:13.510061 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.484592  2685 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.526289 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:13.526623 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:13.486471  2542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.039s	sys 0.039s
I20260709 13:11:13.527038 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.532595 30551 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:13.425385  2702 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.528510 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:13.555433 30557 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.540279 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:13.540843 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:13.542222 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:13.544812  2712 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:11:13.544618  2526 consensus_queue.cc:1059] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:13.545218  2422 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:13.495647  2688 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.503777  2706 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:11:13.562315  2422 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.563412  2706 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:13.563761  2706 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:13.564412  2512 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.564575  2706 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.547443  2600 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.521293  2584 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:13.567022  2584 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.568682  2656 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.503790  2679 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.569583  2679 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.570152  2656 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:13.570539  2656 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:13.570879  2697 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:13.571872  2679 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:13.572091  2697 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:13.572476  2697 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:13.566460  2600 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:13.573156  2600 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.573268  2697 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.575048 30405 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:13.575803 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.576865 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.578090  2598 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.578172  2496 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:13.571460  2656 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:13.549449  2722 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:13.550921  1743 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.579747  1743 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.562312  2688 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.582382  2688 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.550523  2554 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:13.551378  2542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.048s	sys 0.039s
I20260709 13:11:13.551299  2692 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.560006 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:13.587589 31152 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:13.569911  2584 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.578881  2598 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.579268  2399 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.558405 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.592650 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.593261 30486 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:13.557127 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:13.588934 30482 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:13.579146  2656 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.586067 30481 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:13.492116  2673 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:13.495905  2371 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:11:13.602193 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.609508 30486 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:13.586741  2605 consensus_meta.cc:287] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
W20260709 13:11:13.592414  2707 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260709 13:11:13.609438 30481 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:13.489571  2700 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.537659  2480 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.603751 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.491516  2588 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.603147 30557 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
W20260709 13:11:13.603106  2708 log.cc:927] Time spent T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.279s	user 0.003s	sys 0.000s
W20260709 13:11:13.627786 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.630021 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:13.602447  2714 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:13.625520 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:13.625845 30478 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:13.594067  2554 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:13.618364 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:13.620359 30402 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:13.639607 30402 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:13.633796 30483 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:13.636085 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:13.646311 30523 leader_election.cc:400] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14.
I20260709 13:11:13.646763 30523 leader_election.cc:403] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.649223 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:13.583228  2685 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.625823  2480 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.628217  2697 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:13.627275  2512 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:13.656414 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.627498  2642 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:13.626942  2496 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:13.653277  2539 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:13.662231 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84430.8us
I20260709 13:11:13.668043 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.692673 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:13.650964  2554 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.656608  2371 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.658766  2526 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:13.696206 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:13.700206  1599 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:13.702827  1599 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:13.703392  1599 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:13.698591  1743 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:13.704692 30557 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:13.643222  2565 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:13.649912  2686 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:13.685885  2542 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:13.694139  2537 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:13.695588  2538 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:13.666306  2679 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:11:13.705672  2371 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.666505  2572 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:11:13.706303  2526 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.698756  2496 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.686425  2512 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.693617  2642 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.664357  2673 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.704584  2539 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.733028  1743 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.813568 30559 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:13.817173  2723 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:11:13.817484  2727 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:13.817776  2496 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:13.813638 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 160593us
I20260709 13:11:13.818239  2554 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:13.858773  2686 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:13.860809  2733 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:13.861583  2642 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:13.862476  2726 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:11:13.865360  2293 consensus_meta.cc:287] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.000s
I20260709 13:11:13.865818  2293 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.869338  2752 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:13.869899  2752 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.871347  2588 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:13.858922  2730 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:11:13.763273  2526 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.754220  2715 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14.
I20260709 13:11:13.758315  2197 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:13.871932  2752 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:13.749464  2371 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:13.747092  2538 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:13.886444 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 174934us
W20260709 13:11:13.889925 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 193816us
I20260709 13:11:13.975421 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2065) took 1060 ms. Trace:
I20260709 13:11:13.975868 30403 rpcz_store.cc:276] 0709 13:11:12.915224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.915358 (+   134us) service_pool.cc:224] Handling call
0709 13:11:13.975250 (+1059892us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002869d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:13.975364 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454608640}
I20260709 13:11:13.731859  1599 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:13.991119 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:14.062352 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.912024  2539 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:14.066615 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 81056.8us
W20260709 13:11:14.067683 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76698.7us
I20260709 13:11:14.073535 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.079713 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.081048 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.081897 30483 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:14.084903 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:13.888747  2744 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:11:14.075910 30484 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:14.089962  1599 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.094318 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.107493 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.109118 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.109833 30552 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:13.930817  2700 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:14.117565  2751 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:14.128328 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 158997us
I20260709 13:11:14.118618  2748 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:14.091689  2584 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:14.129846 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 429741us
I20260709 13:11:14.111467  2588 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:14.141852 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:14.145874  2715 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.147038  2755 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.147578  2755 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.150174  2755 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:14.153229  2599 consensus_queue.cc:260] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.069794  2685 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:14.131752  2729 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:14.159878 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.196960 30405 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:14.197695 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b473589cd94be59022580022e2de00"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:14.201185 30403 raft_consensus.cc:606] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:14.201602 30403 raft_consensus.cc:614] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.204030  2731 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.204567  2731 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.211838  2731 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.212359  2731 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.212832  2731 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.216900  2731 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.219022 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.219904 30484 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:14.220808  2577 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.221040  2538 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:14.221434  2577 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:14.224390  2600 consensus_meta.cc:287] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:11:14.224916  2600 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.225765  2749 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:14.226244  2749 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:14.165685  2599 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:14.226977 30407 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:14.231879 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.232422 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.234383  2495 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.236207  2495 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.238335  2495 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.235144 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.235615  2751 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.239548  2751 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.242148  2751 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.172233  2692 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:14.167858  2588 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:14.245692 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:14.196584  2688 consensus_meta.cc:287] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.006s
I20260709 13:11:14.158119  2700 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:11:14.157085  2584 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.223861  2577 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.265967 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.266923 30406 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:14.283569 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.270046 31152 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:14.228561  2512 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.277060 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.278291 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.280347 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.287957 30486 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:14.288102 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:14.288981 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.296152  1743 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.296727  1743 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.298116 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.298923 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.300232 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.300912 30482 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:14.261809  2495 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:14.262146  2692 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:14.264901  2293 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.269337  2538 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.307374 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2397) took 1710 ms. Trace:
W20260709 13:11:14.287868  2740 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:11:14.271936  2197 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.313549 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:14.316821  1743 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:14.308954 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 107438us
I20260709 13:11:14.317862 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:14.313197 30409 rpcz_store.cc:276] 0709 13:11:12.596947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.597071 (+   124us) service_pool.cc:224] Handling call
0709 13:11:12.601380 (+  4309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:12.680544 (+ 79164us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:12.687202 (+  6658us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.049574 (+362372us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800390580. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:11:13.270956 (+221382us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:14.088983 (+818027us) spinlock_profiling.cc:243] Waited 878 us on lock 0x7b2c000014c8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:11:14.089671 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 13:11:14.089857 (+   186us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:14.089903 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.089990 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.307112 (+217122us) raft_consensus.cc:1685] finished
0709 13:11:14.307139 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.307308 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78755,"prepare.queue_time_us":6529,"prepare.run_cpu_time_us":4365,"prepare.run_wall_time_us":31501,"raft.queue_time_us":79757,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14464,"spinlock_wait_cycles":15841920,"thread_start_us":221015,"threads_started":1,"wal-append.queue_time_us":740933}
I20260709 13:11:14.302865  2554 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.313493  2692 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:14.324995  2598 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:14.338169 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 2369) took 1523 ms. Trace:
I20260709 13:11:14.282735  2688 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:14.325776  2697 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.001s
W20260709 13:11:14.344112  2750 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:14.344275  2600 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.345500  2371 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.356076  2598 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.366413  2598 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.367650  2371 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.320184  2538 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.368132  2688 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.369103 30555 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:14.369982  2538 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.311393  2577 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:14.370576  2577 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:14.371013  2577 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:14.311575  2495 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.376258  2495 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.376928  2767 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:14.377380  2767 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:14.377749  2767 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.384562  2585 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:14.384443  2526 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.385017  2585 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:14.385835  2585 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.385867  2692 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.351967 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.340770 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43936 (request call id 597) took 2030 ms. Trace:
I20260709 13:11:14.352896 30477 rpcz_store.cc:276] 0709 13:11:12.814313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.826663 (+ 12350us) service_pool.cc:224] Handling call
0709 13:11:14.337906 (+1511243us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54003d7a54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:14.338074 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543526272}
W20260709 13:11:14.341724  2737 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:14.403482 30553 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.403483 31149 rpcz_store.cc:276] 0709 13:11:12.310154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.310329 (+   175us) service_pool.cc:224] Handling call
0709 13:11:12.310729 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.323422 (+ 12693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.323459 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.323992 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.748355 (+424363us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:12.748394 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.340321 (+1591927us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54003d9d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:14.340374 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.340429 (+    55us) raft_consensus.cc:1685] finished
0709 13:11:14.340445 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.340675 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15848,"raft.queue_time_us":6011,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3200,"spinlock_wait_cycles":28297472,"thread_start_us":423982,"threads_started":1,"wal-append.queue_time_us":582590}
I20260709 13:11:14.356882 30481 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:14.359261 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45860.4us
I20260709 13:11:14.364408 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.410301 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.411890 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.413050 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.393779 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.417676 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.419308 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.425079 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:14.425168 30553 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:14.425607 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.425967 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.426483 31147 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:14.297688  2749 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.429121 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:14.388139  2761 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:14.429406 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.428841 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.437119 30557 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:14.438086 30553 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.432564 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:14.430160 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.432404 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:14.427094  2656 consensus_meta.cc:287] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.004s
I20260709 13:11:14.392189  2382 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.406236  2679 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:14.386672  2526 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.438196 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.438315 30557 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:14.495894 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.496418 30483 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:14.496929 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:14.389267  2692 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:14.473291 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:14.495556 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:14.445254  2665 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:14.474589 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.399713  2584 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.470391 30553 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.428221  2585 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:14.356690  2554 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.483420 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:14.481771  2382 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.484915 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.471285  2574 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.428078  2538 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:11:14.493841 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:14.495553 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.498082 31150 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:14.360589  2367 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.498402 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:14.515836 31149 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:14.499169 30554 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:14.500597  2665 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.518571 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.503840  2465 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:14.508958 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.495720  2749 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:14.501565  2480 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 13:11:14.497841  2715 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.405781  2588 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.481341  2679 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.512768  2526 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.524623 30483 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:14.524698 31147 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:14.528944 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2197) took 2311 ms. Trace:
I20260709 13:11:14.529693 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:14.516886 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:14.531641 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.514285  2538 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:14.529436 30558 rpcz_store.cc:276] 0709 13:11:12.211312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.211444 (+   132us) service_pool.cc:224] Handling call
0709 13:11:12.211740 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.932176 (+720436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.522031 (+1589855us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400038ed4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:14.522234 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655219072}
I20260709 13:11:14.532135 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:14.514575  2506 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:14.540139 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.521703  2179 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:14.522732  2665 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:14.553965  2382 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.525908  2367 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.537292  2700 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:14.570137  2367 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:14.570467  2700 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:14.570672  2367 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:14.571856 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.571465  2700 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.572783  2367 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.573316  2367 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:14.573760  2367 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.574824  2609 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.523293  2574 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:14.575021  2697 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:14.575605  2574 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:14.537653  2728 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:14.576092  2574 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.576589  2728 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:14.576998  2728 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.577535  2584 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:14.578142  2574 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.522822  2465 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:14.526906  2480 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.579281  2465 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.580446  2465 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:14.580523  2480 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:14.581522 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.581175  2767 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.538329  2573 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:14.543358  2197 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.584357 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:14.559594  2656 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:14.584918 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.585309 30410 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:14.543040  2506 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.586206  2506 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.575970  2628 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:14.548228 30525 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:14.588310 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.590930 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:14.543666  2695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.004s	sys 0.044s
I20260709 13:11:14.567637  2679 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.568491  2554 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.582907 31152 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:14.594493 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:14.589807 30525 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:14.545059  2766 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:11:14.608230  2747 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.624200  2747 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.626257  2747 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:14.627836  2767 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:14.618600  2724 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:11:14.632123 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2011) took 1105 ms. Trace:
I20260709 13:11:14.632508 30559 rpcz_store.cc:276] 0709 13:11:13.526248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.528611 (+  2363us) service_pool.cc:224] Handling call
0709 13:11:13.528858 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.815839 (+286981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.631903 (+816064us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001e5fd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:14.632066 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654250880}
I20260709 13:11:14.633167  2598 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.633870 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2214) took 1075 ms. Trace:
I20260709 13:11:14.634222 30551 rpcz_store.cc:276] 0709 13:11:13.558817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.559000 (+   183us) service_pool.cc:224] Handling call
0709 13:11:13.559250 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.649287 (+ 90037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.649316 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.649353 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:13.649382 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.633673 (+984291us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b54003390d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:14.633714 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.633820 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206625024}
I20260709 13:11:14.620359 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.637039 30404 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:14.545302  2689 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:14.536989  2538 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:14.587059  2628 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:14.637079 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84582.5us
I20260709 13:11:14.583186  2574 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:14.612494 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.648010 30405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2086) took 1047 ms. Trace:
I20260709 13:11:14.600075 30406 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:14.651590 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.654943 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.646170 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.657106 31148 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 8.
I20260709 13:11:14.657437 30481 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:14.658319 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.648499 30405 rpcz_store.cc:276] 0709 13:11:13.600353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.601222 (+   869us) service_pool.cc:224] Handling call
0709 13:11:13.615345 (+ 14123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.232473 (+617128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.647764 (+415291us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002a67d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:14.647948 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287426304}
I20260709 13:11:14.656505 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.620661 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.669833 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.670498 30409 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:14.673625 30479 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:14.674631 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.677312 30480 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:14.595229  2695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.004s	sys 0.044s
I20260709 13:11:14.677446 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.678294 30409 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:14.679868 30477 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:14.680316 30481 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:14.712388 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.594494  2675 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.594602  2495 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.758488 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.608791  2599 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.760529 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:14.582273  2577 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.761339 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.775333 30408 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:14.764319 30479 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:14.594157  2688 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:14.767289 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:14.775866 30479 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:14.776340 31149 raft_consensus.cc:2410] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:14.760815 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:14.767758 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:14.769520 30481 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:14.771461 30482 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
W20260709 13:11:14.779649 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 206924us
I20260709 13:11:14.647260  2574 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:14.786525 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 246479us
I20260709 13:11:14.792889 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:14.783746 31116 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:14.797055 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 161006us
I20260709 13:11:14.776618 30479 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.797569 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:14.798048 30479 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:14.800859 30374 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:14.807842 30555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2213) took 1249 ms (client timeout 1643 ms). Trace:
I20260709 13:11:14.808074  1743 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:14.808333 30555 rpcz_store.cc:269] 0709 13:11:13.558071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.558191 (+   120us) service_pool.cc:224] Handling call
0709 13:11:14.807665 (+1249474us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54001d97d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:14.807792 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784020864}
I20260709 13:11:14.807701 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.860180 30482 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.756474  2689 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:14.867563 30482 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:14.770255  2731 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:14.773097  2686 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:14.786857  2319 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:14.897801 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 114145us
I20260709 13:11:14.807053  2197 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:11:14.892627 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:14.875665 30479 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:11:14.920977 30479 pending_rounds.cc:85] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 8
I20260709 13:11:14.921466 30479 pending_rounds.cc:107] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:11:14.921820 30479 raft_consensus.cc:2889] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.808590  2299 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.774921  2675 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.864979  1961 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:14.945685 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.876127 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.948753 30411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 834) took 1973 ms (client timeout 2141 ms). Trace:
W20260709 13:11:14.949839 30411 rpcz_store.cc:269] 0709 13:11:12.975246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.975387 (+   141us) service_pool.cc:224] Handling call
0709 13:11:14.948581 (+1973194us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002864d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:14.948696 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306979200}
I20260709 13:11:14.973424 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.909607  2192 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:14.975687  2192 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:14.975823  2599 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:14.976454  2599 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:14.976722  2192 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.927016  2197 consensus_queue.cc:1243] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:14.848621  2572 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:11:14.974334 30411 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:14.894140  2598 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.905568  2319 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.989310 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.000011 30402 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:14.893936  2759 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.910807  2503 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.001966 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.003470 30411 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 8: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:15.006044 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.007501 30407 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 8.
I20260709 13:11:14.787061  2495 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.008212 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.008843 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.010548 30555 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:14.978601  2599 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.019483 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:14.851323  2538 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:14.917102  2731 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.036680 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:15.030874 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 441100us
I20260709 13:11:15.005834  2319 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.033017 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:14.914049  2686 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.044262 30551 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:11:15.040966 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:15.045316 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:15.030030 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.007122  2782 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.050868 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:15.055182 30551 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:14.978876  2299 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:15.061795  2773 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:15.063750  2299 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.064390  2782 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.067438 31118 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:15.067848  2732 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:15.069865  2743 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:15.069996  2523 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:15.070317  2743 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.070782  2743 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.070533  2523 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:15.071844  2523 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.073293  2523 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:15.077301  2585 consensus_meta.cc:287] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.000s
I20260709 13:11:15.043071  2689 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.015763  2665 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:15.079110  2777 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:11:15.080530  2665 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.005155  2573 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:15.007081  2747 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:11:15.083256  2747 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.084125  2700 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:15.084658  2700 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.085408  2731 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.085906  2675 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.086486  2572 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.087057  2572 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.089111  2686 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.089323  2572 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.012521  2503 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.090351 30483 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:15.091252  2503 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.053917  2785 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.092121  2785 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.049151  2765 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.093088  2765 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.094218  2785 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.095520  2218 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:15.095898  2218 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:15.096647  2218 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.097579 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.097759  2218 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:15.098272 30408 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:15.033618  2599 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.104159  2599 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.106333  2599 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.083779  2747 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.100839 31150 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.102295 30408 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:15.108587 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.109617 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:15.111887 30408 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:15.103415 30411 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
W20260709 13:11:15.118659  2778 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:15.120318 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43920 (request call id 606) took 1034 ms. Trace:
I20260709 13:11:15.120764 31151 rpcz_store.cc:276] 0709 13:11:14.085651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.085785 (+   134us) service_pool.cc:224] Handling call
0709 13:11:14.112192 (+ 26407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.260847 (+148655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.260966 (+   119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.268598 (+  7632us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.763269 (+494671us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:14.763325 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.763413 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.120067 (+356654us) raft_consensus.cc:1685] finished
0709 13:11:15.120093 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.120252 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81391,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"thread_start_us":567900,"threads_started":2,"wal-append.queue_time_us":752104}
I20260709 13:11:15.066488  2782 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:15.143759 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 345795us
I20260709 13:11:15.086400  2197 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:15.159027 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49099.5us
I20260709 13:11:15.176807 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.177100 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:15.123595  2573 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.046576  2367 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:14.919837  2628 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.180338 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.141801  2159 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.145284  2728 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
W20260709 13:11:15.123896  2749 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
I20260709 13:11:15.101163  2577 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.122347  2743 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.214005  2706 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.215090  2495 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.183831  2503 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.211741 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:15.225252  2495 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.225755  2495 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.226255  2495 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.202178  2692 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:15.193472  2686 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.241688  2506 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:11:15.012902  2759 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.190186  2197 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.210240  2367 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.124763  2599 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.200088 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.244174  2692 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:15.284651 30407 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:15.212186  2728 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.244029  2765 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.208432  2159 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.272691  2367 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.245488  2503 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.247486  2686 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.302943 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.303303 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.303601 30551 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:15.304000 30558 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:15.304780 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.305699 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.305972 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:15.287097  2749 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.289682  2692 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.308148 30410 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:15.308467 30552 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:15.307399 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.248391  2506 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.287348  2697 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.309895  2512 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:15.354172  2787 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:11:15.300231  2465 consensus_meta.cc:287] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:11:15.282315  2599 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:15.345777 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.282437  2626 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:11:15.298583  2367 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.363170 30408 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:15.200680  2573 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:15.332001 30374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.010s
I20260709 13:11:15.291977  2675 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.372226 30551 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:15.307034  2792 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.374862 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2090) took 1141 ms. Trace:
W20260709 13:11:15.335743 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.405941 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.398164  2793 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:15.325217  2749 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.366822  2766 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:15.391304 30374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.010s
I20260709 13:11:15.383149  2512 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:15.394500 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 276760us
I20260709 13:11:15.379464  2747 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.383765  2159 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.399626 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.381134 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:15.401314 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.441998 30553 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:15.409912 31150 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:15.407881 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 232108us
I20260709 13:11:15.402979 30403 rpcz_store.cc:276] 0709 13:11:14.233718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.234907 (+  1189us) service_pool.cc:224] Handling call
0709 13:11:14.244533 (+  9626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.244769 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:14.503948 (+259179us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.374084 (+870136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.374493 (+   409us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:15.374555 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.374641 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.374797 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":425066,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":106958,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":10943,"thread_start_us":1128016,"threads_started":3,"wal-append.queue_time_us":550222}
I20260709 13:11:15.409379  1961 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.392233  2798 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.467423 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.468142 30410 raft_consensus.cc:2368] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:15.468185 30406 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:15.433940 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 633138us
I20260709 13:11:15.385754  2697 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.440212 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:15.449221 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.450239 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:15.456847 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.460601  2512 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.409560  2792 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.441337  2794 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:15.465400  2774 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.450s	user 0.000s	sys 0.001s
I20260709 13:11:15.433516  2766 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:15.467283  2798 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.474650 31117 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:15.474682 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.485591 30403 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:15.446262 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.486096 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:15.486413 30407 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:15.432173 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 157460us
I20260709 13:11:15.476377 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.409555  2675 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:15.471297 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90281.5us
I20260709 13:11:15.490760 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:15.518275 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:15.520618 30407 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:15.475821  2626 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:15.469882  2759 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.477867  2192 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:15.494872 30410 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:15.476218  2197 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.522532 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.523283 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:15.524474 30450 leader_election.cc:400] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:15.478204  2679 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:15.474952  2799 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:15.526094 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.522328 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:15.526556 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51956.5us
I20260709 13:11:15.489264  2539 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.480595  2794 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.528844  2506 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.540627  2588 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:15.541311  2495 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.542658  2789 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.544756 30411 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.544749 30450 leader_election.cc:403] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:15.490855  2371 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.546373 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.549057 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.521896  2512 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:15.518965  2503 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.521540  2783 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.556697 31146 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:15.548856  2799 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.523823  2755 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:15.542760  2480 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:15.526811  2728 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.566877 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.569240 30407 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:15.566983  2197 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:15.565798  2382 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:15.572912 30411 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:11:15.572968 30374 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.552754  2599 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.558594  2588 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.590910  2588 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:15.594048  2782 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.572011  2626 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.585525 30407 pending_rounds.cc:85] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:11:15.598156 30407 pending_rounds.cc:107] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:15.598507 30407 raft_consensus.cc:2889] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.549491 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.566176  2159 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:15.576689  2805 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:11:15.587631  2382 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:15.581280  2480 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:15.576882  2799 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.553838  2539 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.588574  2789 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.586925  2749 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.575688  2204 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.600095 30410 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:15.598835  2503 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.594831  2665 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.581542  2755 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.594327  2808 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:15.623435 30481 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:15.594597  2782 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.624881 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:15.573196  2686 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.575995  2573 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.584766 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:15.637187 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:15.624147  2626 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.639164 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:15.549232  2766 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:15.635010  2319 consensus_meta.cc:287] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.003s
I20260709 13:11:15.650220 30481 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:15.651841 30477 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:15.623366  2735 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:15.624470  2728 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:11:15.634284  2755 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.629429  2204 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.657873  2766 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.635505  2480 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.658020  2792 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.663008  2792 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.663468  2792 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.665446  2792 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.665948  2792 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:15.666275  2792 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:15.659519  2319 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.668800  2319 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.669534 30555 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:15.671329  2495 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.632702  2665 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.672662  2743 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.674757  2665 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:15.658404  2159 consensus_queue.cc:1175] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce312b0d7a1747c8898a748f8d76df81" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
I20260709 13:11:15.656663  2626 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.645619  2697 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.618270  2585 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.679435 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.671240  2735 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:15.685110 30411 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:15.682374 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:15.688452 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:15.689522 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:15.692674 30410 raft_consensus.cc:2393] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:15.657279  2675 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.696554 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:15.699555 30411 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:15.666607  2792 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:15.702486 30405 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:15.703120 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 109198us
I20260709 13:11:15.703655 30410 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:15.710378 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:15.711099 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:15.712335 30477 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:15.713364 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:15.714311 30478 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:15.693496  2735 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:15.695286  2573 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:15.700248  2665 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:15.729604 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 144914us
I20260709 13:11:15.698414  2584 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.732004 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:15.701926  2794 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.709024  2626 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:15.696713  2585 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.714902  2197 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:15.738621  2584 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.766202  2584 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:15.767354  2815 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:15.768149 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45361.5us
I20260709 13:11:15.760525  2728 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:15.724409  2588 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.730116  2665 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.763072  2782 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:15.782934  2573 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:15.793977 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:15.801676  2574 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.787878 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:15.773329  2159 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:15.771317  2735 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.799278  2626 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:15.787827  2827 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.773221  2743 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:15.808071  2585 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.825382  2588 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.771788  2798 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:15.838616 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:15.773125  2728 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.839650 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:15.782932  2665 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:15.852594  1599 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:16.122344  1599 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:15.873256 31146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45412 (request call id 400) took 1407 ms (client timeout 1532 ms). Trace:
W20260709 13:11:16.123103 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 329225us
I20260709 13:11:15.855125 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:15.930318 31150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 614) took 1285 ms (client timeout 1649 ms). Trace:
W20260709 13:11:16.124344 31150 rpcz_store.cc:269] 0709 13:11:14.645391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.645496 (+   105us) service_pool.cc:224] Handling call
0709 13:11:15.930088 (+1284592us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54005302d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:15.930246 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742791424}
I20260709 13:11:15.790596  2539 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:15.859193 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.123134 31146 rpcz_store.cc:269] 0709 13:11:14.424478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.424835 (+   357us) service_pool.cc:224] Handling call
0709 13:11:15.831229 (+1406394us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54005a2154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:15.831400 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208707328}
I20260709 13:11:15.920456 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:16.126370 31151 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:16.011333  2803 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.556s	user 0.003s	sys 0.000s
W20260709 13:11:16.010146  2800 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.483s	user 0.004s	sys 0.000s
W20260709 13:11:15.978262  2692 consensus_meta.cc:287] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.001s
W20260709 13:11:15.956301  2820 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:11:15.922559  2811 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.299s	user 0.000s	sys 0.003s
W20260709 13:11:15.989876  2367 consensus_meta.cc:287] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:11:16.024943  2700 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.007553  2465 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:15.960615  2783 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.793118  2319 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.337s
I20260709 13:11:15.906157  2706 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:15.960909  2204 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.124895  2159 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.136098  2574 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.166980  2692 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.131388  2724 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:15.929509  2538 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.851903  2673 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.132680  2792 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.136420  2735 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.888346  2799 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:15.924012  2755 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.170457  2465 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:16.129339  2743 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.179407  2791 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:16.195672  2692 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.195973  2792 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.176342  2706 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.184458  2724 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:16.191964  2791 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:16.196215  2799 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.193301  2728 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.202543  2791 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:16.258533 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.370211  2724 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:15.871464 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34032 (request call id 2396) took 1081 ms. Trace:
W20260709 13:11:16.132182 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 277109us
W20260709 13:11:16.263901 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.375640 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.374684 30482 rpcz_store.cc:276] 0709 13:11:14.790145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.792550 (+  2405us) service_pool.cc:224] Handling call
0709 13:11:15.871159 (+1078609us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54000c9754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:15.871348 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152752384}
I20260709 13:11:16.123984 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:16.271076 30452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.006s
I20260709 13:11:16.028456 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2444) took 2440 ms. Trace:
I20260709 13:11:16.170651  2367 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.342373 30552 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.349334  2755 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.349668  2159 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.351413  2688 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:16.387797 31151 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:16.391311  2688 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:16.392161  2675 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.351573 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2029) took 1047 ms. Trace:
W20260709 13:11:16.349720 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 561755us
I20260709 13:11:16.361826 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:16.364217  2465 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.365286 30551 raft_consensus.cc:1240] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:16.366056 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.368180  2706 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.134516  2573 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.404743 30556 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:16.404827 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:16.393047  2675 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.407004  2367 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.407265 30402 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
W20260709 13:11:16.389108 30452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.019s	sys 0.006s
I20260709 13:11:16.400050  2465 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:16.394052 30554 rpcz_store.cc:276] 0709 13:11:15.303571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.304456 (+   885us) service_pool.cc:224] Handling call
0709 13:11:15.304948 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.305275 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.305303 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.310146 (+  4843us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.515868 (+205722us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:15.515937 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.516049 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.921937 (+405888us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:16.291910 (+369973us) raft_consensus.cc:1685] finished
0709 13:11:16.339680 (+ 47770us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.351277 (+ 11597us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50057,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":5956992,"thread_start_us":142271,"threads_started":1,"wal-append.queue_time_us":206691}
I20260709 13:11:16.393021  2688 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:16.422959 30409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53732 (request call id 2426) took 1790 ms (client timeout 1737 ms). Trace:
W20260709 13:11:16.427721 30409 rpcz_store.cc:269] 0709 13:11:14.631294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.421018 (+1789724us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:16.421239 (+   221us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:16.428145  2319 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:16.428807  2319 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.422896  2755 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.429352  2319 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.429796  2755 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.438416  2801 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.443192 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.445783 30407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2102) took 1235 ms. Trace:
I20260709 13:11:16.442847  2159 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.456238  2735 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.460915  2735 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.439244  2801 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:16.460129 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.451915 30407 rpcz_store.cc:276] 0709 13:11:15.183451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.584232 (+400781us) service_pool.cc:224] Handling call
0709 13:11:15.584618 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:15.599351 (+ 14733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.599371 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:15.604806 (+  5435us) log.cc:844] Serialized 52 byte log entry
0709 13:11:15.740952 (+136146us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:15.741009 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.741119 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.401984 (+660865us) raft_consensus.cc:1685] finished
0709 13:11:16.403266 (+  1282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.418370 (+ 15104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4246,"raft.queue_time_us":5043,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8938,"thread_start_us":103047,"threads_started":1,"wal-append.queue_time_us":135144}
I20260709 13:11:16.433682 30485 rpcz_store.cc:276] 0709 13:11:13.587953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.588054 (+   101us) service_pool.cc:224] Handling call
0709 13:11:13.590476 (+  2422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.654656 (+ 64180us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:13.687518 (+ 32862us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.679599 (+992081us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18003cc100. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:15.392925 (+713326us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18003cc100. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:11:15.477776 (+ 84851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.477834 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:15.477876 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.026421 (+548545us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003cc100. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419
0709 13:11:16.028063 (+  1642us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b54003d7554. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:16.028125 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.028342 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33052,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":4142,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":28090,"spinlock_wait_cycles":189403392,"thread_start_us":80539,"threads_started":1,"wal-append.queue_time_us":1865257}
I20260709 13:11:16.456931  2159 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.471020 30552 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:11:16.481366 30410 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
W20260709 13:11:16.477694 31118 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.849s (SENT) [suppressed 9 similar messages]
I20260709 13:11:16.488834 30409 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.489282 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:16.490097 30411 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:16.493557 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2101) took 1318 ms. Trace:
I20260709 13:11:16.494154  2743 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:16.484592 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 313717us
I20260709 13:11:16.494043 30403 rpcz_store.cc:276] 0709 13:11:15.175402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.444963 (+269561us) service_pool.cc:224] Handling call
0709 13:11:16.493104 (+1048141us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54003ece54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.493357 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36525824}
W20260709 13:11:16.517089  2584 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.010s
I20260709 13:11:16.499573  2801 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.521364  2584 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.522984 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.528909  2755 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:16.533068  2831 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:16.538573 30405 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
W20260709 13:11:16.538823 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.539398 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.540544  2382 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.541112  2367 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:16.542217  2382 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:16.542148  2367 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:16.543301 30408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2104) took 1347 ms (client timeout 1713 ms). Trace:
W20260709 13:11:16.543716 30408 rpcz_store.cc:269] 0709 13:11:15.196171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.199658 (+  3487us) service_pool.cc:224] Handling call
0709 13:11:16.542871 (+1343213us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b5400122854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.543108 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204242176}
I20260709 13:11:16.536760  2584 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.544557  2367 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.545691 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.546595 30403 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:16.532038  2791 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.536743  2673 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.548153  2673 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.548790  2480 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.549116  2791 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.550513  2673 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:16.551541 30555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 800) took 1521 ms (client timeout 1849 ms). Trace:
I20260709 13:11:16.552315 30523 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:16.554138  2801 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:16.554585  2801 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:16.555059  2801 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.559062  2799 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.559880  2799 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.562306  2584 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.563063  2795 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.552049 30555 rpcz_store.cc:269] 0709 13:11:15.029561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.029730 (+   169us) service_pool.cc:224] Handling call
0709 13:11:16.551010 (+1521280us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540039fb54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.551359 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427207424}
I20260709 13:11:16.565402  2585 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:16.563894  2795 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.563102  2584 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.568044 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:16.566303  2798 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.545632  2573 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:16.545787 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 1.02658e+06us
W20260709 13:11:16.571110 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 147712us
I20260709 13:11:16.566684  2585 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.578094 30411 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:16.574556  2588 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:16.579926  2588 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:16.580621  2585 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.581161  2588 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.583158  2585 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.582540  2588 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:16.591902 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:16.598482  2367 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.599412  2367 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.602026  2755 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.602155 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:16.602823  2755 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:16.602906  2798 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.603440  2755 raft_consensus.cc:3060] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.604233  2706 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:16.604657  2706 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.605051  2706 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.605579  2798 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.606189  2798 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.603389 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:16.577414  2799 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.620373 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53876 (request call id 842) took 1985 ms. Trace:
I20260709 13:11:16.623339 30402 rpcz_store.cc:276] 0709 13:11:14.634474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.012786 (+378312us) service_pool.cc:224] Handling call
0709 13:11:16.614926 (+1602140us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540039a3d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.620315 (+  5389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3149920000}
I20260709 13:11:16.614616  1599 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.624631  2367 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.616803  2573 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.633297  2441 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:16.633873  2441 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:16.634999  2573 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.635354  2628 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.635062  2441 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.636270 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.637068 30482 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:11:16.641251  1599 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:16.651726 30559 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:16.653873  2819 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.575103  2688 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:11:16.651818 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 847) took 1978 ms. Trace:
I20260709 13:11:16.662909  2179 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.651660  2584 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.663079 30406 rpcz_store.cc:276] 0709 13:11:14.672864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.142640 (+469776us) service_pool.cc:224] Handling call
0709 13:11:15.143054 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.472678 (+329624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.651352 (+1178674us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400209c54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:16.651622 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747346176}
I20260709 13:11:16.591562  2743 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:11:16.659611  2735 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:16.691211 30559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 802) took 1647 ms (client timeout 1855 ms). Trace:
W20260709 13:11:16.691752 30559 rpcz_store.cc:269] 0709 13:11:15.044165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.045071 (+   906us) service_pool.cc:224] Handling call
0709 13:11:16.683781 (+1638710us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003f2354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.691136 (+  7355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3650302208}
I20260709 13:11:16.693286 30408 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:16.654537  2819 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:16.700134 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 132365us
I20260709 13:11:16.701997  2735 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.702696  2735 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.713547  2367 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.656190  2798 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.714381  2367 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.692027  2675 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.724241  2584 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:16.734917  2747 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.735009  2584 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.736106  2747 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.739389  2584 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.739312 30303 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 6 to 10, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 10 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:16.740760  2819 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:16.741446  2665 consensus_meta.cc:287] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.585s	user 0.016s	sys 0.000s
I20260709 13:11:16.741972  2665 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.744390  2665 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.746891 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:16.747605 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:16.748060 30555 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:16.748562 30552 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:11:16.749071  2574 consensus_meta.cc:287] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.007s
I20260709 13:11:16.748885  2584 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.749714 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.716730  2159 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.741608 30303 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 6 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 9 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:16.760464 30411 raft_consensus.cc:2393] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:16.759310  2785 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.755679  2584 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:16.768292 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 193148us
I20260709 13:11:16.774492 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.753827  2799 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.770617  2665 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.790676 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:16.795686 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.796747 30483 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:16.797485  2732 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:16.797950  2732 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:16.802098 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.804749  2179 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:16.806914 30559 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:16.808099 30478 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.808888 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.809810 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.771230  2588 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.806274 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:16.815160 30477 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:16.763055  2585 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:16.821627 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:16.811252 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.780440  2574 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:16.821570 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64125.4us
I20260709 13:11:16.786142  2795 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.810745  2783 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.828037 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:16.822495  2704 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.821368  2735 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.838546 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:16.839763 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.838169 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.841275 30480 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:16.842958 30477 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:16.848140 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.832396  2747 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.825201  2755 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.856170 30481 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:16.859157 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.863477 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:16.855957  2319 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.865089 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.866176  2319 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.858184  2799 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.866966 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.868762  2799 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.869977  2367 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.840987  2783 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.871816  2798 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.873781  2783 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.851930  2585 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.876889 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.843968  2588 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:16.877512 30477 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:16.878607 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.878978  2588 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.879458 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.880048 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:16.858407  2574 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.881090 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:16.881893 30479 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:16.817672  2785 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.846017  2704 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.866489 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:16.886786 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.895546 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 79806.8us
I20260709 13:11:16.897078 30485 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:16.885963 30558 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:16.904551 30483 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:16.916875 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.876886  2585 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:16.882663  2574 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:16.920269 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.852087  2665 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:16.925428 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.891453  2704 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:16.905301  2724 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:16.880049 30303 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index -1 to 5, term changed from 5 to 7, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 7 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:16.891243  2785 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:16.916563  2798 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:16.898715  2706 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.941260 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:16.943912 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.930353  2724 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.951303 30477 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:16.951756 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.950292  2840 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:11:16.953089 30483 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:16.953725 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.954152 30486 raft_consensus.cc:2410] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:11:16.954519 30408 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:16.955447  2204 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:16.955909 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 807) took 1119 ms. Trace:
I20260709 13:11:16.956054  2204 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.956357 30558 rpcz_store.cc:276] 0709 13:11:15.836623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.838248 (+  1625us) service_pool.cc:224] Handling call
0709 13:11:16.948998 (+1110750us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001e55d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:16.955853 (+  6855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772563200}
I20260709 13:11:16.957154 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.959595 30484 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:16.960503 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.963071 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.988737 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.989140 30407 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:16.887297  2732 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:16.991309 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.992347 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:16.963318  2441 consensus_queue.cc:1059] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:11:16.992970 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:16.996476 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.992376 30409 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:16.998004 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.989395 30482 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:17.008363 30408 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 17: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:11:17.008417 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 109626us
I20260709 13:11:16.964797  2724 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:17.009950 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66659us
W20260709 13:11:17.012156 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.010010 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.987435  2584 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:17.013974 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90939.5us
I20260709 13:11:16.958662  2204 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.028007 30406 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:17.018864 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:17.027932 30402 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:17.030915 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:16.950491  2798 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:17.035212 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:17.028076 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:17.011677  2382 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.038611 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.040899 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:17.030738  2735 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.048138  2179 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.065371 30410 raft_consensus.cc:2368] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:17.065325  2179 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.066716  2844 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.067273  2844 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.067777  2179 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.068799 30409 raft_consensus.cc:2410] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:17.070226  2844 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:17.070780 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 103317us
I20260709 13:11:17.072358 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.048678 30408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:17.048806  2204 raft_consensus.cc:3055] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:17.074498 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 65994.4us
I20260709 13:11:17.075490  2675 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.057698  2465 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.079702  2706 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.080117  2798 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:17.062078  2382 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.064344  2755 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.082209  2716 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:17.083671 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:17.083926  2627 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:17.084429 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:17.124379 30551 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:17.084914 30559 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:17.085417 30554 raft_consensus.cc:1240] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:17.063601 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.085675 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.018623  2801 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.067795 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:17.094799 30408 raft_consensus.cc:606] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:17.126531 30408 raft_consensus.cc:614] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:17.102941  2204 raft_consensus.cc:740] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:17.128259  2204 consensus_queue.cc:260] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:17.194137 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 80609.7us
I20260709 13:11:17.109781 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.062126  2584 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:17.115464 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.115694 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:17.060180  2735 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.117666  2465 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.118983 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:17.119879 30374 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:17.182912 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.130416 30555 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:17.206070 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:17.200448 30552 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:17.175691 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:17.200963 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.181224 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.203445 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.207448 30482 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:17.136632 30558 raft_consensus.cc:2393] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 9: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:17.207695 30481 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
W20260709 13:11:17.211483 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 108184us
I20260709 13:11:17.220755 30484 raft_consensus.cc:2410] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:17.209645 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:17.135843 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68116us
W20260709 13:11:17.211125 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116675us
I20260709 13:11:17.208846 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.191912 30303 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 11 to 12, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.210848  2755 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:17.231355  2755 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:17.107442 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.231817  2755 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.190820  2851 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:17.197379  2801 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.192577  2665 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.248001 30556 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
W20260709 13:11:17.234366 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.240459  2673 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:17.240904  2159 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:17.241842  2735 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.123049  2675 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.244834  2724 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:17.246574  2755 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:17.291078  2179 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:17.246683 30486 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:17.292620  2747 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:17.293264  2747 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:17.177961  2480 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:17.182813  2716 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.294885  2179 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.296059  2716 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.252058 30485 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:17.296319  2747 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:17.247028 30480 raft_consensus.cc:2410] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:17.210299  2465 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.199640  2584 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:17.260355 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.297921  2159 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:17.298333 30552 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:17.299315 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.261093 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.260665 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.275003 30551 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:17.229406  2732 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.300034  2673 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.300597 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.300813 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.301222 30553 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:17.301891 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.302284  2673 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.211685  2319 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.303085 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.303009  2319 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.304258 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.304975 30559 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:17.305176  2319 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.305718 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.294644  2480 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.234719  2627 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.308446  2627 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.284983  2204 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.309110  2480 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.309710 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:17.272107 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45764.3us
I20260709 13:11:17.310835 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.311322 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:17.289094 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.311908 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.312373 30560 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:17.313087 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.313297 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.248049  2851 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.284435 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:17.253381  2382 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.299036  2159 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.301976 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:17.261471 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:17.297864  2584 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:17.300069 30552 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:17.291330  2755 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:17.284822 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.314898 30411 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:17.315749 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.282881 31116 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:17.326880  2851 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:17.326973 30374 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:17.328586 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:17.314379 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.330873 30554 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:17.377972 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.313920 30560 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
W20260709 13:11:17.702009 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.629022 30483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.005s
I20260709 13:11:17.330819  2847 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:17.933732  2855 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.350240  2735 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:17.935439 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.935187  2855 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:17.936241 30552 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:17.936827 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.937228 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.744969 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.752010 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.726310 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.939337 30557 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:17.424760 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.939972 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:17.940379 30551 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:11:17.669512 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 403175us
W20260709 13:11:17.813324 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.407553 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.753721 30305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 190) took 36713 ms (client timeout 15000 ms). Trace:
I20260709 13:11:17.702858 30558 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
W20260709 13:11:17.938812 30483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.020s	sys 0.007s
W20260709 13:11:17.702916 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.470988 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.627547 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.433145 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.735577 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.946913 30479 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:17.947127 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:17.507560 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:17.946039 30559 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:17.938395 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.950021 30552 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:17.952414 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:17.938086  2855 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.939643 30555 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:17.967692 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 460236us
I20260709 13:11:17.966184 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.971261 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.964154 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.965420 30481 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:17.888602  2862 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.174s	user 0.000s	sys 0.006s
I20260709 13:11:18.009269 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.953872 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:18.011034 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 696439us
I20260709 13:11:18.011723 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:17.989965 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.014992 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.012375 30402 raft_consensus.cc:2393] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.016350 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.014168 30553 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:18.017838 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.017987 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.018122 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:18.019058 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 750572us
I20260709 13:11:17.478724  2665 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.019483 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.019026 30553 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:17.480947 30303 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 10 to 13, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:18.017882 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.015305 30554 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:18.023402 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.018553 30404 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.015656 30556 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:17.589666  2675 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:17.751291  2179 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:18.026885  2855 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.019937 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:17.594094  2724 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.027385 30409 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:18.027523  2755 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.028548 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.028646 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.029435 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.052312 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.030114 30558 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:18.030462  2673 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.029825 30303 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.024225 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:17.935176  2735 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.034807 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.035418 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.020255  2367 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.059993 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.059175 30560 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.064349 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.056360 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.059530 30554 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:18.035530 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:18.038578 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.041168 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.068089 30552 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:18.042234 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.043560 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.069485 30555 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:18.069612 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:18.045924 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 762671us
I20260709 13:11:17.954041  2382 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:18.039512 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.054764 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.021312  2732 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.056485 30553 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:11:18.058202 30479 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:18.080289 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.010195  2847 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.039014  2855 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:18.058436  2869 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.334s	user 0.002s	sys 0.000s
I20260709 13:11:18.019908  2665 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.076077 30409 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.077867 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:18.085943 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 144850us
I20260709 13:11:18.079386 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.054549  2673 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.055622  2179 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:18.086971 30559 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:18.060284  2735 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.093456 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.080430  2732 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:18.096253 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76405.5us
W20260709 13:11:18.095286 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 159756us
I20260709 13:11:18.070911  2675 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:18.094317 30405 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:18.095870 30551 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:18.084156  2855 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.071946  2724 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:18.093518 30478 pending_rounds.cc:85] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 8
I20260709 13:11:18.099746 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.102254 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.102921 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.106402 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.107880 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.109098 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.109601 30403 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.103770 30407 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:18.101900 30478 pending_rounds.cc:107] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:11:18.118358 30478 raft_consensus.cc:2889] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.090314  2673 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.118014 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:18.098404  2863 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.376s	user 0.001s	sys 0.002s
I20260709 13:11:18.086159  2382 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.120893  2588 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.121670  2588 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.123360  2382 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.123922  2588 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.097967  2856 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:18.100419  2732 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.127693 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.126308 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.131081 30407 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:18.131433 31151 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:18.132882 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:18.133739 30402 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:18.101194  2675 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.140580 31146 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:18.141772  2864 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:18.130897  2856 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.143314  2856 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.144570 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:17.941715 30305 rpcz_store.cc:269] 0709 13:10:41.094048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.105065 (+ 11017us) service_pool.cc:224] Handling call
0709 13:11:17.753429 (+36648364us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:13.110402 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:13.316724 (+206322us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:13.359322 (+ 42598us) write_op.cc:435] Acquired schema lock
0709 13:11:13.361224 (+  1902us) tablet.cc:662] Decoding operations
0709 13:11:13.404024 (+ 42800us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:13.404154 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:13.404198 (+    44us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:13.405245 (+  1047us) tablet.cc:701] Row locks acquired
0709 13:11:13.405306 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:11:13.405559 (+   253us) write_op.cc:270] Start()
0709 13:11:13.405755 (+   196us) write_op.cc:276] Timestamp: P: 1783602673405462 usec, L: 0
0709 13:11:13.405785 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:11:13.415070 (+  9285us) log.cc:844] Serialized 3708 byte log entry
0709 13:11:14.390985 (+975915us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa041f9f0ac 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b
0709 13:11:15.553644 (+1162659us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.824837 (+271193us) write_op.cc:301] APPLY: starting
0709 13:11:15.824977 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:16.167232 (+342255us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:16.167284 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:16.371860 (+204576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:16.372451 (+   591us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:11:16.372558 (+   107us) write_op.cc:312] APPLY: finished
0709 13:11:16.373306 (+   748us) log.cc:844] Serialized 89 byte log entry
0709 13:11:16.404136 (+ 30830us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.434956 (+ 30820us) write_op.cc:454] Released schema lock
0709 13:11:16.441293 (+  6337us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:16.448179 (+  6886us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.448225 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2858143,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":215722,"apply.run_cpu_time_us":30175,"apply.run_wall_time_us":651113,"cfile_cache_hit":34,"cfile_cache_hit_bytes":35564,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":1595,"lbm_reads_lt_1ms":12,"num_ops":9,"prepare.queue_time_us":332717,"prepare.run_cpu_time_us":56095,"prepare.run_wall_time_us":1923902,"raft.queue_time_us":409664,"raft.run_cpu_time_us":13979,"raft.run_wall_time_us":240357,"replication_time_us":2123227,"spinlock_wait_cycles":40090368,"thread_start_us":1870719,"threads_started":4,"wal-append.queue_time_us":1615608,"wal-append.run_cpu_time_us":17573,"wal-append.run_wall_time_us":2320582}]]}
I20260709 13:11:18.087697  2367 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.151289 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.153393 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.155789 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.156899 31147 raft_consensus.cc:2410] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:18.158172 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.159205 31150 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.160363 30407 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:18.161443 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.167971 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.166396 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.171089 30409 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:18.176385 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:18.178483 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 46430.7us
I20260709 13:11:18.149580  2675 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:18.177665 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.205665  2874 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:18.239151 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.239408 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.241192 30404 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:18.206223  2874 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.242952 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.243166 30402 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:18.246654 31151 raft_consensus.cc:2410] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:11:18.243851 30486 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.245015 30483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2484) took 1284 ms. Trace:
I20260709 13:11:18.246085 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.249145 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.249859 30559 raft_consensus.cc:2393] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:18.175554  2873 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.251825 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74256.2us
I20260709 13:11:18.263198 30557 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:18.263792 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2246) took 1002 ms. Trace:
I20260709 13:11:18.264150 30557 rpcz_store.cc:276] 0709 13:11:17.260939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.261132 (+   193us) service_pool.cc:224] Handling call
0709 13:11:18.263739 (+1002607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.254168  2588 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:18.265075  2179 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.260596 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 108922us
I20260709 13:11:18.273518 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:18.275334 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.276896 31146 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.247267 30483 rpcz_store.cc:276] 0709 13:11:16.938872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.956301 (+ 17429us) service_pool.cc:224] Handling call
0709 13:11:16.956631 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.956875 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:17.108024 (+151149us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.803673 (+695649us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:18.220508 (+416835us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.223069 (+  2561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.223121 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:18.223170 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.223240 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.223362 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4714,"prepare.queue_time_us":347597,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":4327,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":24542,"spinlock_wait_cycles":27097472,"thread_start_us":1181664,"threads_started":3,"wal-append.queue_time_us":615759}
I20260709 13:11:18.260210  2873 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.285190 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.285924 30551 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:18.265527  2588 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.249434  2874 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:18.287490 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 200066us
I20260709 13:11:18.260365  2876 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.288283 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.265700  2179 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.293543 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.290303  2876 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:18.298308 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.298902 31146 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:18.285145  2382 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:18.304796 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.312129 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.314081  2874 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.323464 31149 raft_consensus.cc:2368] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19.
I20260709 13:11:18.289042  2872 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:18.318976 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.290536 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.320436 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.321357 30556 raft_consensus.cc:2393] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 7: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
W20260709 13:11:18.333128 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57933.6us
I20260709 13:11:18.335703 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.322014 31152 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
W20260709 13:11:18.324335 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.336897 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.315142 30303 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 9 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 10 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.327244 30559 raft_consensus.cc:2368] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:18.337471 30555 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.336146 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.339285 31150 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:18.339401 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.340404 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.340601 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.340960 31145 raft_consensus.cc:2376] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10. Re-sending same reply.
I20260709 13:11:18.341876 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.342738 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.343894 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.343453 30303 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.344511 31151 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:18.345335 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.345261 30303 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 5 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 9 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:18.346925 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.347131 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.347545 30483 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:18.350737  2855 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.352960  2855 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.353485 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2501) took 1038 ms. Trace:
I20260709 13:11:18.354048 30411 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.357016 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.358145 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.359064 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.359719 31146 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 19: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.360399 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.361084 31146 raft_consensus.cc:2410] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:11:18.361764 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.362128  2665 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.363941  2367 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.364746 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.365262  2179 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:18.365339 31149 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:18.353856 30478 rpcz_store.cc:276] 0709 13:11:17.315515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.315653 (+   138us) service_pool.cc:224] Handling call
0709 13:11:17.384934 (+ 69281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.160101 (+775167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.160153 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.160685 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.284831 (+124146us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:18.284882 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.353121 (+ 68239us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54003d7554. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:18.353169 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.353213 (+    44us) raft_consensus.cc:1685] finished
0709 13:11:18.353227 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.353432 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620551552,"thread_start_us":123708,"threads_started":1,"wal-append.queue_time_us":154175}
I20260709 13:11:18.366510 31149 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:18.379530 30410 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:18.380198 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2117) took 1051 ms. Trace:
W20260709 13:11:18.327677  2870 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:11:18.299758  2876 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:18.383880 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 86892.7us
I20260709 13:11:18.346489 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:18.384876 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91443.1us
I20260709 13:11:18.380549 30410 rpcz_store.cc:276] 0709 13:11:17.328489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.372350 (+ 43861us) service_pool.cc:224] Handling call
0709 13:11:18.059787 (+687437us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a06f0a0 00007fa04a06e984 00007fa0435e96d4 00007fa0435e9662
0709 13:11:18.380140 (+320353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547672832}
W20260709 13:11:18.327936 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 246573us
I20260709 13:11:18.385913 31146 raft_consensus.cc:2393] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:18.385502 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.385977  2885 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:18.288843  2880 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:18.394243 31152 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:11:18.401911 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45336.3us
I20260709 13:11:18.406088 31118 leader_election.cc:400] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:18.409559 30408 raft_consensus.cc:2468] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 7.
I20260709 13:11:18.413414 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:18.410851 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 121445us
I20260709 13:11:18.331584  2847 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.417222 30451 leader_election.cc:400] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19.
I20260709 13:11:18.422322 30451 leader_election.cc:403] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:18.417860 31118 leader_election.cc:403] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:18.412580 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.386672  2887 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.447961 30557 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:18.384739  2855 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.445446 30403 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
W20260709 13:11:18.445613 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 136167us
I20260709 13:11:18.407655  2665 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:18.436195  2856 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.428879  2367 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:11:18.460352 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47851.1us
I20260709 13:11:18.374823  2872 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.464349  2885 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:18.473062 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 94829.2us
I20260709 13:11:18.421764  2724 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:11:18.463989 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 90479.1us
I20260709 13:11:18.476120 30450 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:18.488281 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.486138 30376 leader_election.cc:336] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.643s (SENT)
I20260709 13:11:18.431667  2584 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:11:18.463095  2884 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:18.508642 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.527951 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51939.5us
W20260709 13:11:18.532161 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57652.2us
I20260709 13:11:18.462411  2665 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.539856 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.475522  2585 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.474956  2382 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:18.542990 30406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2115) took 1215 ms. Trace:
W20260709 13:11:18.548856 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 66237.8us
I20260709 13:11:18.549108 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:18.552430 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:18.554087 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:18.483575  2855 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:18.558275 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 152420us
I20260709 13:11:18.559762  2855 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.544090  2665 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.558120  2179 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:18.537298  2755 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:18.545137 30406 rpcz_store.cc:276] 0709 13:11:17.327803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.335576 (+  7773us) service_pool.cc:224] Handling call
0709 13:11:17.726827 (+391251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.744152 (+ 17325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.744186 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.763021 (+ 18835us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.036078 (+273057us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:18.036120 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.036184 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.542752 (+506568us) raft_consensus.cc:1685] finished
0709 13:11:18.542775 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.542918 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315,"raft.queue_time_us":131,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"thread_start_us":268734,"threads_started":1,"wal-append.queue_time_us":314438}
I20260709 13:11:18.542270  2585 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.575652 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.575726 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.578677 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.582145 31151 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:18.574892 31117 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:18.550251  2847 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:18.569984  2204 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.578403  2585 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.571456  2903 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:18.586131 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.578847  2588 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.473841  2885 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.579418  2901 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.581979  2873 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:18.589095  2851 consensus_meta.cc:287] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.005s
I20260709 13:11:18.583868  2895 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.602790  2873 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:18.603232  2873 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:18.594810  2903 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.604054  2873 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.605604  2903 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.606127  2903 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:18.608664  2673 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.609172  2887 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.609673  2887 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.610986  2382 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.611982  2894 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.612591  2894 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.614825  2588 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.615361  2588 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:18.615609  2892 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:11:18.615857  2588 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.618947  2204 raft_consensus.cc:2804] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:18.619491  2204 raft_consensus.cc:697] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:18.620376  2204 consensus_queue.cc:237] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.564222 30303 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 7 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.623634 30409 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:18.593842  2874 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.592470  2584 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:18.568306  2884 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.631011 31145 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:18.591861  2898 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:11:18.625766  2851 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:18.640710  2735 consensus_meta.cc:287] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.004s
W20260709 13:11:18.643005 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 93979.8us
I20260709 13:11:18.644361 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2129) took 1048 ms. Trace:
W20260709 13:11:18.647964 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 162908us
I20260709 13:11:18.648289 30555 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:18.655802 30409 rpcz_store.cc:276] 0709 13:11:17.595729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.130829 (+535100us) service_pool.cc:224] Handling call
0709 13:11:18.644288 (+513459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.655963 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.657303 30406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:18.657832 30406 raft_consensus.cc:606] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:18.655684 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 181858us
I20260709 13:11:18.658186 30406 raft_consensus.cc:614] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:18.653650 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 87843.5us
I20260709 13:11:18.592056  2900 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:18.663516 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:18.663736 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.661602  2584 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:18.667217 30479 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:18.667300 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.667899 30480 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:18.668510 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.669529 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.669744 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.670097 30482 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:18.670390 30485 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:18.672330  2367 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19.
I20260709 13:11:18.672940  2856 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:18.674346  2732 consensus_meta.cc:287] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.001s
I20260709 13:11:18.592700  2847 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.672384  2872 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.687742  2665 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.695704 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:18.696060  2665 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.696333 30556 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:18.677881 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 207654us
I20260709 13:11:18.679849 31144 raft_consensus.cc:2368] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:18.680490 30303 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.682559  2585 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.677058 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:18.606598  2903 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:18.706182 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47904.2us
I20260709 13:11:18.684098  2588 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.707584 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.708231  2588 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.708345  2367 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:18.708992  2588 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.709393  2588 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.709750  2588 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.710992  2585 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.711198  2903 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.689558  2732 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.657969  2735 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.691665 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:18.692464  2851 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.736564 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:18.736625  2735 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.738049 31147 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.700986  2876 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.740252  2876 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.740988 30551 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:18.741619  2732 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:18.689213  2755 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 16. Current term is 17.
I20260709 13:11:18.664278 30484 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:18.713184 30478 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:11:18.709777 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:18.720266 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54008us
I20260709 13:11:18.743388 30478 pending_rounds.cc:85] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 6
I20260709 13:11:18.743712 30478 pending_rounds.cc:107] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:11:18.743938 30478 raft_consensus.cc:2889] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:18.721697 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 45323.9us
I20260709 13:11:18.713652  2880 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:18.728230 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.766759 30481 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.729012 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.712337 30556 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:18.723264 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:18.745298 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 170490us
I20260709 13:11:18.765127 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.767980 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.768160 30486 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
W20260709 13:11:18.769663 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 60004.6us
I20260709 13:11:18.665443  2900 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.777608 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.796509  2908 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.809737  2908 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:18.794816  2903 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.791203 30450 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.810402  2908 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.817549  2665 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:18.774618 30525 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.823100 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:18.824295 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 59536.7us
I20260709 13:11:18.825153  2585 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:18.825747  2585 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:18.826124  2585 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.818936  2903 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.724354  2886 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:11:18.827632  2886 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.828266  2886 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:18.828575  2886 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:18.828605  2903 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.829375  2886 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.775723  2872 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:18.831023  2903 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:18.831524  2872 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:18.832013  2872 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:18.833053  2872 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.662840  2675 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:18.797348 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 74166.1us
I20260709 13:11:18.836944  2675 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.790499  2883 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:18.830540  2886 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:18.798051 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:18.853832 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55891.8us
I20260709 13:11:18.825135 30525 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.836982 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:18.821848  2900 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.814081  2873 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:18.846241 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78077us
W20260709 13:11:18.852200 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.834493  2872 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.830526 30450 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.846549 30481 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:18.860571 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:18.863989 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.864498 30486 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.866039 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:18.862175 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.867694 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.868407 31152 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.868425 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.869208 30484 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:18.873979 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 43529.4us
I20260709 13:11:18.805119  2673 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:18.875687 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.879832 30481 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:18.877139 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.880366 30485 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.877689 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:18.877913  2665 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:18.877964  2856 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:18.875149 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.849287  2897 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.800052  2884 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.880383 30451 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:18.882840 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:18.861604  2880 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:18.908138 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 83129.5us
I20260709 13:11:18.776541  2887 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.887240 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.914994 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.915299 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.876019  2675 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:18.920369 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:18.895556  2856 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.949869 31144 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:18.949522 30486 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
W20260709 13:11:18.949270 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 68955.3us
I20260709 13:11:18.951357 30410 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:18.907680  2732 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:18.956485 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.958246 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76003.9us
I20260709 13:11:18.883267  2874 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:18.919159  2665 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:18.960219 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 123306us
I20260709 13:11:18.959949 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.962145 30451 leader_election.cc:400] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:18.967573 30451 leader_election.cc:403] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:18.925877  2367 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:18.965018 30525 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:18.966812 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.967921 30524 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:18.955999  2903 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.969996 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:18.957320 30411 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:18.954703  2856 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.961738  2899 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:18.978207 30485 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:18.982642 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.998790 31152 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:18.980149 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:18.999725 31144 raft_consensus.cc:2376] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11. Re-sending same reply.
I20260709 13:11:18.916128  2847 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:18.984916  2732 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:18.963595  2884 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:18.992725 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.972906  2159 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:18.929328  2724 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:19.009328 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:19.012601 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:18.914418  2897 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:18.993940  2899 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:18.999334  2584 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:19.036393  2920 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.024902 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:19.026463 31153 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:18.998864  2855 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:19.041139  2855 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.041682  2855 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:18.981585  2367 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:19.046553  2367 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:18.776252 30303 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.052234 30303 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.066013 30303 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:19.084748 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 52974us
I20260709 13:11:19.011641  2884 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.999140  2675 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:11:19.086450 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86780.1us
I20260709 13:11:19.023357  2159 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.980823  2908 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:19.094309 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 126437us
W20260709 13:11:19.096988 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 116138us
I20260709 13:11:19.090916 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.097291 30411 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:19.022751  2909 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:19.107875 30524 leader_election.cc:400] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:19.108225 30524 leader_election.cc:403] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:19.095634  2884 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.099566  2159 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:19.096129  2896 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:19.131883 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.088240  2906 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:19.107021  2909 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.149606 30374 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:19.150496  2915 log.cc:927] Time spent T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:11:19.152114 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44393.1us
I20260709 13:11:19.130142  2847 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:19.157131 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:19.159252 30376 leader_election.cc:336] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.649s (SENT)
I20260709 13:11:19.022285  2880 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:19.164067 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.167100 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.092278  2665 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.137352  2896 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:19.173839 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.153988  2735 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:19.146795  2909 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.155417  2382 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:19.205708 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.205868  2724 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.172865  2887 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.210506  2923 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:19.237950 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:19.210726  2922 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:19.211380 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 52171.5us
I20260709 13:11:19.259256  2724 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:19.260074 30376 leader_election.cc:336] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Timed out: RequestConsensusVote RPC to 127.28.152.4:39627 timed out after 1.649s (SENT)
I20260709 13:11:19.212019  2675 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:19.212834  2673 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:19.260950  2673 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:19.178009  2896 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.261622  2724 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:19.155829  2732 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:19.261917  2673 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.156673  2899 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:19.170190  2847 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:19.219048 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:19.219925 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:19.275918 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 421504us
I20260709 13:11:19.220336  2894 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.221437  2851 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:19.222748  2888 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:19.287875 30556 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:19.289901 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.290493 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.300397 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:19.302068 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:19.256067 30484 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
W20260709 13:11:19.238425  2914 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:11:19.278720 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.314234 30482 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:19.270944  2159 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.247483  2908 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:19.325516 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 161196us
I20260709 13:11:19.332113 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.338394  2159 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.335366 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:19.314982  2927 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:11:19.340517 30480 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:19.286129  2382 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:19.286267  2851 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:19.367727 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 159434us
I20260709 13:11:19.368461 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.371385 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.372216 30411 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:19.354528 30478 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:19.331604  2584 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.312731  2920 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 8. Current term is 9.
I20260709 13:11:19.332939  2367 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:19.381302  2584 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.395267  2584 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.332147  2855 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.354367  2735 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:19.413040 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:19.408939 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:19.429723 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.429886 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:19.432555 30411 raft_consensus.cc:2368] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14.
I20260709 13:11:19.433975 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:19.434425 30405 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:19.434340 30410 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:19.439318 30407 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:19.440474 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.440768 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.442093 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.442353 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.442996  2866 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:19.444262  2912 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:11:19.446393  2930 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:19.448335 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.448686 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.453477 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.454102 30486 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
W20260709 13:11:19.454430 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.457959 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.458791 30411 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:19.465375 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.466032 30404 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:19.466989 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.468412 30486 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:19.468459 30404 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:19.470342 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.470937 30481 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:19.459252 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.486802 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.426532  2898 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:19.491060 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:19.491374 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.491740 30480 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:19.491757 30408 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:19.494166 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.496424 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.500931 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.501008 30481 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
W20260709 13:11:19.475656  2588 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.000s
I20260709 13:11:19.500761 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.447168  2382 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.500528 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.505200 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:19.583967 30405 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:19.505350 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.585186 30552 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.586203 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.586897 30552 raft_consensus.cc:2376] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17. Re-sending same reply.
I20260709 13:11:19.564034 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.564662 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.560417 30408 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
W20260709 13:11:19.540763 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.572777 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.587900 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.578552 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.595024 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.596634 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.580430  2673 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.588366 30553 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:19.603753 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.588913 30556 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 10: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:19.605348 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:19.589718 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.598743 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.606642 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.609054 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.609182 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.610148 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.610790 30556 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:19.611948 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:19.575698  2917 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:11:19.613067 30552 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.612731 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.614420 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.614827 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.615449 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.615553 30556 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:19.616711 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.617422 30556 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:19.610188 30555 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:19.620344 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.620903 30555 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:19.621639 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.622772 30478 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:19.624322 30556 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:19.625223 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.626228 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.627164 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.628212 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.628755 30556 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:19.628901 30482 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:19.629537 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.639150 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.639778 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.640321 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.641036 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.641446 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.642328 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.492889  2898 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.662240 30559 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:19.641177  2921 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:19.404524  2847 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.560451  2906 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:19.664413 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.664456 30558 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:19.622604 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.630507 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.680078 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.683777 30554 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.683590 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.684731 30555 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.566035  2866 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:19.630746  2888 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:19.455396  2851 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:19.688652 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.690621 30480 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:19.566660  2588 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:19.679708  2585 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.002s
I20260709 13:11:19.665910  2883 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.667804  2898 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:19.699193 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.695739 30478 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
W20260709 13:11:19.696362 31147 consensus_meta.cc:287] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260709 13:11:19.699975 30554 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:19.685971 31145 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:19.702193 31147 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:19.685758  2855 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.705433 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.702345 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.702831 30485 raft_consensus.cc:2368] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
W20260709 13:11:19.759692 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57423.7us
I20260709 13:11:19.696735  2888 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.765828 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.766410  2947 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:19.766763 30559 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.766899 30551 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.766988  2947 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.769565  2947 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.773765 30558 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:19.761904 30374 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.699239  2897 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:19.777189 30480 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
W20260709 13:11:19.755566  2872 consensus_meta.cc:287] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
I20260709 13:11:19.788193 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:19.792012 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:19.792438 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 87141.7us
W20260709 13:11:19.799166 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.758620  2874 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:19.682456  2735 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.701242  2585 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.787912  2873 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.797435 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:19.805667 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.851540  2673 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:19.852018  2673 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.851770  2584 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.852418  2673 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:19.852619  2888 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:19.853489  2902 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.175s
W20260709 13:11:19.857765  2948 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:11:19.859556  2936 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:11:19.861918  2585 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.862818 30481 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:19.863662  2884 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.000s
I20260709 13:11:19.864116  2884 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.813573  2887 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:19.865921  2887 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:19.866581 30483 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:11:19.866962  2887 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.867542  2588 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.809604 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.810482 30405 raft_consensus.cc:1275] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:19.868355 30402 raft_consensus.cc:2368] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:11:19.868561 30525 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:19.870451  2897 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:19.868368 30559 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:19.871075  2897 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:19.803818  2938 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.872690 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.687177  2906 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.885108 30558 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:19.886364  2906 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:19.889458  2896 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.000s
W20260709 13:11:19.892050  2918 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:19.752561  2883 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.895013  2883 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:19.801823  2866 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:19.899003  2909 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.005s
I20260709 13:11:19.899503  2909 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.899760  2898 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:19.900740 30553 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.901859  2909 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:19.904062  2903 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.001s
I20260709 13:11:19.904567  2903 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:19.884694  2856 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.884s	user 0.008s	sys 0.003s
I20260709 13:11:19.908740  2856 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.804807 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.871169  2884 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:19.850411 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 53110.1us
W20260709 13:11:19.871776 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58987.7us
I20260709 13:11:19.871861 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.849243 30524 leader_election.cc:400] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14.
I20260709 13:11:19.802613 30551 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:19.924153 30559 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
W20260709 13:11:19.878841 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64220.1us
W20260709 13:11:19.924453 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 75379.4us
I20260709 13:11:19.880771  2584 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:19.909752 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:19.910348 30450 leader_election.cc:336] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.517s (SENT)
I20260709 13:11:19.911283  2897 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:19.913707 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.928644 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:19.932334 30451 leader_election.cc:336] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.504s (SENT)
I20260709 13:11:19.918527 30555 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:19.925114 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.756074  2890 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:11:19.925465 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 120764us
I20260709 13:11:19.938136 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.938686 30483 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:19.925999 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.926757  2159 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:19.927502 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 226520us
I20260709 13:11:19.902565  2898 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:19.890026  2896 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:19.937907 30559 raft_consensus.cc:2368] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:19.935468 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.942714 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:19.943975 30405 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:19.944939 30555 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.939716 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.952054 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.952607 30556 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:19.952719 30557 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:19.952740 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:19.954861  2159 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:19.958313 30451 leader_election.cc:336] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.517s (SENT)
I20260709 13:11:19.958756 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:19.961488 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:19.961717 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:19.965936 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:19.968031 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.969492 30552 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:19.977451 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:19.968504  2159 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.003010 30450 leader_election.cc:336] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.569s (SENT)
I20260709 13:11:20.004000 30557 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:19.957588  2921 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:20.011837  2946 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.955534  2894 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:19.930243  2855 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:11:20.015789 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:20.016167 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.028108 31151 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
W20260709 13:11:20.029332 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 83641.9us
I20260709 13:11:19.960980  2903 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:20.035929 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.030720 30555 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:20.033385 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.039207 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.011516  2925 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:20.016561  2927 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:19.970976  2874 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:11:20.030401  2888 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:20.073782 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63447.1us
I20260709 13:11:20.074168 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.039616 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:20.076100 30451 leader_election.cc:336] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.569s (SENT)
I20260709 13:11:20.076490 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.075712 30556 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:20.091301 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.091724 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.093611 30556 raft_consensus.cc:2393] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:20.094831  2903 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.111716 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.116901 30557 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:20.121692  2958 consensus_queue.cc:1048] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:11:20.121846 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.123590 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:20.124568  2959 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:11:20.123812  2955 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:20.125512 30556 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:20.134383  2943 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.455s	user 0.004s	sys 0.000s
I20260709 13:11:20.036974  2946 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.068564  2925 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:20.137717 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 62482.3us
I20260709 13:11:20.138526 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.111676  2874 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.140081  2856 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.141546  2673 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.144349  2673 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:20.145957 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.146556 30557 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.155247 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.155956 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.156250 30483 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:20.155978 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:20.160308 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.156764 30479 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:20.168682 30479 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:20.162902 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:20.170758 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.171583  2897 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:20.172519 30405 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:20.174268 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.176462 30524 leader_election.cc:400] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:11:20.176856 30524 leader_election.cc:403] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.173754 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:20.181234 30557 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:20.177385  2883 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:20.182164  2945 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:20.167656  2909 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.182865  2945 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:20.183216  2909 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.183683  2909 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.183948  2945 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.184894 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45412 (request call id 419) took 1409 ms. Trace:
I20260709 13:11:20.185292 31145 rpcz_store.cc:276] 0709 13:11:18.775676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.790441 (+ 14765us) service_pool.cc:224] Handling call
0709 13:11:18.790850 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.753883 (+963033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.184614 (+430731us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54005a2154. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:20.184810 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933336320}
I20260709 13:11:20.186087 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.179780  2584 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.187235 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.187305  2584 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:20.182395  2883 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:20.187856  2584 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.187939  2925 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.188423  2883 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.189707  2883 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.189905  2938 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.161602  2888 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.191004 30525 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:20.192148  2946 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.192750  2585 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.193375  2896 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.193965  2896 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.194310  2896 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.194628  2896 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.180187  2876 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.195924  2876 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:20.196269  2876 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.196302  2584 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.169257  2912 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.120663  2921 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.199641 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.200781 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.201283 30556 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.202147 30552 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:20.182934  2897 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:11:20.203871  2724 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:20.202077 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:20.205271 30479 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.207937 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.208756 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.215058 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.216538 30560 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
I20260709 13:11:20.217343 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.169453  2874 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.221355 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.223176 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.223932 30479 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:20.169554  2907 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:11:20.228912  2588 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.222054  2888 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.229349  2905 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:11:20.230535  2905 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:20.230957  2905 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:20.218847  2912 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.231824  2905 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.233044  2905 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.229832  2924 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.233480  2924 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:20.233851  2924 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.220461  2585 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.245867  2585 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:20.246335  2585 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.246423 30486 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:20.236218 30479 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:20.236088 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.247437 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.248001 30486 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:11:20.236658 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.248939 30559 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:20.249665 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:20.252924 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.256017 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.257201 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.288445 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.289539 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.291379 30411 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:20.292282 30483 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:20.294265 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.297101 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.294889 30407 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:20.297861 30403 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:11:20.298038 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.298748 30411 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:20.296636 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.254405  2897 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.303133 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.302300 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.258059  2732 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:20.312217 30556 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:20.318516 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.319514 30410 raft_consensus.cc:2368] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16.
I20260709 13:11:20.320673 30410 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:20.254302  2932 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:11:20.332248 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.316569  2732 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.311853  2179 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.339007 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:20.325289  2922 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:20.343823 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:20.302469  2920 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:11:20.339895  2732 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:20.370872 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 153580us
I20260709 13:11:20.371567  2588 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:20.373045  2934 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.061s	user 0.000s	sys 0.006s
I20260709 13:11:20.346088  2922 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.375029  2922 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.376165 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:20.377122 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.377655  2851 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.367580  2584 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.378212 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.385494  2588 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:20.386932  2179 raft_consensus.cc:2764] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:20.384528  2885 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.397037 30410 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:20.400588 30451 leader_election.cc:400] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:20.401786 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.400965  2953 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.403159  2949 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.403693  2949 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.405808 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.395884  2584 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.408908 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:20.397032  2588 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.412788 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.398100  2885 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.410355  2584 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.413012  2588 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.419258  2949 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:20.421720  2965 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:11:20.424345  2968 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:11:20.426103  2970 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:11:20.427816  2982 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:20.428681  2973 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:20.428918  2982 raft_consensus.cc:2764] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:20.415915  2885 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.410954  2847 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:20.444182 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.394639  2876 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.474927 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 168821us
I20260709 13:11:20.412662  2908 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.442677  2885 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.489565  2885 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.481505 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.481627  2909 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.482520  2985 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.483305 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.485312  2922 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.487058  2972 log.cc:927] Time spent T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:11:20.491106 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45502.3us
I20260709 13:11:20.497215 30523 leader_election.cc:400] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13.
I20260709 13:11:20.446314  2584 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.422355  2732 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.442399  2847 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:20.502817 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.504123 30410 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.493901  2885 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.508003  2179 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:20.509807  2179 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:20.510141  2179 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:20.510483  2876 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.510928  2179 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.511330  2885 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.512135  2179 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.513785  2885 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.500115  2920 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:20.527926  2920 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:20.506304  2912 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.516546  2909 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.524269  2873 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:20.524765 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 563127us
I20260709 13:11:20.562208 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.524866  2887 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.525695  2855 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:20.514806  2977 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:20.529664 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.587867 30481 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.586508 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.549728 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.550578 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2473) took 1109 ms. Trace:
I20260709 13:11:20.588624 30402 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.494462  2588 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.589478 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 176747us
I20260709 13:11:20.591087  2588 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.591325 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.588547 30409 rpcz_store.cc:276] 0709 13:11:19.441340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.441431 (+    91us) service_pool.cc:224] Handling call
0709 13:11:19.441718 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.491357 (+ 49639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.491386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.559824 (+ 68438us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.945652 (+385828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:20.083124 (+137472us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.550216 (+467092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.550301 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.550359 (+    58us) raft_consensus.cc:1685] finished
0709 13:11:20.550377 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.550519 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":514672,"prepare.queue_time_us":124149,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":5038,"raft.queue_time_us":550932,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":380470,"threads_started":2,"wal-append.queue_time_us":393362}
I20260709 13:11:20.535733 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.536386  2920 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:20.584813 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.594108 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.586018 30410 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:20.505198  2847 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.580950  2880 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.595956  2880 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.600642 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.601233 30482 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:20.594493 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.601889 30409 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.553341  2874 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.603226 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67622.7us
I20260709 13:11:20.603884 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.559883  2902 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.606833 30406 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:20.611035 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:20.607275 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 79188.4us
I20260709 13:11:20.608356 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.615015 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:20.615159 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.620218 30451 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
I20260709 13:11:20.620633 30451 leader_election.cc:403] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.623420 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.623924 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.624464 30478 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.626232 30402 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:20.584219  2855 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:20.582573  2887 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.561798  2873 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:20.624082 30406 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:20.643518 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:20.642092 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.698274 30482 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:20.698859 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 95040.9us
W20260709 13:11:20.699735 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 80441.5us
I20260709 13:11:20.699918 30376 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.701771 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.702358 30408 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.616824  2179 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:20.585233  2675 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:11:20.656996 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:20.641494  2981 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:20.706024 30409 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
W20260709 13:11:20.703258 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59838.8us
I20260709 13:11:20.718590 30406 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.718992 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.731566 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.732373 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.621608  2588 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.727478 30479 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.621874  2909 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:20.717782 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.728567 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.623564  2921 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.743214 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.617669  2880 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.726204 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.765511 30402 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:20.731190 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:20.639806  2732 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.697863  2887 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.719630 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.791481 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.644336  2896 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.794354 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.795441 30402 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:20.743816 30478 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:20.749508 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.714911  2894 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.757278 30486 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:20.757885 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.621722  2983 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:11:20.629580  2947 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:11:20.759934 30524 leader_election.cc:400] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16.
I20260709 13:11:20.806334 30524 leader_election.cc:403] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.643151  2992 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
I20260709 13:11:20.708070 30481 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:20.763526  2724 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.736533  2985 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.764478 30409 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:20.730417  2940 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.734601  2909 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:20.630752  2912 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:20.623842  2874 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:20.761667  2585 consensus_meta.cc:287] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.001s
I20260709 13:11:20.630419  2902 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.810542  2922 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:20.810555  2986 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.799335 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.802402 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.797201 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.803577 30408 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 20.
I20260709 13:11:20.763998 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.763058  2939 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:20.758852  2179 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:11:20.810621  2996 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.839738  2996 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:20.816742 30404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2482) took 1322 ms. Trace:
I20260709 13:11:20.840626 30410 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:20.760051  2855 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.799074 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.832281 30481 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:20.833731 30402 raft_consensus.cc:2368] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15.
I20260709 13:11:20.833791 30407 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:20.821180  2673 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:20.838800  2939 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.840171  2996 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.866503  2673 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:20.765838  2873 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.864566 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 104767us
I20260709 13:11:20.798398  2903 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:20.873956 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 145455us
I20260709 13:11:20.820639  2912 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:20.878250 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.841068  2983 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.841027 30404 rpcz_store.cc:276] 0709 13:11:19.494659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.495544 (+   885us) service_pool.cc:224] Handling call
0709 13:11:19.564352 (+ 68808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.662742 (+ 98390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.662775 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.688575 (+ 25800us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.934486 (+245911us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:20.068925 (+134439us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.810238 (+741313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.810342 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.816498 (+  6156us) raft_consensus.cc:1685] finished
0709 13:11:20.816521 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.816673 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":461575,"prepare.queue_time_us":72844,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":586587,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":8209664,"thread_start_us":612679,"threads_started":3,"wal-append.queue_time_us":349697}
I20260709 13:11:20.818586  2585 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:20.929819 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.932591 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55520.8us
I20260709 13:11:20.933961 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.934880 31117 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:20.886240  2923 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.953649 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 224810us
I20260709 13:11:20.954247 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.881242  2903 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:20.953764 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 74462.4us
I20260709 13:11:20.958317 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.964421 30481 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 18: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:20.961117  2851 consensus_meta.cc:287] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.002s
I20260709 13:11:20.962540  2585 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:20.933039  2896 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:20.968572 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:20.969336 30406 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:20.971365 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:20.971570 30477 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:11:20.972182 30481 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.873126  2980 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:11:20.974514 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:20.881425  2986 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:20.976830 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.978842 30558 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.955988  2855 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:20.963627  2724 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.937947  2584 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.981997 31147 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:20.981370 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:20.984112 30406 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:20.984644 30554 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:20.985060  2999 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:20.987169 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.987843 30552 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:20.991523  2159 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:20.991900  2159 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:20.992624  2159 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:20.993101 30479 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 20.
I20260709 13:11:20.982034 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:20.993846  2159 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.994658 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:20.984512 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:20.996083 30555 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.001391 30481 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:20.973417  2889 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.004536 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.011467 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:21.014222 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.003526  2896 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:21.018551  2947 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:21.018765  3005 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:21.019342  3005 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.019610  2947 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:21.019776  3005 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.020044  2947 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:21.020985  2947 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.022197  2947 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.025418 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:21.026001 31151 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.010982  2898 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:21.027661  2898 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:21.028756  2898 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:21.041194 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.979118  2980 consensus_queue.cc:1243] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:21.061771 30485 raft_consensus.cc:2393] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:21.048416 30558 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:20.983513  2724 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.066684 30555 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
W20260709 13:11:21.067462 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.995270  2986 consensus_queue.cc:1243] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:11:21.038558  2905 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.788s	user 0.006s	sys 0.002s
W20260709 13:11:21.011554  2924 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.777s	user 0.014s	sys 0.018s
I20260709 13:11:20.956153  2923 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.118523 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:21.127214 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.134791 30484 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:11:21.135231 30484 pending_rounds.cc:85] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 11
I20260709 13:11:21.135479 30484 pending_rounds.cc:107] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:11:21.135767 30484 raft_consensus.cc:2889] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.131443 30451 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:21.164667 30406 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:21.040877  2902 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.041529  2874 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.118786  2724 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.171725 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:21.190073 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58725.1us
I20260709 13:11:21.070230  2922 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.194058 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.201280 30406 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:21.197710 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.197993 31151 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:21.061755  2896 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.039173  2889 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.130594  2179 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.982826  2912 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.167783  2947 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:21.218216  2159 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:21.232721  2588 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:21.244096 30479 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:21.246958 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.248737  2159 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:21.251731  3006 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:11:21.256269 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.303741 30406 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:21.256603  2179 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.313001  2159 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.258747 30477 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:21.258834  3015 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:21.267936 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2102) took 1338 ms. Trace:
I20260709 13:11:21.316987 30559 rpcz_store.cc:276] 0709 13:11:19.929754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.041936 (+112182us) service_pool.cc:224] Handling call
0709 13:11:20.248773 (+206837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.249323 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.267649 (+1018326us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003381d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:21.267830 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337557248}
I20260709 13:11:21.272192 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 849) took 1114 ms. Trace:
I20260709 13:11:21.318650 30557 rpcz_store.cc:276] 0709 13:11:20.157738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.203685 (+ 45947us) service_pool.cc:224] Handling call
0709 13:11:20.205222 (+  1537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.226779 (+ 21557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.226809 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.226851 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:20.226884 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.271958 (+1045074us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54001d9cd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:21.272000 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.272138 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49074944}
W20260709 13:11:21.272423  2847 consensus_meta.cc:287] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.677s	user 0.005s	sys 0.004s
I20260709 13:11:21.133409  3007 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:21.200012  2905 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.298576 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:21.247932  2922 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.138015  2903 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.314036  2585 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.340169 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:21.340775 31149 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.304028  2923 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.337678 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:21.338258 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.310892  2947 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:21.340382 30483 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:21.344664  2159 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:21.345067 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 333651us
I20260709 13:11:21.147624  2924 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.325462  2884 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:21.348522 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 157119us
I20260709 13:11:21.304939  2675 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:11:21.334231 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.339242  2872 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:21.353235 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.334558  3007 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.336403  2905 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:21.360847 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.358403 30477 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:21.326721  2735 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:21.322834  2588 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.338574  2902 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:21.325678  2847 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.358189  2584 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.356065  2884 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:21.348515  2585 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.379820 30480 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:21.385020 30479 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:21.382953 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 69557.4us
W20260709 13:11:21.388345 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 115816us
I20260709 13:11:21.391357  2976 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:21.391804  2976 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.392619  2976 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:21.393356  2887 consensus_meta.cc:287] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.001s
I20260709 13:11:21.393826  2887 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.396263  2179 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:21.399097  2996 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:11:21.399561  2996 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.400585 30486 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:21.401736  2996 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.403671 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:21.404453 30478 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:21.405023  2888 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:21.405416  2888 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.406147  2887 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.405905  2724 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:21.407718 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.409932  2924 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:21.363782  2872 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.412654 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.413911 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.414650 30404 raft_consensus.cc:2393] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:21.398084  3005 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.415097 30411 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:21.426640 31149 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:21.422453 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.433089 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.436297 30402 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:21.436445 30555 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.439852 30525 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:21.442711 30450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 2.018s (SENT) [suppressed 72 similar messages]
I20260709 13:11:21.444546 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.414501  2588 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.448501 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.449391 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.467908 30555 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:21.358852  2896 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.393971  2976 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:21.481559 30557 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:21.414517  2872 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:21.494077 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 101137us
W20260709 13:11:21.497309 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.497473  2585 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:21.497730 30376 connection.cc:256] RPC call timeout handler was delayed by -1.7605451189999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:11:21.498153 30376 connection.cc:256] RPC call timeout handler was delayed by -1.744345118999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:11:21.498462 30376 connection.cc:256] RPC call timeout handler was delayed by -1.5824514440000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3118s for a response
W20260709 13:11:21.498821 30376 connection.cc:256] RPC call timeout handler was delayed by -1.5688451189998887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:11:21.499075 30376 connection.cc:256] RPC call timeout handler was delayed by -1.4384514440000657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32780000000000004s for a response
W20260709 13:11:21.499326 30376 connection.cc:256] RPC call timeout handler was delayed by -1.36724511899979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
W20260709 13:11:21.499667 30376 connection.cc:256] RPC call timeout handler was delayed by -1.1706854770000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:11:21.383755  2884 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:21.500193 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 60475us
I20260709 13:11:21.502205 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:21.504168  3022 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:21.504933  3022 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.508503  2855 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.508875  2724 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.509109 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.509038  2855 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.509865 30405 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.406309  2888 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.515538  2888 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:21.518559 30405 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:21.526578  2855 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.378861  2922 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.386715  3016 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:11:21.550388 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.546715 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:21.383831  2947 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.478473  2584 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:11:21.533684  2992 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:21.548976 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:21.543390  2585 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.567245 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.572412 30479 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:21.573690 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.486763  2905 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.551467  2939 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.576500 30404 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:21.506053  3022 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.578215 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:21.577890 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.584326 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.383196  3007 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.582002 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.591073 30479 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:21.558909  2855 consensus_queue.cc:1059] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:21.597848 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.598464 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.579854  3025 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:21.601648 30560 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:21.602494  3014 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.604745  3014 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.608728  3024 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:21.609325  3024 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.595345  2588 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:21.621625 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.576576  3016 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:21.628242 30553 raft_consensus.cc:2368] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15.
I20260709 13:11:21.631749 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.593106  2996 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.611176  2588 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:21.662040 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 115449us
I20260709 13:11:21.663383 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.585552  2735 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:21.665541 30554 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:21.665097 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:21.669232 30450 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:21.671885 30556 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:21.702473 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.703178 30553 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.703543 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.704636 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.705008 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.705646 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.706344 30555 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:21.653964  2912 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:21.709056 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.713498 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.714916 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.709689 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.716176 30404 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.716432  3022 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:21.717026  3022 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.653847  2847 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.571924  2992 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.721228  2992 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.722926 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.724170 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.724691 30556 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:21.725345  3023 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 13:11:21.726003  3014 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:21.727512 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:21.728609 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.729125 30555 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:21.729619 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.675293 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:21.730758 30479 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:21.680286 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:21.733053 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.734026 30403 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:21.735069 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:21.738010 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 62781.1us
I20260709 13:11:21.740315  3022 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.741185 30556 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:21.745951  2873 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.704363  2985 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.749400  3005 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:21.750034  3005 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.750490  3005 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.752472  3005 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:21.654358  3025 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.758898 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 681) took 1515 ms. Trace:
I20260709 13:11:21.759317  3025 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.759408 30484 rpcz_store.cc:276] 0709 13:11:20.243569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.252915 (+  9346us) service_pool.cc:224] Handling call
0709 13:11:20.253191 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.136209 (+883018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.754550 (+618341us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54001bf3d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:21.758816 (+  4266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026445696}
I20260709 13:11:21.760903 30552 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:21.761821  3024 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:21.762874  3027 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:11:21.767169 30559 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:21.769404 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.771600  2909 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:21.777684  3011 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.461s	user 0.000s	sys 0.001s
I20260709 13:11:21.780093 30551 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:21.781291 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.707566  2855 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:11:21.782765  2855 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.783856  2903 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.783463  2920 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.784729  2912 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:21.783457  2855 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:21.785542  2855 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:21.785936  2912 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.786742  2855 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.788426  2855 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:21.792872 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:21.793619 30478 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.671489  3032 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:21.802254 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63030.3us
I20260709 13:11:21.803500 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:21.790057 30552 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:21.805428 30409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2159) took 1049 ms. Trace:
I20260709 13:11:21.805804 30409 rpcz_store.cc:276] 0709 13:11:20.755962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.812814 (+ 56852us) service_pool.cc:224] Handling call
0709 13:11:20.813193 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:20.835125 (+ 21932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.835171 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:20.869213 (+ 34042us) log.cc:844] Serialized 52 byte log entry
0709 13:11:20.982211 (+112998us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:20.982247 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.982309 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.785599 (+803290us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b24001302c8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041e429c4 00007fa041e40acb 00007fa041ffbdc9 00007fa041ffba55 00007fa041ffafb0 00007fa044c71488 00007fa044c71be8 00007fa044c49398 00007fa044c4476a 00007fa044c43bb6
0709 13:11:21.789343 (+  3744us) raft_consensus.cc:1685] finished
0709 13:11:21.789364 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.805366 (+ 16002us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1990,"raft.queue_time_us":30001,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4233,"spinlock_wait_cycles":15906688,"thread_start_us":50656,"threads_started":1,"wal-append.queue_time_us":256780}
I20260709 13:11:21.810333 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.814669 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.816067  2880 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:21.816210 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.816711  3004 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:21.819177  2889 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:21.847640  2675 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.819446 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.819475 30485 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:11:21.823496 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 141415us
I20260709 13:11:21.857890 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:21.831372 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.831077 30555 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:21.834717 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:21.737382  3014 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:21.859529  3014 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.861481 31145 raft_consensus.cc:2393] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:21.822571  2847 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:21.870908 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59180.9us
I20260709 13:11:21.869024 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:21.872045 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.887415 30478 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:21.907650 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.908368 30553 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:21.908648 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.909313 30559 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:21.821095  2985 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:11:21.916605 30481 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:21.915064 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.917163 30404 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:21.917520 30477 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:21.916479 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.920749 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:21.870007  2896 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:21.923537 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 374607us
I20260709 13:11:21.933573 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:21.933104 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:21.915191  2980 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:21.916350  3015 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.915382  3024 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.920148  3005 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:21.915232  2978 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:21.930460 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58648.2us
I20260709 13:11:21.950440 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.914979  2932 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:11:21.955343  3043 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:21.947836  3022 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.956673  3024 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:21.948470  2980 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:21.941679  2873 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:21.944113  3040 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:21.925405  2675 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:21.968178 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:21.962033 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:21.964488 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:21.962672  3037 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:11:21.967846  3038 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.980857 30553 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:21.984689  2675 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:21.988080 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2161) took 1222 ms. Trace:
I20260709 13:11:21.991083 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.991405 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.992249 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.947958  3031 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:11:21.997118 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:21.969197  3043 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:21.997901 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:21.999576  2983 consensus_meta.cc:287] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 1.062s	user 0.012s	sys 0.000s
W20260709 13:11:22.002180  3042 log.cc:927] Time spent T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:11:22.002285  2983 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16.
I20260709 13:11:21.967132  3022 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.004542 30477 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:22.005239  3022 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:22.006623  2980 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.008646  3043 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:22.009869  3012 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.665s	user 0.000s	sys 0.001s
I20260709 13:11:21.983966  3014 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.974606  2947 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.014431 30477 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:22.015889 30403 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:11:22.017334 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.031263 30477 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:11:21.999325  2976 consensus_meta.cc:287] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:11:22.032258 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:22.034210 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:22.032382  3014 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:22.044113 30411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53716 (request call id 2152) took 1311 ms. Trace:
I20260709 13:11:22.044667 30411 rpcz_store.cc:276] 0709 13:11:20.732274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.798823 (+ 66549us) service_pool.cc:224] Handling call
0709 13:11:22.043911 (+1245088us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54002f5dd4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:22.044043 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318761344}
I20260709 13:11:21.988257  3038 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.048766  3038 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:22.020112 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 143786us
I20260709 13:11:22.031111  2947 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.053085  2947 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.053066 31116 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:22.054518  3052 raft_consensus.cc:2804] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:22.055121  3052 raft_consensus.cc:697] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:22.056102  3052 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.057364 30411 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:11:22.059010 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:22.059865 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:22.060636 30477 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:22.046377 30560 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:22.071859 30525 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.073099 30525 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.073215 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:22.079970 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:22.081086 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 119150us
I20260709 13:11:22.084052 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:22.081815 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.086403 30411 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:22.083604 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:22.077956  3004 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:22.122977  2884 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:22.079948  2983 raft_consensus.cc:3060] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:22.218758 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.149531  2585 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:22.124152 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:22.162611 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:22.515942 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 434156us
I20260709 13:11:22.135351 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2461) took 1606 ms. Trace:
I20260709 13:11:22.163543 30484 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:11:22.127296 30404 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:22.140853 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:22.553494 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.553944 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.562852 30559 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:22.563340 30556 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:22.151412  3024 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:22.128880 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.278311  2920 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:22.170292 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.139436  2909 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:22.168335  3004 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.123291 30479 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:11:22.555006  2898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.006s	sys 0.006s
I20260709 13:11:22.562335 30480 rpcz_store.cc:276] 0709 13:11:20.528821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.529011 (+   190us) service_pool.cc:224] Handling call
0709 13:11:20.536125 (+  7114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.380245 (+844120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.135090 (+754845us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001c6454. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:22.135286 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909074816}
I20260709 13:11:22.569511 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:22.568889 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.575675 30557 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
W20260709 13:11:22.578742 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 401647us
I20260709 13:11:22.581784 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:22.588359 30482 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:22.599071 30559 raft_consensus.cc:2393] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:22.561215  2585 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:22.603598 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 474789us
I20260709 13:11:22.587733  3004 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:22.658548 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.577042  3032 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:22.599864  2847 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.597441  2898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.007s	sys 0.006s
I20260709 13:11:22.603096  3022 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.672648  2856 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:22.585378  3047 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.747761  2888 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.662928  2912 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.655423  3043 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.827945  3043 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.828212  3004 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.829180 30557 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:22.830314  3004 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:22.699993  2980 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.665218  2673 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:21.992766 30408 rpcz_store.cc:276] 0709 13:11:20.766168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.836174 (+ 70006us) service_pool.cc:224] Handling call
0709 13:11:20.836557 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.836803 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:20.875846 (+ 39043us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.820234 (+944388us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18003ef260. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:11:21.987744 (+167510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:21.987792 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:21.987834 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.987897 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.988015 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38645,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1061,"spinlock_wait_cycles":4653440,"thread_start_us":167292,"threads_started":1}
W20260709 13:11:22.681077 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.586922  2902 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.835064 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.668220  3016 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.679391  2588 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:22.858120  2588 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:22.601365  2960 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.236s
I20260709 13:11:22.686578  2675 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 13:11:22.859685  2960 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:22.836508  2912 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.859903  2874 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.860080  2960 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:22.860479  2874 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.861063  2960 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.835798  2888 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.751037  2585 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.862567  2874 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:22.863160  2673 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:22.863691  2673 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:22.864001  2888 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.864535  2905 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:22.831287  3047 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.865096  2905 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.864709  2673 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.680212  3048 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.867005  3047 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:22.675559  2847 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.867161  3048 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.869423  2847 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.869870  3048 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.720531  2983 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:22.668081  3032 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.678275  2884 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.722543 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2304) took 1045 ms. Trace:
I20260709 13:11:22.772167  2856 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:22.919557 30560 rpcz_store.cc:276] 0709 13:11:21.676992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.714623 (+ 37631us) service_pool.cc:224] Handling call
0709 13:11:22.722318 (+1007695us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54000712d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:22.722464 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680257792}
I20260709 13:11:22.604676  2947 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.251s
I20260709 13:11:22.857095  2924 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.856966  2902 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.872396 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:22.943138 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:22.943634 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 71301.9us
I20260709 13:11:22.944067 30484 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:22.861737  2912 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:22.891047 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:22.891791 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:22.893823 30559 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:22.895020 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.866423  2673 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:22.950121 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.951259 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.952297 30555 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:22.953867 30555 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:22.955876 30558 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:11:22.956408 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65482.2us
I20260709 13:11:22.957288 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:22.922204  2856 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:22.899824  2888 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:22.870815  2588 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:22.918321 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.967864 30553 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:22.862466  2960 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:22.921809 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:22.964036 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:22.856554  2980 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.919780  3056 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:22.959172  2947 consensus_queue.cc:1243] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:22.959003  3016 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:22.978905 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 311495us
I20260709 13:11:22.898386 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:22.985029 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 86742.4us
I20260709 13:11:22.922082  2884 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.909231  3043 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:22.965391  2912 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:22.955956  2924 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:22.958811  3007 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.960629  2874 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.968114  2996 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:22.962194  2905 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:22.989812 30559 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:22.983487  3031 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.005203 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 2125) took 1468 ms. Trace:
I20260709 13:11:23.014096 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:23.019730 30558 rpcz_store.cc:276] 0709 13:11:21.536401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.536552 (+   151us) service_pool.cc:224] Handling call
0709 13:11:23.004909 (+1468357us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540039f654. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:23.005122 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3228455808}
I20260709 13:11:22.983659  3016 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.992141  3032 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:22.983769  3047 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:23.015257  2874 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.024322  2939 raft_consensus.cc:3055] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:23.027376  2898 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.028409 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:23.018889  2996 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.029614 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:22.988638  2920 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.031090 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:23.043123 30560 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:23.014835  2912 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:23.038209 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:23.041062 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.028930  2884 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.039456  2874 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.030522  3016 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:23.034315 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 433699us
I20260709 13:11:23.035997  2939 raft_consensus.cc:740] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:23.173436 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 120674us
I20260709 13:11:23.179893 30481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34032 (request call id 2466) took 1956 ms. Trace:
I20260709 13:11:23.184422  2847 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:23.197075  2847 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.196007 30481 rpcz_store.cc:276] 0709 13:11:21.223247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.223372 (+   125us) service_pool.cc:224] Handling call
0709 13:11:21.223741 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.917317 (+693576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.179597 (+1262280us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54000c9754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:23.179812 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593009408}
I20260709 13:11:23.188750 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:23.017629  3007 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.054590 30560 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:23.044251  2996 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.205166 30480 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:23.196486 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.048887  2912 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.036577  3047 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.228437  3014 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:23.236845  2585 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.243405  2847 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.247991 30481 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:23.248824 30485 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.199056  3043 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.173756  2675 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.286331  2675 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.288442  2675 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:23.257405 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:23.289374 30482 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:23.258841  2902 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.173360  3025 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:23.270064  3007 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.269845  2912 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.270685 30551 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:11:23.295524 30551 pending_rounds.cc:85] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 8
I20260709 13:11:23.295871 30551 pending_rounds.cc:107] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:11:23.296294 30551 raft_consensus.cc:2889] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.271750 30480 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:23.280269 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:23.255244  2939 consensus_queue.cc:260] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.297855 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:23.292793  3001 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.003s	sys 0.020s
I20260709 13:11:23.282467  3014 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.225631  3059 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:11:23.321054  3016 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.322685  2924 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.325783  2588 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:23.327556  3047 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.329824  2980 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:23.314342  3067 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:11:23.333237  3059 consensus_queue.cc:1243] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:23.301226  3025 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.314812 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:23.336388 30376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.033s	sys 0.042s
W20260709 13:11:23.384086 30556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.033s	sys 0.045s
W20260709 13:11:23.311316  3001 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.003s	sys 0.021s
W20260709 13:11:23.444725 30450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.044s	sys 0.078s
W20260709 13:11:23.431219 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55048.1us
W20260709 13:11:23.375891  2735 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.025s	sys 0.064s
W20260709 13:11:23.431414  2998 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.037s	sys 0.055s
I20260709 13:11:23.316337  3014 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:23.449860 30376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.033s	sys 0.042s
W20260709 13:11:23.468778 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 887021us
I20260709 13:11:23.469712 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:23.450024 30556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.034s	sys 0.046s
W20260709 13:11:23.462864 30450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.044s	sys 0.078s
I20260709 13:11:23.462189 30374 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:23.321264  2856 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.376353  3013 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:23.473163 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.446967  2986 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.294770  3043 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.447223  2924 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:23.464597  2735 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.025s	sys 0.065s
I20260709 13:11:23.446579  2976 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:23.484061 30410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.035s	sys 0.060s
W20260709 13:11:23.485080 30410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.035s	sys 0.060s
W20260709 13:11:23.471167  2998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.037s	sys 0.056s
W20260709 13:11:23.481830 30450 leader_election.cc:336] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.655s (SENT)
I20260709 13:11:23.486409 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:23.446504  2902 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:23.448989  2673 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:23.490746 30485 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:11:23.499229 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.478590  3080 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.492955  3059 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:23.507089 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 519681us
I20260709 13:11:23.507990 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:23.519675 30554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.027s	sys 0.031s
W20260709 13:11:23.520112 30554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.027s	sys 0.031s
I20260709 13:11:23.502512  3083 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.485186  3013 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.490008  2986 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.493562  2976 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.492723  2924 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.559389 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2133) took 1481 ms. Trace:
W20260709 13:11:23.548825 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 47100.4us
I20260709 13:11:23.559940 30554 rpcz_store.cc:276] 0709 13:11:22.078152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.586652 (+508500us) service_pool.cc:224] Handling call
0709 13:11:22.651803 (+ 65151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.652018 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:22.962287 (+310269us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.559027 (+596740us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:23.559074 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:23.559123 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.559183 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.559318 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38458,"prepare.queue_time_us":810485,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":856213,"threads_started":2}
I20260709 13:11:23.562278 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.539692  2980 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.541512  2856 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.509342  2847 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:23.570116 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.538775  2905 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.583442  2847 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.583736  2905 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.585877  2847 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.567719 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:23.549481  3074 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.582777  2992 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:23.569420  2872 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:11:23.586378  2905 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:23.599529 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:23.606253 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 404952us
I20260709 13:11:23.590098  3083 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:23.596460  2874 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:23.599329  3031 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.597792  2992 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:23.573678  3056 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:11:23.650106 31116 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:23.589002  2980 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.612157  2912 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.601608  3074 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.673352 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:23.650838  2874 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:23.673581 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 175720us
W20260709 13:11:23.675117 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 164709us
I20260709 13:11:23.674038 31146 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:23.623543  3069 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:11:23.678777  2874 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.658624  3016 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.668495  2949 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:23.695178  2902 consensus_queue.cc:1243] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:23.649559  3083 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:23.702263 30450 leader_election.cc:336] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.804s (SENT)
I20260709 13:11:23.702913 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:23.675565  3025 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.709959 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:23.713758 30450 leader_election.cc:336] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 2.274s (SENT)
I20260709 13:11:23.714490 30450 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:23.686165 30303 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 104) took 23524 ms (client timeout 15000 ms). Trace:
I20260709 13:11:23.656411  3031 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:23.707360  3071 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:11:23.704136  2673 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.718473  3084 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.729682  3083 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.709360  2902 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:23.731725  3086 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:11:23.732460  3085 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:23.733843  2980 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:23.736464  3077 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:23.739081  2924 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:23.721302  3025 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:23.767939 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 706) took 1677 ms. Trace:
I20260709 13:11:23.764403  3014 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.706067  2949 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:23.742096  3074 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.730502  2986 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.701084  2992 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.719633  2912 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.724855  3043 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.700695  3001 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:11:23.760195  3088 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:23.760838  3013 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.764576  2976 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:23.768131  2996 consensus_meta.cc:287] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:11:23.768885  3102 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.769160  3101 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.741467  3031 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:23.740659  2960 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.001s
I20260709 13:11:23.768461 30486 rpcz_store.cc:276] 0709 13:11:22.090541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.133975 (+ 43434us) service_pool.cc:224] Handling call
0709 13:11:22.134346 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:22.579290 (+444944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.579332 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:22.586749 (+  7417us) log.cc:844] Serialized 52 byte log entry
0709 13:11:23.050245 (+463496us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:23.050282 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.050341 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.767672 (+717331us) raft_consensus.cc:1685] finished
0709 13:11:23.767701 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.767871 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444518,"raft.queue_time_us":465554,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":51843,"thread_start_us":387635,"threads_started":1,"wal-append.queue_time_us":837876}
W20260709 13:11:23.775621 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.722646 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 132397us
I20260709 13:11:23.766605  3025 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.789604 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 870) took 1738 ms. Trace:
I20260709 13:11:23.797580 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:23.779822  2992 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:23.774821  2735 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.805053 30556 rpcz_store.cc:276] 0709 13:11:22.051697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.583058 (+531361us) service_pool.cc:224] Handling call
0709 13:11:22.583426 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.583677 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.583712 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.584237 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.470748 (+886511us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:23.470804 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.470897 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.789350 (+318453us) raft_consensus.cc:1685] finished
0709 13:11:23.789380 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.789537 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":813238,"threads_started":1,"wal-append.queue_time_us":971298}
I20260709 13:11:23.809401 30410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53876 (request call id 916) took 1226 ms. Trace:
I20260709 13:11:23.773357  2874 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.787447  3025 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.810264 30410 rpcz_store.cc:276] 0709 13:11:22.582539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.582649 (+   110us) service_pool.cc:224] Handling call
0709 13:11:22.582923 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.606039 (+ 23116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.606072 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.657009 (+ 50937us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.485465 (+828456us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:23.485505 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.485572 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.809186 (+323614us) raft_consensus.cc:1685] finished
0709 13:11:23.809208 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.809341 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15175,"raft.queue_time_us":23281,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5723,"thread_start_us":784925,"threads_started":1,"wal-append.queue_time_us":936995}
I20260709 13:11:23.811108 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:23.786873  3101 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.815271  3101 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.816686  3014 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.817828  3031 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:23.818239  3031 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:23.818595  3031 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.806442  2912 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:11:23.807940  3084 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:23.808853  2949 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.826959 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:23.809334  3048 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:23.782516  2996 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.827730  3084 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:23.719398 30303 rpcz_store.cc:269] 0709 13:11:00.150781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.168775 (+ 17994us) service_pool.cc:224] Handling call
0709 13:11:00.997294 (+828519us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:11:23.674667 (+22677373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:19.869471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:19.870196 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:19.873594 (+  3398us) write_op.cc:435] Acquired schema lock
0709 13:11:19.873615 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:19.881305 (+  7690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:19.881417 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:19.881449 (+    32us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:11:19.882558 (+  1109us) tablet.cc:701] Row locks acquired
0709 13:11:19.882605 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:11:19.927125 (+ 44520us) write_op.cc:270] Start()
0709 13:11:19.955990 (+ 28865us) write_op.cc:276] Timestamp: P: 1783602679921668 usec, L: 0
0709 13:11:19.960042 (+  4052us) op_driver.cc:348] REPLICATION: starting
0709 13:11:20.116344 (+156302us) log.cc:844] Serialized 5722 byte log entry
0709 13:11:20.599207 (+482863us) op_driver.cc:464] REPLICATION: finished
0709 13:11:20.839724 (+240517us) write_op.cc:301] APPLY: starting
0709 13:11:20.839812 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:21.053062 (+213250us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:21.053193 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:21.454272 (+401079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:21.496210 (+ 41938us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:11:21.496261 (+    51us) write_op.cc:312] APPLY: finished
0709 13:11:21.496596 (+   335us) log.cc:844] Serialized 129 byte log entry
0709 13:11:21.496760 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:21.496919 (+   159us) write_op.cc:454] Released schema lock
0709 13:11:21.496975 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:21.497405 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:21.497433 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":23069,"mutex_wait_us":941148,"reported_tablets":22,"spinlock_wait_cycles":75990272,"child_traces":[["op",{"apply.queue_time_us":217455,"apply.run_cpu_time_us":21700,"apply.run_wall_time_us":657679,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62703,"num_ops":14,"prepare.queue_time_us":391507,"prepare.run_cpu_time_us":54168,"prepare.run_wall_time_us":520880,"raft.queue_time_us":154500,"raft.run_cpu_time_us":59904,"raft.run_wall_time_us":200530,"replication_time_us":620618,"thread_start_us":491371,"threads_started":4,"wal-append.queue_time_us":223668,"wal-append.run_cpu_time_us":23673,"wal-append.run_wall_time_us":2210703}]]}
I20260709 13:11:23.844856  3059 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.842805  2675 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:23.854604 30404 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:23.854995  2675 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:23.855890  2675 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.846874  3084 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.852443 30406 raft_consensus.cc:1275] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:23.857784 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.858453 30403 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:23.841472  3048 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.854486  3059 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:23.863906  2939 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:23.842999 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 243801us
I20260709 13:11:23.857056  2675 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:23.868834 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.789175  3102 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.871779 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.870437 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.873497 30410 raft_consensus.cc:2410] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:23.871419 30477 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:23.832520  2874 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.874897 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.876185  3111 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.876832 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.871450  3026 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.878216  3026 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.880244  3026 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.872228  2922 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.881472  2922 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.883461  2922 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.884244 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:23.884938 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:23.886765 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.887457 30406 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:23.888268 30403 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:11:23.891269 30450 leader_election.cc:336] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.952s (SENT)
I20260709 13:11:23.891758 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:23.892890 30450 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.984s (SENT)
I20260709 13:11:23.893312 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:23.894335 30450 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 2.018s (SENT)
I20260709 13:11:23.895254  2912 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.895385  3032 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.895918  2912 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.896359  2912 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.898451  2912 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:23.900365 31145 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:23.903627 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2134) took 1812 ms. Trace:
I20260709 13:11:23.904011 30408 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:11:23.904387 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.904135 30557 rpcz_store.cc:276] 0709 13:11:22.091230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.596125 (+504895us) service_pool.cc:224] Handling call
0709 13:11:22.749954 (+153829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.829534 (+ 79580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.903311 (+1073777us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54003f3754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:23.903537 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181467904}
I20260709 13:11:23.905256 30411 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:23.909168 30450 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:23.914021 30376 leader_election.cc:400] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15.
I20260709 13:11:23.915547 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:23.916342 30411 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.917237 30552 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:23.917348  3043 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.944365 30302 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.945677 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.945408  3043 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.947933  3043 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:23.919181  3022 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:23.920888  2856 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:23.950899  2856 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:23.951731  2856 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.952880  2856 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.921191 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:23.921789 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.956490 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.958313  2976 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.958853  2976 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.958806 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2309) took 2279 ms. Trace:
I20260709 13:11:23.959221 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:23.959654 30551 rpcz_store.cc:276] 0709 13:11:21.678359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.780764 (+102405us) service_pool.cc:224] Handling call
0709 13:11:23.005888 (+1225124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.296778 (+290890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.506345 (+209567us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540039f654. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:23.957508 (+451163us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540039f650. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a88ad 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:23.957631 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3425031808}
I20260709 13:11:23.960474  3031 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:23.961124  2976 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:23.961822  2912 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:23.961959 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:23.946164 30302 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 3 to 6, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 6 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.962384  2912 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.945437 30558 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:23.921933 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.923161  3080 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:23.965441  3080 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:23.924394  2996 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:23.929589 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.965271 30302 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.971263 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:23.971943 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.890252  3025 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:23.975123 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.926162 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:23.941289 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.976428 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.943231 30560 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:23.976977 30551 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:23.944554 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.917856  3026 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.948338 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.949262 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:23.988039 30557 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:23.976894 30559 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:23.949470 30556 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:11:23.965298 30403 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:23.931489 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:23.990216 30405 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
W20260709 13:11:23.988075 30552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 866) took 1981 ms (client timeout 1543 ms). Trace:
I20260709 13:11:23.972002 30477 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:23.977824 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:23.915169  3048 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:23.915479  3104 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.988477 30555 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:23.996306 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:23.990746 30552 rpcz_store.cc:269] 0709 13:11:22.006663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.091049 (+ 84386us) service_pool.cc:224] Handling call
0709 13:11:23.987807 (+1896758us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002468d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:23.987984 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027410688}
I20260709 13:11:24.000669 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.002717 30411 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
W20260709 13:11:24.005887 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 79839.1us
I20260709 13:11:24.008279 30486 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:24.009377 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.005266 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.010377 30411 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.015165 30477 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:24.016559  2675 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.018896 30551 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:23.966328  3080 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.021553 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.024096 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.024989 30405 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:23.987690  3031 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.028309 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.032265 30411 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:24.039969 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.040678 30486 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:24.040982 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.007400  2884 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:24.047773 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.005677  3026 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.005745  3104 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.164764 30411 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:24.155350 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.167228 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.161761 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.168073 30483 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:24.168284 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.169193 30551 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:24.115211 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:24.153854 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.170842 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.172055 30485 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:11:24.068711 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.136049  2992 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.173967  3004 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.174254 30558 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:24.173193 30485 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:11:24.174717  3004 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.176213 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.176329 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.177912 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.169973 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.179093 30486 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:24.174027  2992 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.179721 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.096699 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:24.098467 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.185806 30410 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:24.094619 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:24.186777 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 158536us
W20260709 13:11:24.043293  3106 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:11:24.191082 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.200621 30411 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:24.182109  2992 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.193045 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.196200 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:24.191819 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:24.202373 30411 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:24.202461 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.210871  2382 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:24.211345  2382 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.211706  2382 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:24.213008  2675 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.021011 30302 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.220675 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.221306 30551 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:24.221374 30302 catalog_manager.cc:5697] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:24.232303 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:24.232929 30560 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:24.170948  3080 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.067132  2939 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:24.076517  2873 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:24.242506 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.248984 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:24.250489 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:24.251341 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.278741 30477 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.279531 30553 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:24.280566 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 88824.3us
I20260709 13:11:24.112016  3059 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.285727  3059 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:24.280731 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.286573 30480 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:24.288204 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.291771 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:24.292428 30558 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:24.294862  3022 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:24.295730 30451 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:24.295591  3022 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.297605  3031 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:24.298012  3031 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.298367  3031 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:24.301054 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 51822.1us
I20260709 13:11:24.237553  2887 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.301312 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:24.283803  3026 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:24.302197 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46517.7us
W20260709 13:11:24.312278 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59894.3us
I20260709 13:11:24.305792 30560 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:24.313791 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:24.348044 31153 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.348964 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.350143 30411 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:24.298870  2996 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:11:24.352267 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.298550  3022 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:24.354777 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 72698.2us
W20260709 13:11:24.416363 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 99586.1us
I20260709 13:11:24.416620 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:24.356784 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45914.4us
I20260709 13:11:24.418061 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:24.309181  2585 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:24.196908  3043 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
W20260709 13:11:24.412503  3113 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:11:24.300993  3102 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:24.233788  3014 consensus_queue.cc:1048] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:11:24.311982  3025 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:24.423125  3071 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:24.418512 30523 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:24.419948 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 72842.8us
I20260709 13:11:24.426227 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.429649 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.225368 30302 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 13, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 13 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.307657  2883 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.440135  2585 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:24.440652  2909 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:24.482769 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56624.7us
W20260709 13:11:24.441408 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 191010us
I20260709 13:11:24.441702 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.446925 31153 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
W20260709 13:11:24.479888 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55958.6us
I20260709 13:11:24.485868 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.314004  2873 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.486393 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.486085 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:24.363926  2967 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:11:24.487493  2909 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.483114  2883 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.507300 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.509577 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.503919  3111 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.590969  3111 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.593721  3111 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.487270  2179 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:11:24.496173 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 77725.9us
I20260709 13:11:24.483115  3073 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:24.448683  2939 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:24.598181 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.599519 30523 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:24.516222 30553 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:24.483152  2585 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:24.518626  2856 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.499404  3059 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.428445  3109 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:11:24.519977 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.488092  2992 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:24.506445  2909 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.524317 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:24.518985  3084 consensus_meta.cc:287] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.661s	user 0.003s	sys 0.008s
I20260709 13:11:24.511101  2883 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.512459  2920 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:24.513449  3025 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:24.609231  2585 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:24.522533  3112 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:11:24.544548 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:24.545956 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:24.625782 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 101532us
I20260709 13:11:24.626883 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:24.611128  3022 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:24.549666 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:24.555843  2912 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:24.567260  3120 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:11:24.630184  3080 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:24.569419  3121 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:11:24.571208 30302 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 10, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.622843  3025 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.632519  3025 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:24.632627 30302 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:24.612838  3059 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.637002  3059 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.635792 30302 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 10 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:24.637701  3004 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:24.621344  2992 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.638230 30302 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 12, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:24.640129  2992 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.630893  3107 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:11:24.623759  3084 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.642114 30480 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 11: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:24.640367 30302 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 10 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:24.642978  3084 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:24.644435  3114 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.478s	user 0.002s	sys 0.002s
I20260709 13:11:24.644040 30302 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 9, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.646832  2856 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:24.647429  2856 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:24.648792  2856 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.433276  3007 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
W20260709 13:11:24.577942  3048 consensus_meta.cc:287] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.000s
I20260709 13:11:24.651968  3048 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.580329  2996 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.581676  3032 consensus_meta.cc:287] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.000s
I20260709 13:11:24.583221 30477 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:24.583839  2873 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:24.584456  3104 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:24.585242 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.585619  2382 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.586529  3031 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:24.601675 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 92212.9us
I20260709 13:11:24.603080 30523 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.604175  2179 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:24.607069  3071 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:24.607606 30408 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:24.612447 30478 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:11:24.539867 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43757.4us
I20260709 13:11:24.609139  2983 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:24.629434 30485 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
W20260709 13:11:24.568501  3125 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:11:24.472008  3026 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:11:24.640604 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:24.692404 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 51889.5us
W20260709 13:11:24.655061 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 111378us
I20260709 13:11:24.660550 30524 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:24.683705 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 80721.3us
I20260709 13:11:24.686467 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:24.697198 30411 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:24.658432  3032 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.658370  3069 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:24.711156  3069 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.711632  3069 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.712196  3031 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.714159  2382 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:24.690037  3104 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:24.687757  3080 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:24.716189  3022 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:24.687590  3059 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:11:24.717128 30479 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:24.691059  2983 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:24.718525  2983 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:24.690044  2884 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:24.647414 30302 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 12, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 12 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.725308 30302 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 11, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 11 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:24.702251 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.735687  2920 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:24.702564 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.704035 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:24.704977 30376 connection.cc:256] RPC call timeout handler was delayed by -2.0576650650000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:11:24.740617 30376 connection.cc:256] RPC call timeout handler was delayed by -1.5851650649999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:11:24.741063 30376 connection.cc:256] RPC call timeout handler was delayed by -1.0658650650000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
I20260709 13:11:24.741875 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.743534 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:24.745914 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.751380 30376 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:24.752584 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.690253  3048 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:24.656711  2996 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.750859  3014 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:24.777777 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.824219 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.781104 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.785537 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.827965 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.781078 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.829485 30411 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:24.830127 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.764564 30404 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:24.807493 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:24.778141 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:24.768283 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:24.765180 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.831105 30402 raft_consensus.cc:2368] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 16.
W20260709 13:11:24.762506 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 461229us
I20260709 13:11:24.832106 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.832177 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.833356 30404 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:24.834411 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.835726 30404 raft_consensus.cc:2368] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12.
W20260709 13:11:24.761579  3093 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:24.826956 31146 consensus_queue.cc:237] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.841620 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.843945 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.840379 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.849260 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.842659 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:24.760968  3026 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.847836 30411 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:24.857488 30408 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:24.864769 30409 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:24.865280 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.865845 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.866641 30409 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 10.
I20260709 13:11:24.860023 30407 raft_consensus.cc:2368] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:24.863368 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.867681 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.868489 30409 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:11:24.760025  3022 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:24.872334  3084 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:24.872841  3084 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:24.873396  3084 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.872936  3022 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.760874  3080 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:24.860932 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:24.873193 30295 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ba4c05796efa42489d11c8a49ba476ad with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:24.837953  3032 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.880324 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.866889 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.828451  3014 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:24.887451 30408 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:24.888655 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.889307 30408 raft_consensus.cc:2376] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11. Re-sending same reply.
I20260709 13:11:24.893399 30407 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:11:24.894164 30407 pending_rounds.cc:85] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:11:24.894626 30407 pending_rounds.cc:107] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:11:24.895087 30407 raft_consensus.cc:2889] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.886113 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.798194  2883 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:24.862349  3026 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.921342 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:24.845539  2945 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:11:24.868711 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:24.921432 30407 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:24.874444  2585 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.827950  3048 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:24.909076 30404 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:24.928746 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:24.844951  3031 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:11:24.868603 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.960939 30411 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:24.936257 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:24.879815  2976 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:24.942257 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73654.8us
I20260709 13:11:24.891649  3014 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.957361  2585 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:24.966403 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.056084 30409 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:24.963733 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:25.061939 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:24.924355 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.973624 30402 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
W20260709 13:11:25.072934 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.089846 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:25.090528 30484 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:11:25.090878 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.091444 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:24.964883 30407 raft_consensus.cc:2376] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15. Re-sending same reply.
I20260709 13:11:24.932665  3026 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.092116 30485 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:25.098268 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 395749us
W20260709 13:11:24.970320 30410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.017s
W20260709 13:11:25.100136 30410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.000s	sys 0.017s
I20260709 13:11:25.100037 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:25.100981 30484 raft_consensus.cc:2410] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:11:25.093354 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.101737 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:25.102421 30410 raft_consensus.cc:2376] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12. Re-sending same reply.
I20260709 13:11:25.108075 30407 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:11:25.112705 30411 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:24.946771  2675 raft_consensus.cc:2764] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:11:24.904922  3032 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.122869 30404 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:25.099417 30524 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:25.120440 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.124912 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:25.126583 30404 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.128031 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:25.128701 30477 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:25.129109 30481 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:25.132203 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.133910 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.126946 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:24.964510  3127 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:25.136096  2179 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:25.154518  2179 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.155213  2179 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:25.134905 30410 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:25.142329 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:25.109790  3059 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:25.131176  3111 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.156085  3043 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:25.165721 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.171455 30478 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:25.183758 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.196190 30402 raft_consensus.cc:2410] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:11:25.200408 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.154472  3127 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.235288  2179 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.237673 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.168308 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:25.135608  3128 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:25.211457 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45831us
I20260709 13:11:25.224469 30485 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:25.176779 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:25.169353 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49004.1us
I20260709 13:11:25.245766 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.246994 30451 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.180863  3131 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:25.269309 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:25.275043 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:25.257222  2912 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:25.340814  2912 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:25.341284  2912 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:25.324640  2909 consensus_meta.cc:287] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.003s
I20260709 13:11:25.343096  2909 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.242162  3127 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:25.346041  2909 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.241073  3128 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:25.346985  3128 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:25.286083 30450 leader_election.cc:336] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 2.196s (SENT)
I20260709 13:11:25.270969  2585 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:25.186380 30302 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:25.312307  3102 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:25.290376  3007 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.273152  3075 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:25.283224  2983 consensus_meta.cc:287] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.007s
I20260709 13:11:25.209831  3111 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.236364  3069 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:25.322093 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 378461us
I20260709 13:11:25.335654 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:25.337842 30523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.046s	sys 0.058s
W20260709 13:11:25.491314 30523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.047s	sys 0.058s
I20260709 13:11:25.287885  2992 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.491711 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 786932us
I20260709 13:11:25.492116  2992 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.492874 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:25.340080 30411 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.348737 30450 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:25.318616  3025 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 13:11:25.495186  3025 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.497722  3025 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.349331  2585 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.498963  2585 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:25.499581  3140 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:25.339277  3031 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:25.431773  2179 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.501012  2179 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.501186  3031 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.438036 30404 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:25.452994 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:25.502185  3043 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:25.502501 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 49607.4us
I20260709 13:11:25.503137  3043 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.507869  3104 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.508584  3104 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.511130 30376 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:25.513860  2179 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:25.514380  2179 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.515424  2382 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:25.515797  2382 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:25.516424  2179 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.516583  2382 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.517956  2179 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.518126  2382 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:25.518585  2179 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.348421  2883 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:25.527855 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 272682us
I20260709 13:11:25.528867 30374 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:25.350911  2909 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:25.560025 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.568976 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 76181.5us
W20260709 13:11:25.569609 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 283562us
I20260709 13:11:25.570436 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:25.573963 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 63186.6us
I20260709 13:11:25.575335 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:25.578730  2179 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.585875  2179 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.392728  2884 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:25.428649  3075 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.500126  3140 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.644654 30411 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:25.569430  2992 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.644512 31151 consensus_queue.cc:237] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.615604  2909 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:25.661125 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.428220  3007 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:25.661834 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 519604us
I20260709 13:11:25.519083  2983 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.628542  3075 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.636832  3104 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.627552  3032 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.632648  3102 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:25.673377 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:25.684329 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 114023us
I20260709 13:11:25.683542 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:25.691418 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.691561 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:25.691921 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.351725 30302 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 13, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 13 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.667368  3157 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.695000 30450 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Timed out: RequestConsensusVote RPC to 127.28.152.1:33099 timed out after 1.543s (SENT)
I20260709 13:11:25.667150  3131 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:25.682200  3084 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.808s	user 0.004s	sys 0.015s
I20260709 13:11:25.673910  2992 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:25.703263  3165 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:25.704304  3144 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:25.707345  2909 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.707917  3007 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.712132 30302 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 9, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 9 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.716970 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:25.720229 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 146787us
I20260709 13:11:25.684026  3032 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.688891  3022 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:25.682535  3154 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:25.728873  3148 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:25.721431  2883 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.731427  3069 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.695290  3159 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:25.689078  3104 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:11:25.774571  3014 consensus_meta.cc:287] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.003s
I20260709 13:11:25.774994  3014 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.776131  3111 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.777201  3014 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.730472  3131 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.751935 30302 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.779359 30302 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.782845  2732 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:25.783435  3128 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.783450  2732 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.785454  3128 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.786170  2732 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.787815  3128 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:25.715764  3157 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.746547  3155 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:25.748314  2939 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:25.751072 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.781049 30302 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 4 to 8, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 8 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:25.753137  3048 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.754734  3145 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:25.755178  3154 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:25.750051  2912 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.755537  3162 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.756475  2983 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.756804  3032 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.741133  3022 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.744102  2883 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.734622  3140 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:25.740324  3150 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:25.763770  2382 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.766808  3161 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:25.768075  3133 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.597s	user 0.007s	sys 0.000s
I20260709 13:11:25.723292  3084 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.773669  3127 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.789705 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:25.688393  3102 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.813182  3022 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:25.801473 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.838790  3150 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:25.916532  2912 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.916460  3150 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.917989  2946 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:25.918426  2946 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:25.920135  3084 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.839448  3161 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:25.922802  3133 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:11:25.923651  3026 consensus_meta.cc:287] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.002s
I20260709 13:11:25.924055  3026 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.832986 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:25.812208 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 236956us
I20260709 13:11:25.725103  2992 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.800212  3145 consensus_queue.cc:1243] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:25.799376  2939 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.828315  2883 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.932165  3157 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:25.932603 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.933393  3031 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:25.836421 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:25.765825  2585 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.935361  2996 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.936239  2856 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:25.936889  2856 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.937388  2585 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.889361  2732 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:25.938385  2732 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.940995  2732 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.890872  3102 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.830801  3162 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:25.896217  3032 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:25.898566  3137 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.546s	user 0.000s	sys 0.001s
I20260709 13:11:25.798985  3155 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.945170  3162 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.946276  3155 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:25.935357 31145 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 11: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:25.800195 30302 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 11, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:25.948832  2992 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.837265  2382 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:25.905292 30486 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:25.797483  2884 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:25.954596  2382 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:25.807678 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 63096us
I20260709 13:11:25.908200 30482 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:25.839287  2932 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:25.919991  3127 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:25.985422 30556 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:11:25.985715 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:25.976246 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:25.987988 30451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.027s	sys 0.034s
W20260709 13:11:25.988329 30451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.027s	sys 0.034s
W20260709 13:11:25.988587 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 719371us
I20260709 13:11:25.975260 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:25.988722 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.989363 30411 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:25.990847 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.992754 30404 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:25.995464 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.996213 30404 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:26.005187 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.009186 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.009979 30485 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 20.
I20260709 13:11:26.011068 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.011487 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.011636 30551 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:26.012259 30485 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:26.013859 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.014052 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.016635 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.015242 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.017951 30485 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
I20260709 13:11:26.015257 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.019491 30551 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.020728 30553 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:26.020854 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.021384 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.024296 30559 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:26.022259 30478 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:26.025323 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.025933 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.026723 30558 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:26.028566 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.028990 30556 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:26.029484 30553 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:26.022931 30451 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.023644 30552 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:26.030937 30451 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.036557 30551 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:25.999110  2675 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.001047  2382 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:26.057564 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.042626 30403 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:26.058637 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.044368 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.045499 30478 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:25.955009  2884 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.061165 30405 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:26.047101 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.062252 30555 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:25.998970  3157 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.040544 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.055512 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.046207 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.063452 30557 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:26.064530 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.064843 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:25.966372  2932 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.066052 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:25.920046  2946 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.067209  2946 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.067752  2884 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.068322 30411 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:26.069732 30484 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:11:26.021736  3161 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.023092  3102 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:26.071292 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.024999  3080 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.037806  3155 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.045758  3032 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:26.078166 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.079905 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.045336  2585 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:26.083397 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.092298 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.093487 30559 raft_consensus.cc:2410] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:11:26.087417 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.091536 30553 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:26.094383 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.097235 30411 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.090723 30477 raft_consensus.cc:2410] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:11:26.104494 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.105648 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.106518 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.107079 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.108541 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.109346 30553 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:26.090999 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.103320 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.110569 30553 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:26.111979 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.110839 30551 raft_consensus.cc:2368] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15.
I20260709 13:11:26.073904  3145 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.057740  2675 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.117136 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.077497  3155 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.123879 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.138878  3111 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.138928  3169 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:26.139511 30558 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:26.139952  3169 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:26.140333  3169 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:26.140590 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.141177 30558 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
I20260709 13:11:26.141137  3169 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.121485 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.142220 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.134511 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.126174 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.126186 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.076321  3168 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.127432 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:26.129346 30411 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:26.079978  3080 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.078042  2887 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:11:26.078948  2382 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.115546  3032 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.091778  3102 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.131461  3128 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:26.132129  2585 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.133872 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.103664  2992 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:26.116071  3154 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:26.138069  3075 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.163203 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.191563 30481 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:26.142683  3169 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.193558 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:26.167754 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.169814 30560 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:26.170020 30559 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:11:26.139348  3155 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.163837 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.214875 30411 raft_consensus.cc:2393] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:26.215903 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.216768 30411 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:26.152302 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:26.171360 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 476460us
I20260709 13:11:26.144644 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.220265 30553 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:26.174803 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.188550  2992 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.114925  3026 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.078759  3157 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.124490  2884 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:26.158490 30555 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:26.167758 30557 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:26.164445 30405 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:26.227654 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.229123 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.144146 30451 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.178786 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.230755 30558 raft_consensus.cc:2410] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:11:26.142863  2856 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.139503  3111 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.180496 30409 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.181181 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.267190 30483 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:26.182003 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.186021 30552 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:26.169384  3059 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:26.290231  3102 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.289927  3059 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.291785  2732 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:26.292074  2675 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.292953  3059 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.293890  2732 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:26.293681  3032 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.294296  2732 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:26.296548  3162 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.297328  3162 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.300094  3022 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.300782 31152 consensus_queue.cc:237] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.302985  3080 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.303766  2939 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.303651  2732 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.305053  2732 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.305349  2382 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.265944  2883 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.207160 30559 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:26.213390 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.142997  3145 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:26.220573 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68367.9us
I20260709 13:11:26.314885 30552 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:11:26.316215 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47195.6us
I20260709 13:11:26.091500  3127 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:11:26.213994 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 404156us
I20260709 13:11:26.190444  3154 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.222390 30407 raft_consensus.cc:2393] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:26.222998 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.232127 30556 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:26.233477 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.231045 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.236428 30560 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:26.236989 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:26.265317 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.187466  3084 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:11:26.270648 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.340387 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:26.270507  2585 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.271238  2932 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.224439  3165 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:26.271607 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 127522us
I20260709 13:11:26.234906  2884 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:26.272233  3131 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.272253  3111 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.273095  3174 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:26.275673 30524 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:26.355664 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.356305 30484 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.277419 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:26.278294 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.278882 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.357123 31147 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:26.357479 31153 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:26.279109 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.279528 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:26.279608 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:26.287680 30409 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
W20260709 13:11:26.358980 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 79535.4us
I20260709 13:11:26.328055 30554 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:26.338145 30552 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:26.222507  2992 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.338488  3154 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.178444  3168 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.339030  3022 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.339084  3075 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.350642  2946 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.348346 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.348483 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:26.376328 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.347874 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.354815 30557 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:26.288560  3157 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:26.362170 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 86594.1us
I20260709 13:11:26.362246 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.364566 30483 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:26.365797 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.366530 30404 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:11:26.368350 31152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:26.373746 30481 pending_rounds.cc:85] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:11:26.374176 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:26.378746 30481 pending_rounds.cc:107] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:11:26.378963 30483 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.352300  2884 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.377599 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.379073 30481 raft_consensus.cc:2889] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:26.327757  2920 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:26.391530 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:26.405108 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.403631 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.407182 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.395483 31144 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:26.409082 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.349434  3109 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:26.410146 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:26.376827  3177 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.394937 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:26.427901 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.403611  3157 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:26.407905  3022 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:26.414553 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.403713  3084 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:11:26.417582  3178 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.418445 31148 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:26.405151  3150 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:26.420240 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 56643.3us
I20260709 13:11:26.421599  3171 consensus_queue.cc:1059] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:26.422849 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.400115 30484 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:26.436093 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.457360 30477 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.404237  2883 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.366526  3131 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.393237  3172 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:26.383553  3048 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:11:26.412838 30483 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:26.392666  2946 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.408069  2920 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.459223 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.463207  3152 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:26.462433 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.424396  2755 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:11:26.470979 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.473363 30551 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 12. Ops: []
I20260709 13:11:26.466580  3178 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:26.440452  3159 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:26.467397 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44681.2us
I20260709 13:11:26.440637  3069 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:26.488121 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.488745 30405 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.488893 31152 raft_consensus.cc:606] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.489374 31152 raft_consensus.cc:614] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.488758 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:26.492451 30402 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.492619  3127 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:26.493044  3127 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.442818  3157 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.468590  3022 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:26.478902 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.479521 31149 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:26.479594 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.469111  3171 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:26.501127 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.512956 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.454860 31117 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:26.513962 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59246.6us
I20260709 13:11:26.510291 30477 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:26.470026 30484 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.468374  3162 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.468113  3152 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:26.521842 30402 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:26.461316  3150 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.500758  3178 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.524081 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.475520  3104 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:11:26.503968  3159 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:26.539917 30408 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:26.517510  2883 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.551528 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.541788  2884 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.509034  3171 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:26.528102  3022 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.545917 30484 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:26.517745  2949 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:26.550271 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:26.564908 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 247314us
W20260709 13:11:26.565639 30376 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.601s (SENT) [suppressed 16 similar messages]
I20260709 13:11:26.529045 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.550541 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.529419 30405 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:26.477339  3168 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.548858  3140 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:26.568989 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 221171us
I20260709 13:11:26.435223  3073 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:11:26.437094  3181 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.158s
I20260709 13:11:26.580914 30406 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:26.580832 30374 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.508549  3183 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:11:26.622396 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:26.579190 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:26.630614 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.569476  3174 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.641736 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.649488 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.652099 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:26.653915 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:26.547073  3127 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.567809  3131 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.580375  2949 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:26.630103  3075 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:26.669337 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.537150  3159 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.537024  3178 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:26.676898 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 243195us
I20260709 13:11:26.656486  3084 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:26.657112  3140 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:26.556183  2992 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.618947  3168 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:26.688100  2382 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:26.673115 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 216590us
I20260709 13:11:26.688484  2382 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:26.685314 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 119414us
I20260709 13:11:26.685276 31144 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:26.683517  3075 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:26.660363  3172 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:26.661249  3171 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.679847  2920 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.571024  3152 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.693063  3075 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.689667  3127 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.675341  2883 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:26.693248  3171 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.689268  3084 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.693486  3026 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.707590  2946 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.720477  2949 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:26.718350  3191 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:26.720072  3026 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.718683  3174 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.725159  3150 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.726125  3128 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:26.726246  3189 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:26.711308  3152 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.726655  3128 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:26.714953  3157 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.728287  3155 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.737165  3109 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:26.737607  3109 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:26.737664  3155 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.735416  3128 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.738238  3145 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.726285  3026 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.740554  3128 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.746870  3084 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:26.758849  3197 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:26.768467  3154 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:26.776932  3198 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:11:26.821118 30409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:26.822935 30409 raft_consensus.cc:606] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:26.826494 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.828159 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 453888us
I20260709 13:11:26.829813 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:26.833495 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 179640us
I20260709 13:11:26.835280 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:26.835829 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:26.837708 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:26.838728 30411 raft_consensus.cc:606] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.839228 30411 raft_consensus.cc:614] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.843700 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.844489 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:26.845367 30477 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:26.845738 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.847143 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.848476 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.851130 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:26.852499 30481 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:26.853956 30480 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:26.838677 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:26.855399 30482 raft_consensus.cc:2393] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:26.857985 30484 raft_consensus.cc:1240] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:26.859673 30482 raft_consensus.cc:1275] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:26.859840 30484 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:26.860953 30480 raft_consensus.cc:1240] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:11:26.864492 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:26.870911 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.871474 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.872579 30554 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
W20260709 13:11:26.878407 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.878983 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:26.879400 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:26.880314 30411 raft_consensus.cc:606] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.880836 30411 raft_consensus.cc:614] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:26.881577 31116 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:26.818328 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 239006us
I20260709 13:11:26.884686 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:26.922401 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 79706.8us
I20260709 13:11:26.924356  3161 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:26.928483  2992 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:26.933465 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.948158  2856 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:26.738602  3109 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.949368  2856 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.950757  3182 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.951162  3183 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.951494  2939 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.952247  3155 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:26.953166  2884 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.955627  3177 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:26.956970  3212 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.957787  3212 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.961277  3212 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:26.961438  3154 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:26.962968  3178 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.934759  3206 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:26.964298  3206 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:26.950805  3109 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.971140  3059 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:26.972220  3032 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:26.952291  2939 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:26.976497 30374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.977456  3169 consensus_meta.cc:287] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
I20260709 13:11:26.978417  2939 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:26.984534 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 146221us
I20260709 13:11:26.987167  3172 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.987726 30483 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:26.989800 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:26.992009  3089 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.991616  3004 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 5 to 11, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:26.992733  3089 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:26.993916 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:26.996156  3089 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:26.997102  3089 consensus_queue.cc:1059] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:26.991793  3140 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:26.965984  3206 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:26.981040  2755 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:27.002187 30552 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 5 to 11, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:26.985747 30554 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:26.951416  3182 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.008203  3182 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.008555  3209 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:27.009085 30477 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
W20260709 13:11:27.009843 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 86060.4us
I20260709 13:11:27.010396 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.011680 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:27.013553 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.008239 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.008626  2856 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.025696 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:27.037263 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.042158  2675 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:27.047104  2675 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.049922  2675 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.054845  3131 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.054986  2585 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.055500  3131 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:27.055581  2585 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:27.055883 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 116547us
I20260709 13:11:27.056092  3131 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.056574  3080 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.057057  2996 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:27.057536  2996 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:27.060667  3059 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.022392  2992 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:11:27.065400 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:27.066323 30402 raft_consensus.cc:606] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.066841 30402 raft_consensus.cc:614] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:27.024709  3032 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:27.067909 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.033614  3178 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:27.069164  3181 consensus_queue.cc:1048] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:11:27.071296  3178 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.071079  2585 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.071758  3178 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.072305  2585 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.057528  3080 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:27.058571 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.075740  3013 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:27.075989  3080 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.076260  3013 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:27.076753  3080 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.077271  3080 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.077701  3013 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.041401 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.079380  2856 raft_consensus.cc:993] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
W20260709 13:11:27.079934 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 86673.1us
I20260709 13:11:27.080369  3162 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:27.082942 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 46574.5us
I20260709 13:11:27.083184  2923 consensus_queue.cc:1059] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:27.085083  2946 raft_consensus.cc:3055] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:27.085513  2946 raft_consensus.cc:740] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:26.713272  2382 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.086799  2884 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.086877  2946 consensus_queue.cc:260] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.088052  2939 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.080029  2856 raft_consensus.cc:1081] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:27.088755  2939 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.091498 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:27.091857  2946 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.093405 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.094167 30558 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:27.095278 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.087805  2884 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.096335 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:27.096530  2939 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.097311 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.097786  2884 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.098629 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.099499  2996 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.101444  2996 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.095327 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.104031 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:27.104701 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.106277 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.106390 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.099520 30559 raft_consensus.cc:2393] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:27.107195 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.107296 30481 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:27.106833 30483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:27.111073  3013 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.112217 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:27.066985  3150 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.112828 30402 raft_consensus.cc:606] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.115588 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:27.078097 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.078208  3161 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:27.122576  3161 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:27.123301 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45338.2us
W20260709 13:11:27.128032  3022 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.005s
I20260709 13:11:27.129468 30486 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:27.096598 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.155644  3182 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.157589  3210 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.158325  3210 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.161605  3022 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.123351  2755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60524 (request call id 2) took 2353 ms. Trace:
W20260709 13:11:27.162669  3111 consensus_meta.cc:287] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.008s
I20260709 13:11:27.167069 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.168295  3075 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.169559 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:27.173321 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.174518 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 160064us
I20260709 13:11:27.250360 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.247666 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:27.167322  3210 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:27.229535  3059 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.178408  3075 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.163291  3150 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:11:27.274683 30450 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:27.280359 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.281353 30410 raft_consensus.cc:2410] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:11:27.277522  3152 consensus_meta.cc:287] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.548s	user 0.015s	sys 0.000s
I20260709 13:11:27.282763 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.281363  3231 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.283614 30407 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:27.283622  3231 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:27.243979  3111 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.284593 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.284825  3231 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.285444 30403 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:27.286141 30405 raft_consensus.cc:1275] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:27.279088 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.287634 30409 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:27.260331  3182 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:27.261700  3171 consensus_meta.cc:287] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.542s	user 0.002s	sys 0.011s
W20260709 13:11:27.262178 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 248834us
I20260709 13:11:27.261900  3178 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:27.263088  3127 consensus_meta.cc:287] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.003s
I20260709 13:11:27.263126 30481 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:27.279826 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.272120 30408 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:27.274350 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.300499 30406 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:27.282392 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.252804 30477 raft_consensus.cc:2393] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:27.284632 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.264254 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.275488 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.303274 30402 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:27.303476 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:27.303828 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.304180 30481 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:27.304832 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.243891  2996 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.166682  2755 rpcz_store.cc:276] 0709 13:11:24.769461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.769826 (+   365us) service_pool.cc:224] Handling call
0709 13:11:25.632987 (+863161us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b580048b9d0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450050aa 00007fa045087447 00007fa0450a470a 00007fa0450a576a 00007fa0450a491b 00007fa0450b003c 00007fa0450af6b3 00007fa0450a79fa 00007fa04a06f4c9 00007fa0435ebc54
0709 13:11:25.694036 (+ 61049us) log.cc:844] Serialized 494 byte log entry
0709 13:11:26.307485 (+613449us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b54005972a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045029b26 00007fa04502349a 00007fa045022714 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354
0709 13:11:26.408421 (+100936us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b54005972a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045022142 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354 000000000038f199 00007fa041fbc475
0709 13:11:26.725073 (+316652us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54005972a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa04501edbe 00007fa045029930 00007fa0450298d8 00007fa045029858 00007fa045029813 00007fa045028a9c 00007fa04af14626 00007fa04af0edd8 00007fa0450657cb 00007fa0450682c0
0709 13:11:27.081212 (+356139us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54005972a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045029b26 00007fa04502349a 00007fa045022714 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354
0709 13:11:27.123251 (+ 42039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16,"raft.queue_time_us":2780,"raft.run_cpu_time_us":19041,"raft.run_wall_time_us":1322037,"spinlock_wait_cycles":1085499008,"thread_start_us":295147,"threads_started":1,"wal-append.queue_time_us":572069}
I20260709 13:11:27.306399 30404 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 9.
I20260709 13:11:27.276818  3075 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.282153 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:27.302122 30403 raft_consensus.cc:1240] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:27.305423 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 129538us
I20260709 13:11:27.286535  3111 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.311684 30411 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.311795 30478 raft_consensus.cc:2410] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:27.311875 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.313521 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e1b5d40df944767ab310e2bd822d5b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:27.313832 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.314819  3152 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.314862  3075 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.317070  3075 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:27.317713 30486 raft_consensus.cc:1275] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:27.318678  3178 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.321810 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.322412 30558 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.323343 30552 raft_consensus.cc:1240] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:27.323447 30559 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:27.323879  3128 raft_consensus.cc:2764] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:11:27.324371 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.324920 30559 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:27.325708 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:27.325903 30552 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:27.326247 30559 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:27.326680  3214 consensus_queue.cc:1059] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:27.327554 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:27.327939  3214 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:27.328152  3202 raft_consensus.cc:3055] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:27.328338 31149 raft_consensus.cc:2410] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:27.328586  3202 raft_consensus.cc:740] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:27.329578  3202 consensus_queue.cc:260] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.333415 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:27.330004 30558 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 19.
I20260709 13:11:27.328387  3214 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:27.335772  3214 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.278226  3150 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:27.367625 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.349723 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.282212  3162 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.386231 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.388017 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.414914 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.415283 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:27.415659 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48145.4us
W20260709 13:11:27.416067 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 90521.1us
I20260709 13:11:27.385650  3111 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.419432 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:27.420553 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 170373us
I20260709 13:11:27.421269 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.423332  3162 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:27.429102 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:27.430047 31118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.432063 30556 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.387156  3150 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:27.421746  3214 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.437731 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:27.434854 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.381774 30406 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:27.430260  3202 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.440994  3111 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.446460 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:27.449198  3111 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.441674 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.390304  3131 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.459396 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:27.462873 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:27.462990 30374 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.468770 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.471796  3147 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.472395  3147 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:27.472815  3147 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.473047 30479 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:27.468349  2946 consensus_queue.cc:1048] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:27.470801  3152 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:27.474874  3152 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:27.475406  2912 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:27.476344 30451 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.476969  2912 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:27.477926 30480 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:11:27.478331 30480 pending_rounds.cc:85] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:11:27.479837  2585 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.479908  3155 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:27.480525  2585 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:27.481565  2585 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:27.482401 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47640.1us
I20260709 13:11:27.475426  3152 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.483363  2992 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:27.483759  2992 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.484134  2992 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.486312 30556 raft_consensus.cc:2468] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:27.490844 31118 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:27.463896  3214 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.467592  3111 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:27.499709  3111 consensus_queue.cc:1243] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:27.500500 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.478590 30480 pending_rounds.cc:107] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:11:27.501139 30480 raft_consensus.cc:2889] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.501415  3182 raft_consensus.cc:2804] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:27.502000  3182 raft_consensus.cc:697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:27.503021  3182 consensus_queue.cc:237] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.471925  3075 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.510072  3075 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.510466  3075 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.500276  3161 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.512892 30483 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.513293 30483 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:27.515499  3225 log.cc:927] Time spent T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:11:27.510972 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:27.518918 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.519840  3059 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.520099  3161 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.494410  3150 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.521646  3150 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.522179 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:27.522989  3059 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.523371  3059 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:27.523851  3059 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.450618  3080 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.528638 30403 raft_consensus.cc:1240] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:27.529711  3080 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.536114 30411 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:27.544122  3080 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:27.545463  3214 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:27.544564 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 44151.2us
I20260709 13:11:27.540016 30483 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.551474 30376 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.553382 30376 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.554944 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.556479  2884 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:27.560923  2887 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.563922  2382 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.564697 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:27.552807  3111 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.570233 30479 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:27.573464 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.574111 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:27.575457 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:27.578733  2946 consensus_queue.cc:1048] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:27.579205 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.583941  3131 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.573374 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:27.588706 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 167645us
I20260709 13:11:27.589844 30525 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:27.590828 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 137168us
I20260709 13:11:27.592375 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.593719 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.593950  3206 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:27.594416 30558 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.594515  3206 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:27.595954 30560 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:27.595700  3206 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.596192 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.597364  3147 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.579208 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:27.612277  3212 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.613567  3212 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:27.614025  3212 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:27.615917 30558 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:27.617954 31146 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:27.625365  2992 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:27.636153 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 197758us
I20260709 13:11:27.636487  3171 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.636780  3059 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.637151 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.638615  2883 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.639632  3102 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:27.640049 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 61081.1us
I20260709 13:11:27.640820  2946 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.641378  2920 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:27.638921 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.643199 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:27.645767 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:27.645826 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.652235  3102 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:27.653074  3102 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.655877 30486 raft_consensus.cc:2955] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 5 to 11, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:27.658041 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.658725 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.659349 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.660055 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.685905 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.686741 30406 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:27.642953  3147 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.694917 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.701296 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.642948  2992 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.714187 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:27.692593  3161 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:27.718626 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59361.9us
I20260709 13:11:27.722344 30408 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:27.722373 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.725962  2949 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.727293 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:27.728039 31146 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:27.730085 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 91246.6us
I20260709 13:11:27.730403 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:27.731293 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.731724  2996 raft_consensus.cc:2764] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:11:27.687009  2755 consensus_queue.cc:1059] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:11:27.732447  3128 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.737264 30478 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:27.709290  2585 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.715894  3216 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.747857 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.749209  3022 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:27.755111  2755 raft_consensus.cc:3055] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:27.707000  3212 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.708925  3202 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:27.756381  3210 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:27.758450  3182 consensus_queue.cc:1059] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:27.759207 30483 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.760092  3152 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.760607  3102 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:27.764714 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.765313 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.788949 30405 raft_consensus.cc:2410] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:11:27.765952 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.789494 30409 raft_consensus.cc:2468] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:27.702518  2920 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:27.723263  3059 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:27.767042 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.771039 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:27.772471 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:27.773502 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.743927  3161 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:27.776882 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:27.779789 30479 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:27.781080 30408 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 21: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:27.786175 30402 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:27.780285  2755 raft_consensus.cc:740] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:27.813743 30406 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:27.818415 30402 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:27.821441 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.787657  3216 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:27.834873 30411 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:27.793813  3178 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.835750 30409 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 19: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:27.838038 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.780468  3128 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.842000 30405 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:27.840574 30408 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:11:27.804937  3022 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:27.822829  2949 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.850832 30402 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:27.853278 30411 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:27.854346 31150 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:27.815433  3210 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:27.860131 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 93243.9us
I20260709 13:11:27.848131  3162 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.865113 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.878063 30411 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.906636 30556 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:27.915499 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:27.919317  3131 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:27.919586  2932 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:11:27.919890 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:27.920266 30450 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:27.920989 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:27.921550 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.921950 30404 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:27.888659  3162 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:27.920570  3022 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.921540 30405 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:27.925462 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:27.966898 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 147898us
I20260709 13:11:27.923923  3131 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:27.945705  3257 log.cc:927] Time spent T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:27.951179  3059 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.876945  3161 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.988732 30411 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:27.908793  3075 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:27.970867 30405 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:28.004240 30408 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:27.944345 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:28.007521  3162 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:28.009814 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 99092.1us
I20260709 13:11:28.011772 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.013506 30404 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:28.017844 30555 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.976177  3152 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.037066 30411 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:27.900022  2755 consensus_queue.cc:260] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:27.848016  3147 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:27.978645  2992 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:11:28.059257 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 140115us
I20260709 13:11:28.021067  3171 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:27.968950  3216 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.069470 30556 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:28.043458  3004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60524 (request call id 5) took 1737 ms. Trace:
I20260709 13:11:28.042598  2883 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.075105  3075 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:28.077121  3259 log.cc:927] Time spent T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:28.078712  3128 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.043900  3059 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.101840 30450 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:28.093668  3102 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.095811  2920 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.110128  3131 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.093356 30480 raft_consensus.cc:2955] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:28.109972  3102 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:28.140913 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.146095  3102 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.148852 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:28.104945  3266 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:11:28.150470 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:28.071583  3004 rpcz_store.cc:276] 0709 13:11:26.290097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.298866 (+  8769us) service_pool.cc:224] Handling call
0709 13:11:26.307873 (+  9007us) log.cc:844] Serialized 494 byte log entry
0709 13:11:27.986645 (+1678772us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16171,"raft.run_cpu_time_us":1177,"raft.run_wall_time_us":11053}
I20260709 13:11:28.158620  3202 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.179086 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:28.179946 30376 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.177409 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:28.178967 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:28.186803 30481 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 18. Ops: []
I20260709 13:11:28.189653 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:28.192694 30478 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:28.194952  2946 raft_consensus.cc:3055] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:28.196053  3270 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:11:28.195971  3152 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.198582  2382 consensus_queue.cc:1059] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.199568  3075 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.200542  3210 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.206261 30483 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:28.186257  3202 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:11:28.206717  3059 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:28.239719 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63736.5us
I20260709 13:11:28.214756  2992 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:28.186260  3102 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:28.217927 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:28.218134  3168 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:28.190335 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:28.219313  3268 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:11:28.219244 31150 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:28.223981 30555 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:28.227667  3150 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.228827 30560 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:28.234845 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:28.229230  2946 raft_consensus.cc:740] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:28.243042 31144 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:28.249655 30481 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:28.236904  2883 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.252542 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:28.254976 31146 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:28.259626 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.262568  3272 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:28.262989  2946 consensus_queue.cc:260] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.265406 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:11:28.269011 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 215000us
I20260709 13:11:28.269629  3147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60524 (request call id 0) took 3507 ms. Trace:
I20260709 13:11:28.269982 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.277179 30482 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
W20260709 13:11:28.281437  3245 log.cc:927] Time spent T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.477s	user 0.000s	sys 0.002s
I20260709 13:11:28.281997  2996 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:28.282675  2996 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:28.283238  3250 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.386s	user 0.003s	sys 0.000s
I20260709 13:11:28.270103  3147 rpcz_store.cc:276] 0709 13:11:24.762023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.764926 (+  2903us) service_pool.cc:224] Handling call
0709 13:11:24.889457 (+124531us) log.cc:844] Serialized 494 byte log entry
0709 13:11:25.778365 (+888908us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b18003dbfa0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa045002b0b 00007fa045087b63 00007fa0450af752 00007fa0450a79fa
0709 13:11:28.269545 (+2491180us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":417,"mutex_wait_us":470806,"raft.queue_time_us":505166,"raft.run_cpu_time_us":1500,"raft.run_wall_time_us":25325,"spinlock_wait_cycles":15969024,"thread_start_us":329355,"threads_started":1,"wal-append.queue_time_us":632120,"wal-append.run_cpu_time_us":2790,"wal-append.run_wall_time_us":1192499}
I20260709 13:11:28.283691  2996 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.284934  3131 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.249828  3075 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.298954 31149 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.259379  3168 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.303458 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:28.305848  3280 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:28.256263  3102 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.305595  3278 consensus_queue.cc:1059] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:28.306385  3280 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:28.268018  3128 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:28.264569  3231 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:11:28.308306 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 82789.8us
W20260709 13:11:28.318747 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51970.3us
I20260709 13:11:28.320740 30409 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:28.323585 30450 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:28.310092  2946 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.382880  3131 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:28.375264 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51773us
I20260709 13:11:28.314064  3280 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.387166 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:28.392246  3168 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.392751  3168 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.393186  3168 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.400205  3280 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.402921  3131 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:28.406795  2946 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.407387  2946 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.408459  3280 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.409580  2946 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.415439  3131 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:28.415907 30479 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.416203  3131 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.418495  3131 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.412113 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba4c05796efa42489d11c8a49ba476ad with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
W20260709 13:11:28.427728 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 188659us
I20260709 13:11:28.431360 30560 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:11:28.447722 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.447364 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:28.375398 30410 raft_consensus.cc:2955] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:28.325241  3178 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:11:28.324932  3202 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:11:28.461951 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:28.427462  2382 consensus_queue.cc:1243] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:28.427609  3286 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:28.483002 30560 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:28.529400 30479 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:28.489231  3147 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:11:28.499425  3286 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:28.547967 30406 raft_consensus.cc:3055] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:28.547626  3286 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.548394 30406 raft_consensus.cc:740] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:28.549152 30406 consensus_queue.cc:260] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.550339 30406 raft_consensus.cc:3060] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.553128 30405 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.554379 30405 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.504102  3168 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:28.536535  3284 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:28.541958 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:28.535461  3287 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.577360 30409 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:28.577632 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:28.597134 30402 raft_consensus.cc:2468] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 8.
I20260709 13:11:28.582151  3161 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.584661  3279 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:28.585232 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:28.585631  3152 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.585893  3026 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:28.586853 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 306712us
I20260709 13:11:28.586759 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:28.588474 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 318593us
W20260709 13:11:28.588991 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 286863us
I20260709 13:11:28.589720  3283 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:28.590241  3216 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.567858  3182 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:28.601574 30406 raft_consensus.cc:1275] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:11:28.632205 30406 pending_rounds.cc:85] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 9
I20260709 13:11:28.632515 30406 pending_rounds.cc:107] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:11:28.632805 30406 raft_consensus.cc:2889] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.605218 30405 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:28.611850 30407 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:28.635052 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.618530 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:28.624336 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:28.619269  3283 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:28.611608  3279 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:28.639568 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:28.640031 30555 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:11:28.615733  3026 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:28.644354 30556 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:28.639356  3283 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:28.637882  3150 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:11:28.647037  3296 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:28.647500  3296 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.647861  3296 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.664857  3260 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.665382  3260 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:28.665743  3260 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.634756  3075 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.673899  3283 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.674858  3210 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.675523  3210 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.675879  3026 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.676503 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:28.677110  3026 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.677582  3210 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:28.621182  3152 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:28.679597 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.680428  3152 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.681845 31144 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:28.638064  3206 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.683794  3206 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.685415 30485 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:28.685743  3206 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:28.643544  3109 consensus_queue.cc:1048] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:11:28.614198  3161 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:28.693221 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 72572.1us
I20260709 13:11:28.737334 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:28.738889 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.635987  3162 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:11:28.637980  3287 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.751588 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:28.731540  3022 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.738797  3109 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.737463  3131 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.737805  3152 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.752638  3278 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:28.754510  2992 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.758769  3022 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:28.765275  3272 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:28.766654  3278 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.787235  3075 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:28.787963  3075 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.790462  3075 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:28.795989 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.811292 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 224636us
I20260709 13:11:28.763588  3109 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.766058  3131 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.766855  3152 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.770923  2585 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:28.826649  3161 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.803427  3278 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.783507  3272 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:28.777581  3206 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:28.833804 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:28.763757  3279 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.837662 30524 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:28.838603  3216 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.843210  3216 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.845332  3216 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:28.846392 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:28.852880  3216 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:28.853479  3216 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:28.853149  3022 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.854305  3022 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.856673  3283 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:28.782058  2992 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:28.905326 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 139998us
I20260709 13:11:28.833089  3272 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.907472 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:28.912000 31119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.809492  3296 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:28.920084 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 82546us
W20260709 13:11:28.926180 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 113338us
I20260709 13:11:28.914997  2883 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.932775 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.854446  3216 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:28.918233  3280 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:28.922214  3279 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.943756  3309 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.945254  3309 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:28.946048  3231 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.953122  3260 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.955991  3287 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:28.957036  3131 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:28.924948  3128 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.940169  2585 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:11:28.978085 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.991878 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 76686us
W20260709 13:11:28.984131 30376 leader_election.cc:336] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.528s (SENT)
I20260709 13:11:28.994524 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:29.004961 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:28.977138  3280 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:28.940886  2883 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:28.977022  3168 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:29.053558 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:29.060762 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 132983us
I20260709 13:11:28.990351  3202 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.070164 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:28.993243  2585 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:29.106993 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:28.979782  3128 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.115537  3128 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:29.117117 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 63677.7us
I20260709 13:11:29.135327 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.066915  3287 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:29.161288 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 193828us
I20260709 13:11:29.164754  3131 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:29.165230  3131 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:29.165380  3296 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.165656  3131 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.158010  3307 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.166420  3307 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:29.168130  3314 log.cc:927] Time spent T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:11:29.168691  3307 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:29.181695 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.112794  3202 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.118744  3168 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.194010 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:29.160095  3128 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:29.194600 30376 leader_election.cc:336] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.601s (SENT)
I20260709 13:11:29.176355  3109 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.190565  3260 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:29.189319  3152 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.207716  3202 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.216401  2585 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.219466  2883 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:29.203136  2992 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:29.223002 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.224072 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:29.224897 31147 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:29.224212 30484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2660) took 1043 ms. Trace:
I20260709 13:11:29.226074 30484 rpcz_store.cc:276] 0709 13:11:28.181262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.191849 (+ 10587us) service_pool.cc:224] Handling call
0709 13:11:28.192231 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.220300 (+ 28069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.220328 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.227741 (+  7413us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.802189 (+574448us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18002bbb80. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:28.922673 (+120484us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:28.922737 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.922804 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.223837 (+301033us) raft_consensus.cc:1685] finished
0709 13:11:29.223863 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.224125 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27308,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5298,"spinlock_wait_cycles":3878144,"thread_start_us":118662,"threads_started":1,"wal-append.queue_time_us":764156}
W20260709 13:11:29.233276 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.239130 30376 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.644s (SENT)
I20260709 13:11:29.239784  2992 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:29.240506  2992 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.196070  3280 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.243117  2992 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:29.243769 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.245033  3272 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.248193  3109 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:29.248728  3109 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.243710 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:29.251103  3152 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.255782  3278 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.258411  3278 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.259179 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:29.262449 31149 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.278434  3109 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.280462  3102 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.280205  3131 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.282517 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:29.292431  3273 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 1.120s	user 0.002s	sys 0.003s
I20260709 13:11:29.296799 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.297444 30411 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:29.299047 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2210) took 1323 ms. Trace:
I20260709 13:11:29.299533 30551 rpcz_store.cc:276] 0709 13:11:27.975249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.975368 (+   119us) service_pool.cc:224] Handling call
0709 13:11:27.975712 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:28.091997 (+116285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.092025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:28.111578 (+ 19553us) log.cc:844] Serialized 52 byte log entry
0709 13:11:28.187765 (+ 76187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:28.248968 (+ 61203us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.580961 (+331993us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003bdee0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:11:28.581148 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.581217 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.294084 (+712867us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18003bdee0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:29.298773 (+  4689us) raft_consensus.cc:1685] finished
0709 13:11:29.298799 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.298959 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69525,"prepare.queue_time_us":27773,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":445131,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":3769,"spinlock_wait_cycles":45705216,"thread_start_us":96445,"threads_started":2,"wal-append.queue_time_us":162365}
W20260709 13:11:29.278681 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 212570us
I20260709 13:11:29.297462  3131 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:29.314670  3059 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:11:29.322541  3272 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.347640  2585 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:29.350315  3294 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.803s	user 0.000s	sys 0.009s
I20260709 13:11:29.352955  3059 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:29.353376 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 750) took 1641 ms. Trace:
I20260709 13:11:29.353538  3059 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.356057  3059 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.358940 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:29.358681  2996 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.359691 30484 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:29.359576  2996 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.377197 30478 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:29.378327 30481 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:11:29.378747 30481 pending_rounds.cc:85] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 6
I20260709 13:11:29.378958 30481 pending_rounds.cc:107] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:11:29.379209 30481 raft_consensus.cc:2889] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.379460 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.348253  2585 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.353760 30480 rpcz_store.cc:276] 0709 13:11:27.712259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.712383 (+   124us) service_pool.cc:224] Handling call
0709 13:11:27.733339 (+ 20956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.876221 (+142882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.876267 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.932499 (+ 56232us) log.cc:844] Serialized 494 byte log entry
0709 13:11:28.091412 (+158913us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:28.212727 (+121315us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.231344 (+ 18617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.351907 (+1120563us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18002d4900. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419
0709 13:11:29.353072 (+  1165us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002111d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:29.353119 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.353164 (+    45us) raft_consensus.cc:1685] finished
0709 13:11:29.353175 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.353304 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5688,"spinlock_wait_cycles":289489920,"thread_start_us":77945,"threads_started":1,"wal-append.queue_time_us":152255,"wal-append.run_cpu_time_us":3182,"wal-append.run_wall_time_us":1076630}
I20260709 13:11:29.377743 30478 pending_rounds.cc:85] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:11:29.394767 30478 pending_rounds.cc:107] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:11:29.395025 30478 raft_consensus.cc:2889] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.395603 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.396708 30479 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:29.390573 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.400091 30481 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:29.403956 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:29.404852 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.405465 30477 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:29.411746 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:29.412957 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.416112 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.418349  2585 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.420486 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.421388 30551 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:29.427595 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.439853 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.440652 30479 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:29.445783 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.448009 31149 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:29.449143  2585 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.449772  2585 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.433949  2755 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.453410 30486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43256 (request call id 756) took 1226 ms. Trace:
I20260709 13:11:29.453800 30486 rpcz_store.cc:276] 0709 13:11:28.227327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.510680 (+283353us) service_pool.cc:224] Handling call
0709 13:11:28.531580 (+ 20900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.560817 (+ 29237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.560856 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.561307 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.325297 (+763990us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800433840. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:29.427871 (+102574us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:29.427910 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.427973 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.447690 (+ 19717us) raft_consensus.cc:1685] finished
0709 13:11:29.447722 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.453347 (+  5625us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29965,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10312,"spinlock_wait_cycles":51983104,"thread_start_us":102395,"threads_started":1,"wal-append.queue_time_us":873355}
I20260709 13:11:29.455691 30376 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:29.457072 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.457722 30479 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:29.459600 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.461196  3059 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:29.464412  3059 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:29.465313  3059 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:29.471722  3331 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:11:29.454404  2996 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.475207 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.477133 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:29.452891  3147 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:29.480139  2585 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.472818  3212 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:29.484174 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.484215 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.485209 30479 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:29.488221 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:29.489534 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:29.491061 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:29.480917  3147 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.491664 30552 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.489403 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.503517 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.492455 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:29.493009  2585 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.513270 30552 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:29.515156 30479 raft_consensus.cc:1240] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:29.513577  3162 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:29.517391  3162 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.521899  3162 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:29.521962  3278 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.522811  3278 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.511832  2996 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:29.525435  2996 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.525827  2996 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.527388  3277 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:29.527935  3277 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.529475 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.530192 30406 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:29.530498 30411 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:11:29.530560 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.535009 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:29.537550 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:29.538304 30485 raft_consensus.cc:3060] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.531004 30411 pending_rounds.cc:85] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 8
I20260709 13:11:29.539525 30411 pending_rounds.cc:107] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:11:29.539844 30411 raft_consensus.cc:2889] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.531493 30551 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:29.529877  3277 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:29.543762 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.544051 31118 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:29.544425 30409 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:29.555516 30559 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:29.558622 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.557833 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.547211 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.565943 30479 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:29.556285 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.572609 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:29.573407 30551 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:29.589092 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.562103 30408 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:29.555955  3267 raft_consensus.cc:2804] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:29.534585  3013 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:29.585852 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.606276 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.607821 30450 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:29.587141 30402 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:29.600328 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.604085 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.610464 30406 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:29.617388 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.621136  2585 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.621673 30450 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.555570  3272 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:29.626210 30559 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:29.619230 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:29.623005 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:29.618197 30408 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:29.625036 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.624325  3161 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:29.630332  3161 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:29.630769  3161 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.630822  3327 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:11:29.635051 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:29.543157  3280 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:11:29.545281  3216 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:11:29.639437 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.555001  3277 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:11:29.604696  3013 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.644620 30555 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:29.647639 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.643518 30408 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
W20260709 13:11:29.649804 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47579us
I20260709 13:11:29.646143 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.621528  3178 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:29.654253  2585 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:29.654624  2585 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.654963  2585 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.628237  2992 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:29.654860 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:29.660643 31117 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.655875 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.615778  3315 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:29.658933 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.656038 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.636507  2382 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.659380  3286 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:29.676568  3286 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.677052  3286 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.648347  3150 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.652117  3320 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.657160  3013 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.657879  3178 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.651552  3202 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:29.665665  2992 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.696599 30485 raft_consensus.cc:2468] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:29.673607  3152 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.698874 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:29.638900  3272 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.685595  3324 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.684932  2932 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.691390  2946 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:29.684999  3320 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.684504  3278 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.691247  3178 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.699800  2992 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.701586  3298 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:29.702391  3152 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.725656 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:29.722214  2585 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.726451  3260 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:29.718357  2946 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.747849  2946 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.750880  3152 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.733986  3298 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.756956 30403 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:29.757640  3298 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.700111  3202 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.759763  3202 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.712982  3324 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.760690  3324 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.724663  2932 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:29.763103 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 99087.1us
I20260709 13:11:29.766368  2585 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.765127 31116 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:29.717186  3320 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.730655  3272 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.794651 30407 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:29.705700  3267 raft_consensus.cc:697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:29.797384  3267 consensus_queue.cc:237] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:29.804605 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.766220  3216 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:29.806949  3348 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.724776  3277 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:29.839344  3313 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:29.840276  3216 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.858796 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.785987  3280 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:11:29.868305 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:29.868414 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:29.873116  3168 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:29.874625  3216 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.931515  2585 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.934394  2585 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.936342 30485 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:29.782627  2996 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.938901 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.940347 30559 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:29.879601  3212 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:29.939550 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:29.942791 30403 raft_consensus.cc:2410] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:29.873950  3313 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:29.948139 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.933306  3349 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.955387 31150 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:29.932216  3168 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:29.957526 30559 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:29.965044 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.983393  2585 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:29.987079 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:29.987758 30404 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.992249 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.992944 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:29.993525 30405 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.993705 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:29.994829 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.995800 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:29.997725  3324 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:29.975328  3168 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.000437  3147 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.000769  3168 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.003103  3216 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.004128  3323 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:30.004518  3323 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:30.005347  3216 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.005987  2992 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.010197 30402 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:29.944805  3287 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:29.988902 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.007758  3324 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:30.012274 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 56948.7us
I20260709 13:11:30.014938 30405 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:30.021428 30404 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:29.946208  3212 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.027444 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.027498 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.059908 30404 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:30.061854 30405 raft_consensus.cc:1240] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:29.972962  3315 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:11:30.073858 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 91360.7us
I20260709 13:11:30.084364 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:30.072634  3354 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:11:30.087859 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.083889  3152 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.005401  3323 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:29.970935  3349 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:30.122516  3364 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:30.073580  3161 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.213696  3357 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.214612  2996 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.067018  3279 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.070993  3324 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.291980 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.267107 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.227325 30405 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:30.302570 30557 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:30.269474  3353 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:30.303681 30405 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:30.287774 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.242429  3168 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.305862  3168 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.259618 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:30.214857 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 135348us
I20260709 13:11:30.250160 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.308490  3152 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.216101  2992 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.310345  2992 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.312255 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:30.340534 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.336916 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.316313 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.316146 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.319192 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.355006 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.303681  3353 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.363134  3161 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.363936  3161 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.219493 30403 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:30.364424 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.268766 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.365836 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.366876  2382 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:30.367075 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:30.367866 30403 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:30.367637 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.368328  3353 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.340531 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.357242 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.226918  2946 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.370047 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.371331 31150 raft_consensus.cc:2368] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:30.371681  2946 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.372357  3324 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.373232 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.374470  3324 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.261126 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.218590  3178 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.310524 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.307933 30407 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:30.367455  2382 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.248495 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.223275 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.215660  3313 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.238730 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.230073 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.368667 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:30.336413 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.284192  3210 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.226356  3013 consensus_meta.cc:287] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.527s	user 0.003s	sys 0.008s
I20260709 13:11:30.221277  3212 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.284402  3280 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.359687  2992 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.227501 30404 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.374686 30554 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 18. Ops: [16.9-16.9]
I20260709 13:11:30.384137 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.385001  2382 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.364456  3161 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.437099  3323 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.439186  3161 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.387261  3350 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.375774 30411 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:30.386253  3279 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.442050 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.395375  3210 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.389189 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.390358 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:30.453414 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 64350.6us
I20260709 13:11:30.453518 30403 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.454538 30450 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.457162  3131 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:30.457659  3131 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:30.458549  3131 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.459089  3315 raft_consensus.cc:2804] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:30.459604  3315 raft_consensus.cc:697] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:30.460501  3315 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.392642 31150 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:30.440531  3350 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.395524  3357 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.446862 30411 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 21.
I20260709 13:11:30.467828  3351 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:11:30.437131 30555 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:30.431311  3287 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:30.447451 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:30.472180 30483 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:30.405118  2883 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:30.407714 30485 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:30.417318 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.418855 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.473764 30551 raft_consensus.cc:3060] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.376297 30482 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:11:30.377301 30481 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:30.475281 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:30.377979  3168 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.478065 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.478986 31117 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:30.479164 30485 raft_consensus.cc:2393] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:30.480290  3168 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:30.480885 30404 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:30.378626 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.516475 30407 raft_consensus.cc:2393] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:30.421516  3320 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.395961  3013 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.386065 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.492895  3178 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.410903 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.409444 30479 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:30.408396  2932 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.387545 30560 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:30.433663 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.465435  3350 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.466635 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.397047  3280 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.528335 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.528946 30478 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:30.529453  3280 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.529841 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.531183 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:30.422077 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131721us
I20260709 13:11:30.484246 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.475682 30403 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:11:30.361392  3349 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.488417  2946 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:11:30.547511 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.485244 30482 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:30.486420 30485 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:30.548765 30485 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:30.548856 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:30.549697 30409 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.478031 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.487092 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.487315 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.488397 30558 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:11:30.368680 30553 raft_consensus.cc:2368] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12.
I20260709 13:11:30.476644  2883 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:30.502807 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 209969us
I20260709 13:11:30.551290 31146 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:30.551265 30411 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
W20260709 13:11:30.552194 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.552862 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.488526  3353 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:30.493129  3286 consensus_meta.cc:287] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.004s
I20260709 13:11:30.519572 31117 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:30.451449 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.495426  3216 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.525148 30406 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:30.527520 30559 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:30.536180 30554 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:30.545979 30483 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:30.535105 30484 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 21.
I20260709 13:11:30.556559 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.553740 30411 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:30.570171 30481 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:11:30.570649 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.561739 30482 raft_consensus.cc:1275] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:30.553418 30558 pending_rounds.cc:85] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:11:30.571921 30558 pending_rounds.cc:107] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:11:30.572175 30558 raft_consensus.cc:2889] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.571274 30411 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:30.564674 30486 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:11:30.565263 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45820.9us
I20260709 13:11:30.574568 31117 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:30.575970 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:30.482777  3287 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.577108  2932 raft_consensus.cc:2804] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:30.579342  3287 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.580915  3347 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:30.581447  3347 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.581861  3347 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.583125  2932 raft_consensus.cc:697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:30.584357  2932 consensus_queue.cc:237] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.591249 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.549823 30485 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.593390 30485 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.568248 30404 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:30.604504 30555 raft_consensus.cc:1217] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:11:30.604708 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:30.605037 30555 raft_consensus.cc:1240] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:30.605260 30406 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:30.607625 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 51162.2us
I20260709 13:11:30.609189 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:30.595683 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:30.547605  3279 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.506865  3212 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:11:30.565649  3353 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.620754 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 55700.9us
I20260709 13:11:30.623579 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.633828 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.619268 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.635202 30479 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:30.624402 30556 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:30.628533 30406 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:30.631125 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:30.633909 30376 leader_election.cc:336] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.671s (SENT)
I20260709 13:11:30.636785 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:30.629316 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60056.3us
I20260709 13:11:30.638913 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:30.641870 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:30.642383 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:30.643056 30404 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:30.643400 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.593003  3004 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.615391  3355 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:30.660224 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.667357 30554 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:30.662395 30376 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:30.662570 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.664080 30406 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:30.614807  3348 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:30.665377 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:30.670518 31147 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.671274 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:30.604104  3363 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:11:30.644721  3202 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:30.689785 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.604343  3216 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:30.683980 30376 leader_election.cc:336] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.707s (SENT)
I20260709 13:11:30.640686  3324 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:30.571256  3286 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.644321  3231 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:30.615185  3351 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:11:30.735961 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.640609  3353 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:30.592279  3313 consensus_queue.cc:1059] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:11:30.661412  3287 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:30.691144  2382 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:30.690820 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57064.6us
I20260709 13:11:30.671595  3355 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.716195 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:30.719002 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 205970us
I20260709 13:11:30.770486 31147 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:30.695523  3202 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.724318 30558 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:11:30.724980  3371 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:30.610984  3161 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:11:30.731735 30410 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:30.715240  3360 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:11:30.714545  3298 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.737668 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.719894  3359 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:30.728718  3320 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.741031 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.671167  2883 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:30.740254  3373 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:11:30.739346  3369 log.cc:927] Time spent T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:11:30.741995 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.681090  3131 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:30.722555 30485 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:11:30.862900 30485 pending_rounds.cc:85] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 12
I20260709 13:11:30.863251 30485 pending_rounds.cc:107] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:11:30.753721 30450 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:30.867980 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 114356us
I20260709 13:11:30.837817  3287 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:30.758198 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.680248  3147 consensus_queue.cc:1048] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:11:30.871225 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.758899  3210 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:30.720409  3378 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:30.872494 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.872915  3378 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.875041  3378 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.763760  3013 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.767125 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:30.876183 30477 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:30.768187  3347 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.878398  3347 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.769971 30409 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:30.773952 30523 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:30.723492  3357 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:30.698894 30525 leader_election.cc:400] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:30.887286 30525 leader_election.cc:403] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:30.887964 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 214259us
I20260709 13:11:30.736956 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.843099 31153 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:30.843674 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:30.851013 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 193206us
W20260709 13:11:30.887341 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 113450us
I20260709 13:11:30.851547 30560 raft_consensus.cc:2368] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12.
I20260709 13:11:30.781626  3355 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.752418  2382 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:30.834681  3260 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:11:30.857954 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 174012us
W20260709 13:11:30.897817 30376 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.824s (SENT)
I20260709 13:11:30.859160 30551 raft_consensus.cc:2468] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:11:30.791411  3202 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.863547 30485 raft_consensus.cc:2889] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.868605 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.757393  3379 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:30.873653 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.731130  3286 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:30.895087 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:11:30.895996 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.853832 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.893151 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:30.908474 30479 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.903856  2585 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:30.908951  2585 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.909322  2585 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.895641 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:30.909773 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.909991 30482 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.911573 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.867514  3131 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.912606 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.916415 30560 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:30.913232 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:30.914764 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.915778 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.916601  3378 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:11:30.918574 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.926515 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:30.927146 30553 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.884516  3313 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:30.928591 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.854789  3359 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.898164  3357 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.942291 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.907572  3210 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:30.854056  3377 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:11:30.935866 30554 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:30.930897 30482 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:30.936408 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.897559  2382 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.959398 31153 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:11:30.963430  3380 log.cc:927] Time spent T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:30.964860  3382 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.965560  2996 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.965399  3382 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.966070  2996 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.970062  3022 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:30.937886 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:30.931449  2585 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:30.932842 30479 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:30.907737  3379 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.940343  3375 consensus_queue.cc:1059] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:11:30.950539  3182 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.927520  3131 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.979672 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:30.978520  3022 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:30.927778  3361 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:30.907989  3212 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:30.990515  2382 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:30.940865  3272 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:30.914860  3152 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:11:30.995750 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.047986 30554 raft_consensus.cc:2376] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14. Re-sending same reply.
W20260709 13:11:30.997128 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.944375  3286 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:31.002854 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 105062us
W20260709 13:11:31.053789 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 411977us
I20260709 13:11:30.992578 30558 raft_consensus.cc:2468] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 9.
I20260709 13:11:31.043432 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.054535 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:31.055465  2585 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:31.056303 30376 leader_election.cc:336] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.508s (SENT)
I20260709 13:11:30.989507  3379 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:31.060318 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 86013.9us
I20260709 13:11:31.068826 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.046281  3357 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:31.076658  2585 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.077287  2382 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:31.084614 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:31.067904  3323 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:11:31.050877  3216 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:31.087056 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.073951 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:31.090750 30376 leader_election.cc:336] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.523s (SENT)
W20260709 13:11:31.090970 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.091209 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.059820  3272 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.102881  2585 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.103370  2585 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.100973 30450 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:31.107442 30376 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.875s (SENT)
I20260709 13:11:31.107398 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.039077  3182 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.108685 31144 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:31.078785  3357 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.085358  3375 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:31.087805  3212 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:31.121130 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.119843  2585 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.120764 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.126534 30410 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.132577 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.133688 30551 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:31.052286  3361 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.146770 30410 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 14.
I20260709 13:11:31.111323  3286 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:31.059549  3022 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.125586  3212 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.124643  3375 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.256038 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.129158  3298 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:31.259788 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 131232us
I20260709 13:11:31.260016 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
W20260709 13:11:31.264032 30376 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.885s (SENT)
I20260709 13:11:31.264457 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.243873  3168 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:31.204736  3313 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:31.291316 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.269644 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.245330  3382 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.282408 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:31.295360 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.296141 30482 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:31.296332 30481 raft_consensus.cc:2368] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
I20260709 13:11:31.301090 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.301808 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.302440 30479 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
W20260709 13:11:31.293018 30376 leader_election.cc:336] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.558s (SENT)
I20260709 13:11:31.303241 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.306038 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.307231 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.268520  3391 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:31.269361  3383 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:31.316745 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.290112  3286 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:31.325587 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:31.333103 30376 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.562s (SENT)
W20260709 13:11:31.338622 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59663.8us
I20260709 13:11:31.340164 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:31.343384 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.343899 31116 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:31.344136 30551 raft_consensus.cc:2368] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 18. Current term is 19.
I20260709 13:11:31.291126  3298 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.362596 30553 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
W20260709 13:11:31.363554 30376 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.579s (SENT)
I20260709 13:11:31.367691 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.298431  3272 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.319022  3212 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.361239  3182 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.351532  3355 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.332075  3287 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:31.264971  3357 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.369045 30553 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:31.293898  3168 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:31.344077  3353 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:11:31.383994 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:31.385068 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 117771us
I20260709 13:11:31.385591 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.407855  2382 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:31.409528 30551 raft_consensus.cc:2410] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:11:31.348647  3384 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:11:31.341936  3391 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.392699  3404 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:31.401697  3216 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:31.343869  3359 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:31.407850  3212 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.390923 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:31.346772  3383 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:31.363096  3376 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:31.403429 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 60577.7us
I20260709 13:11:31.386758  3286 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:31.362869  3396 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:31.363596  3393 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.158s
W20260709 13:11:31.408756 30376 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.633s (SENT)
I20260709 13:11:31.408335 31153 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
W20260709 13:11:31.393870 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 292993us
W20260709 13:11:31.389813 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.423888 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 83805.8us
I20260709 13:11:31.344415  2996 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.434005 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.332056  3375 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.407136  3407 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:31.480157 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.494019  3361 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.494180  3396 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.389027  3313 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.543800 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.537150  2992 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.483282  3376 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.553470  2382 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:31.549425 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 140720us
I20260709 13:11:31.550305 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.550915 30557 raft_consensus.cc:3060] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:31.554757 30376 leader_election.cc:336] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.649s (SENT)
W20260709 13:11:31.557400 30376 leader_election.cc:336] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.687s (SENT)
I20260709 13:11:31.558255  2382 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:31.558749 30374 leader_election.cc:400] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
I20260709 13:11:31.559262  2382 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:31.560209  2382 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.561317  2382 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.552213  3168 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:31.564723  3366 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.844s	user 0.003s	sys 0.000s
I20260709 13:11:31.566592 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2231) took 1978 ms. Trace:
I20260709 13:11:31.559307 30374 leader_election.cc:403] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:31.426250  3404 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.568516 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:31.574458  3131 consensus_meta.cc:287] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.000s
I20260709 13:11:31.544613  3286 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.574923  3131 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.576421 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.577037  3286 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:31.577685 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.578089  3260 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:31.578245  3407 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:31.578513  3260 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.412552  3353 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.583956 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.585481  3353 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:31.413328  3391 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.580550  3396 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:31.567000 30552 rpcz_store.cc:276] 0709 13:11:29.588654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.588813 (+   159us) service_pool.cc:224] Handling call
0709 13:11:29.616411 (+ 27598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.632555 (+ 16144us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:29.672705 (+ 40150us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.256693 (+583988us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18002b2940. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:11:30.627784 (+371091us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.640224 (+ 12440us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.640365 (+   141us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.640397 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.640461 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.564067 (+923606us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:31.566403 (+  2336us) raft_consensus.cc:1685] finished
0709 13:11:31.566422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.566536 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14552,"prepare.queue_time_us":32916,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1895,"raft.queue_time_us":21739,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":12955,"spinlock_wait_cycles":26708608,"thread_start_us":365558,"threads_started":2,"wal-append.queue_time_us":958441}
I20260709 13:11:31.589144 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.589265  3329 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:31.589738  3329 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.590196 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.591005 31150 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 22: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:31.590621  3329 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.596736  3329 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:31.598040  3379 consensus_meta.cc:287] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.520s	user 0.003s	sys 0.004s
I20260709 13:11:31.599040  3298 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.426760  3216 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.483896  3383 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.469170  3406 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:31.568912 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:31.579312  3407 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:31.620708 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 84672.6us
I20260709 13:11:31.582288 30484 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:31.582335  3231 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:31.583593  3376 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:31.601254 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47921.4us
I20260709 13:11:31.548264  3357 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:31.567934  3202 consensus_meta.cc:287] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
W20260709 13:11:31.551152 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.606528  3004 consensus_meta.cc:287] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.003s
I20260709 13:11:31.612538 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.581414  3404 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.621209  2382 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:31.579538  3260 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:31.621706 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64335.8us
I20260709 13:11:31.632725 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.599923  3131 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.603768  3216 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.601945  3286 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 13. Current term is 14.
I20260709 13:11:31.638190 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:31.639333 30376 leader_election.cc:336] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.714s (SENT)
I20260709 13:11:31.622077  3355 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.643469  2382 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.655514 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.598450  3379 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:31.656625 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.658607  2382 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.634805  3231 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.664747  2382 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:31.659266 30376 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.741s (SENT) [suppressed 30 similar messages]
W20260709 13:11:31.666251 30376 leader_election.cc:336] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.839s (SENT)
I20260709 13:11:31.638827  3004 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:31.667562 30376 leader_election.cc:336] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.222s (SENT)
I20260709 13:11:31.667912 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:31.659493  3350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.018s	sys 0.007s
I20260709 13:11:31.669188 30406 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 22: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:31.670595 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:31.677549 30376 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.771s (SENT)
I20260709 13:11:31.677976 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:31.678658  2382 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:31.636265  3202 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.663362  3168 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:31.676076 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:31.679952 30482 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:31.678844 30376 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.913s (SENT)
I20260709 13:11:31.683336 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.683529 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:31.670037  3286 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:31.672179  3260 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:31.678782  3350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.018s	sys 0.007s
W20260709 13:11:31.691620 31150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 663) took 1208 ms (client timeout 1502 ms). Trace:
W20260709 13:11:31.692270 31150 rpcz_store.cc:269] 0709 13:11:30.483799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.483942 (+   143us) service_pool.cc:224] Handling call
0709 13:11:31.691352 (+1207410us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004461d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:31.691514 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430228352}
I20260709 13:11:31.686161 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.697817  2382 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:31.698104 30376 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.069s (SENT)
I20260709 13:11:31.698536 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.699365  3022 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:31.699884 30376 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.098s (SENT)
I20260709 13:11:31.700335 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.701041  3152 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.703838 30479 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:31.702507 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:31.705710 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.706326 30410 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.706269 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.707617 30409 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.707693 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.709021 30408 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:31.709424 30404 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:31.710193  3379 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 22 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:31.711323 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.712033 30405 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:31.699435  2382 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:31.719300  3375 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.720258 30410 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:31.729470 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43920 (request call id 662) took 1345 ms. Trace:
I20260709 13:11:31.737399 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.738071 30410 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.730073 31144 rpcz_store.cc:276] 0709 13:11:30.383807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.383911 (+   104us) service_pool.cc:224] Handling call
0709 13:11:31.729224 (+1345313us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54006d0e54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:31.729384 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553045376}
I20260709 13:11:31.745443 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.747057 30410 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:31.755980  3202 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:31.762986 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.763813 30402 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:31.764568 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.765892 30551 raft_consensus.cc:2410] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:31.767484 30409 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:31.801851 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:31.711382  3231 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.804695  3279 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:31.810074  3279 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.815245 30410 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:31.819095 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.819870 30409 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.825506 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.826200 30403 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:31.824748 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:31.832916 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:31.835813 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.836257 30450 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:31.835850 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:31.837675 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:31.837740 31147 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 22: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:31.807536  3231 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.851398 30409 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:31.853634 30557 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:31.854221 30376 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:31.855000 30450 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:31.855250  2382 raft_consensus.cc:2764] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:31.856154 30450 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:31.856987 30451 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:31.842033  3161 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:31.845597  3391 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.841183  3350 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:31.851505  3382 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:31.828884  3298 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:11:31.845440  3360 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.865332  3202 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.872190  3279 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:31.875358  3412 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.121s	user 0.000s	sys 0.003s
I20260709 13:11:31.880561 30403 raft_consensus.cc:1240] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.882036 30411 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:31.861914  3320 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:31.884563 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.884878  3161 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.885466 30402 raft_consensus.cc:2368] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:31.885874  3161 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.886750  3405 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:11:31.887646  3405 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:31.887975  3405 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:31.889892 30403 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:31.890954 30409 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:31.891501 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.892016 30403 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:31.891006 30560 raft_consensus.cc:2410] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:31.893829 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.865417  3350 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:31.896905  3350 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.897858 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.864244  3329 raft_consensus.cc:2804] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.899668 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.900149 30557 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:31.903486 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.905079 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:31.905913 30411 raft_consensus.cc:2410] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:31.902941  3202 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.909183  3202 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:31.911146 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44906.1us
I20260709 13:11:31.888787  3405 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.929281  3405 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:31.931490 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.932209 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.938567  3427 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:31.939131 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.946789 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.893664  3382 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:31.960650 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66897.1us
I20260709 13:11:31.962630 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.963377 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:31.963481  3404 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:31.965147  3131 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:31.968941  3357 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.992218 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:31.971113 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.993119 30486 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 18: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:31.975215 30554 raft_consensus.cc:2410] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:11:31.939814 30557 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
W20260709 13:11:31.976809 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 64379.2us
I20260709 13:11:31.977743 30402 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:31.978071 30450 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:31.978801 30481 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:31.996059 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.995946 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:31.999846 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.000440 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:32.000985 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:32.001543 30486 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.005796 30374 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.007349 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.007617 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:31.946368  3216 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:31.982555  3386 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:31.982894 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.982968 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.984174 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.983976 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.982582 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:31.989723 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:31.994733  3286 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:31.991834 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:31.969820 30524 connection.cc:256] RPC call timeout handler was delayed by -1.489710728999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:11:32.021270 30524 connection.cc:256] RPC call timeout handler was delayed by -1.4717107290000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:11:32.021601 30524 connection.cc:256] RPC call timeout handler was delayed by -1.3529107289998592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:11:32.021885 30524 connection.cc:256] RPC call timeout handler was delayed by -1.111710728999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:11:32.022167 30524 connection.cc:256] RPC call timeout handler was delayed by -1.07211072899986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:11:32.022423 30524 connection.cc:256] RPC call timeout handler was delayed by -1.0577107289998366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:11:32.022787 30524 connection.cc:256] RPC call timeout handler was delayed by -1.047810729000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:11:32.023392 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.010844 30552 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:32.011344 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:31.978353 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 66964.7us
I20260709 13:11:31.983955  3360 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:31.991343  3329 raft_consensus.cc:697] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:32.028340 30524 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.020486 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.029434 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.029709 30557 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:32.027886 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.012606  3152 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.032028 30558 raft_consensus.cc:2368] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:32.032235  3388 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:32.032413  3393 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.032809  3388 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:32.033329  3391 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.035321  3382 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:32.035429 30524 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:31.998879  3357 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.035972 30485 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:32.036726  3392 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.036962  3212 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.037422  3357 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:32.019186  3298 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:32.038247  3298 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:32.039814  3404 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:32.012367  3349 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:32.040390 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.010177  3280 consensus_queue.cc:1059] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:32.041528  3280 consensus_queue.cc:1243] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:32.042058  3280 raft_consensus.cc:3055] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:32.042392  3280 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:32.043594 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.043268  3280 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.044446  3212 consensus_queue.cc:1059] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:32.046321 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.047473 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:32.033419  3378 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.049307 30559 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:32.053274  3404 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:32.063063 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.063966 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:32.030881  3286 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.186722 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.033277  3388 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:32.044487  3280 raft_consensus.cc:3060] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:32.243119 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 191578us
I20260709 13:11:32.243865  3152 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:32.245880 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 194146us
I20260709 13:11:32.033301  3329 consensus_queue.cc:237] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.053884  3212 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:32.031733  3168 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:11:32.327113 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.249435  3357 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.329216 30403 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:11:32.250167 30556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2385) took 1207 ms (client timeout 1579 ms). Trace:
I20260709 13:11:32.252869 30481 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 22.
W20260709 13:11:32.253064  3425 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:11:32.253592 30486 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
W20260709 13:11:32.254587 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 204860us
I20260709 13:11:32.272702 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 2256) took 1135 ms. Trace:
I20260709 13:11:32.330273 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.333055 30551 rpcz_store.cc:276] 0709 13:11:31.136943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.410197 (+273254us) service_pool.cc:224] Handling call
0709 13:11:32.272457 (+862260us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003f3754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:32.272622 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498297088}
I20260709 13:11:32.255117 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.264182 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.314489  3404 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.282075 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 2244) took 1162 ms. Trace:
I20260709 13:11:32.336794 30554 rpcz_store.cc:276] 0709 13:11:31.120785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.120895 (+   110us) service_pool.cc:224] Handling call
0709 13:11:32.281838 (+1160943us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54003098d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:32.282000 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945897216}
I20260709 13:11:32.337801 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.338326 30554 raft_consensus.cc:2368] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 17.
I20260709 13:11:32.284757  2883 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:32.287168 30376 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.288424 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 260595us
W20260709 13:11:32.300359 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.054490  3298 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.032312  3360 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.311450 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:32.341775 31147 raft_consensus.cc:2393] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 13: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:32.325680  3212 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.327764 30557 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
W20260709 13:11:32.330271 30556 rpcz_store.cc:269] 0709 13:11:31.042503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.042678 (+   175us) service_pool.cc:224] Handling call
0709 13:11:32.249951 (+1207273us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54001da1d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:32.250085 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353686400}
I20260709 13:11:32.278366 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38000 (request call id 2255) took 1141 ms. Trace:
I20260709 13:11:32.346817 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.312332 30559 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:32.344561 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.347137 30560 rpcz_store.cc:276] 0709 13:11:31.136716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.583711 (+446995us) service_pool.cc:224] Handling call
0709 13:11:32.278165 (+694454us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54003390d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:32.278303 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704094464}
I20260709 13:11:32.350472 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.351539 30374 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:32.352312 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.354755 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.358207 30560 raft_consensus.cc:2393] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 12: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:32.323422  3350 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.363534 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.364349 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.364723 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.364292 30305 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 10 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 11 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:32.361447 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.366588 30557 raft_consensus.cc:2393] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:32.362884 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.365264 30552 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:11:32.362635 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 75558us
I20260709 13:11:32.387614 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.389667 30559 raft_consensus.cc:1813] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Handling vote request from an unknown peer 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:32.345630  3378 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:32.390480 30559 raft_consensus.cc:2410] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:11:32.370253 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.391892 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.393419 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.398290 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2260) took 1104 ms. Trace:
I20260709 13:11:32.398881 30554 rpcz_store.cc:276] 0709 13:11:31.293833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.397265 (+1103432us) service_pool.cc:224] Handling call
0709 13:11:32.397645 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.397874 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.397913 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.397969 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:32.398016 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.398087 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.398218 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.345536  3379 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.399652 30558 raft_consensus.cc:2410] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:32.354964  3363 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.415896 30482 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:32.338896  3109 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
W20260709 13:11:32.417316 30376 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.206s (SENT)
I20260709 13:11:32.417554  3435 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.417953 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.418303  3435 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.420858  3435 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.421729  2382 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.413185 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 972) took 1028 ms. Trace:
I20260709 13:11:32.425724 30554 rpcz_store.cc:276] 0709 13:11:31.385276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.412223 (+1026947us) service_pool.cc:224] Handling call
0709 13:11:32.412598 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.412822 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.412857 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.412914 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:32.412957 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.413022 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.413133 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.365610  3436 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:32.387532  3393 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.432916  3393 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:32.433363  3393 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:32.387969  3386 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:32.436273  3386 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.349762  3357 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:32.438776 30558 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.410004  3287 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.440057  3404 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.442799  3260 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:32.431229  3436 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:32.446412  3436 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.447095  3392 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:32.447544  3392 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.448355  3392 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.451346 30559 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:32.451900 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2257) took 1314 ms. Trace:
I20260709 13:11:32.435366  3363 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:32.468443 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.425289 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 971) took 1127 ms. Trace:
I20260709 13:11:32.452415 30555 rpcz_store.cc:276] 0709 13:11:31.137205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.867267 (+730062us) service_pool.cc:224] Handling call
0709 13:11:31.867577 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:31.894976 (+ 27399us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:31.911541 (+ 16565us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.304452 (+392911us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.317103 (+ 12651us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:32.325058 (+  7955us) log.cc:844] Serialized 52 byte log entry
0709 13:11:32.329482 (+  4424us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:32.335328 (+  5846us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.360344 (+ 25016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.360427 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.451456 (+ 91029us) raft_consensus.cc:1685] finished
0709 13:11:32.451485 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.451807 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151306,"prepare.queue_time_us":23344,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3286,"raft.queue_time_us":157979,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":13188,"spinlock_wait_cycles":12576384,"thread_start_us":186737,"threads_started":1,"wal-append.queue_time_us":254957}
I20260709 13:11:32.472295 30551 rpcz_store.cc:276] 0709 13:11:31.297732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.396159 (+1098427us) service_pool.cc:224] Handling call
0709 13:11:32.424644 (+ 28485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.424888 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.424925 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.424981 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:32.425031 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.425097 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.425220 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.453735 30554 raft_consensus.cc:1275] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:11:32.476653 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 123260us
I20260709 13:11:32.477763 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:32.455152  3438 log.cc:927] Time spent T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:32.496490 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.504089 30524 leader_election.cc:400] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:32.453593  3216 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:32.509877  3383 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:32.510449  3383 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.512753  3383 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:32.354240  3272 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:11:32.520232  3350 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.524075  3357 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.500459  3378 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:32.539099 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 119687us
W20260709 13:11:32.539921 30376 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.684s (SENT)
I20260709 13:11:32.540305 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.541180 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.545558 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.550110 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.507177 30554 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:32.555963 30524 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.550638 30376 leader_election.cc:336] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 1.711s (SENT)
W20260709 13:11:32.587911 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 242497us
I20260709 13:11:32.530874  3378 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.528692  3363 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.681865 30403 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:32.688235 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:32.626811 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 212748us
I20260709 13:11:32.458213  3212 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.554829 30554 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:11:32.691761 30554 pending_rounds.cc:85] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 10
I20260709 13:11:32.692080 30554 pending_rounds.cc:107] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:11:32.692360 30554 raft_consensus.cc:2889] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.645325 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.694067 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 48836.7us
I20260709 13:11:32.694986 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.695858  3277 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.696352 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.555501  3379 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.650213 31144 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:32.560997  3162 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.532339  3386 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.556377 31116 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:32.652585 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:32.699326 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 148722us
W20260709 13:11:32.700006 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 143718us
I20260709 13:11:32.699920  3147 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.646936  3405 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:11:32.656008  3393 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.657392  3377 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:32.701942  3379 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.702131  3377 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.702656  3379 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:32.703418  3393 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:32.703173  3379 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.704073 30557 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:32.670207 30558 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:11:32.671279 30305 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 7 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:32.704396  3377 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:32.704564 30479 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:32.706081 30481 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:11:32.699894 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.704699 30558 pending_rounds.cc:85] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 8
I20260709 13:11:32.679171 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.708069  3379 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.712366  3147 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:32.713622  3147 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.717059  3416 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:32.718463 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.718818  3416 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:32.720638 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.720644 30402 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:32.708114 30558 pending_rounds.cc:107] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:11:32.723816  3260 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.724299 30558 raft_consensus.cc:2889] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:32.725488 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73147.2us
I20260709 13:11:32.726843 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.728313  3407 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:32.728933 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.729599  3377 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.730101 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.557090  3216 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:11:32.733382 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.737203 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.733211 30554 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:11:32.740391 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.740746 30406 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:11:32.742666 30376 leader_election.cc:336] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.021s (SENT)
I20260709 13:11:32.743147 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.744149 30410 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:11:32.744596 30410 pending_rounds.cc:85] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 6
I20260709 13:11:32.744846 30410 pending_rounds.cc:107] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:32.745112 30410 raft_consensus.cc:2889] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.746961 30486 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:32.749388 30486 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:32.651825  3389 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.753501 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:32.752389 30376 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Timed out: RequestConsensusVote RPC to 127.28.152.3:43783 timed out after 2.068s (SENT)
I20260709 13:11:32.764691 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.754225 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.765611 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:32.752154  3386 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:32.649207  3272 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:32.760807 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:32.781991 30411 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.754741 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:32.786496 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.786974 30481 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.788262 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:32.769091 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.779783 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2258) took 1525 ms. Trace:
I20260709 13:11:32.780393 30553 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
I20260709 13:11:32.791369  3375 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.791030  3378 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.791965 30376 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.791836  3375 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.792853  3447 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.793627  3447 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:32.793663 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.794739  3447 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:32.795164 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.794767  3280 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.795840  3280 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.798833 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.799108  3280 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:32.800467  3447 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.800683 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.801420  3386 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.802088  3386 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.802553  3386 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.734071  3388 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.805492  3386 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.805722  3388 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:32.802304 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.807158  3287 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.807622 30481 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:32.806504 30411 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:32.751192  3440 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.818209 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:32.819270 30478 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:32.790901 30560 rpcz_store.cc:276] 0709 13:11:31.254914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.396168 (+1141254us) service_pool.cc:224] Handling call
0709 13:11:32.396583 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.402209 (+  5626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.402240 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.402728 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.491224 (+ 88496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:32.491266 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.491336 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.779519 (+288183us) raft_consensus.cc:1685] finished
0709 13:11:32.779546 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.779709 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19453,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":19517,"thread_start_us":88153,"threads_started":1,"wal-append.queue_time_us":250086}
I20260709 13:11:32.823022 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.824222 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.826462 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:32.827098 31144 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:32.827848 30552 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:32.829432 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.840575 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.841673  3444 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:32.842135  3444 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.835640  2883 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:11:32.843113  3444 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.884532  3383 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.885314  3383 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:32.894542 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.895985 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 977) took 1191 ms. Trace:
I20260709 13:11:32.896533 30551 rpcz_store.cc:276] 0709 13:11:31.704140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.473314 (+769174us) service_pool.cc:224] Handling call
0709 13:11:32.501035 (+ 27721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.501304 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:32.771327 (+270023us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.895310 (+123983us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.895533 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.895611 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:32.895680 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.895771 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.895915 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53898,"prepare.queue_time_us":233511,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1277,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":294258,"threads_started":2}
I20260709 13:11:32.913069 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.914321 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38014 (request call id 2396) took 1042 ms. Trace:
I20260709 13:11:32.915323 30556 rpcz_store.cc:276] 0709 13:11:31.872244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.907989 (+1035745us) service_pool.cc:224] Handling call
0709 13:11:32.914250 (+  6261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.923281 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:32.924556 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:32.926785 30407 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:11:32.927052 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:32.928042 30486 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:32.930112 30407 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:32.931828 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 123630us
I20260709 13:11:32.908119  3444 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.928975  3168 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:32.937099 30411 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:32.937922 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.938164 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:32.939745 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:32.956655  3456 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.957381  3456 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:32.956477  3356 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:32.962869 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 134942us
I20260709 13:11:32.964058 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:32.964254  3396 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:32.964529 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.964781 30411 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:32.965670 30523 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.957751  3456 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.966888  3456 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.968930 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.970057 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.970276  3216 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:32.971048  3216 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.971086 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:32.971774  3216 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.971988 30556 raft_consensus.cc:2410] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:32.972267  3216 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:32.972853 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:32.973148  3216 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:32.973886 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.974470 30451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.975968 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.962769  3383 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.974920  3363 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.985498  3363 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:32.987646  3363 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:32.988514  3392 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.989708  3381 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:32.990247  3375 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:32.964658  3286 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:32.980008 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 328801us
I20260709 13:11:33.019606 31118 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:32.981426 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:32.983489 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2259) took 1718 ms. Trace:
I20260709 13:11:32.983521 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 2719) took 1019 ms. Trace:
I20260709 13:11:32.975893 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:32.982602 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2272) took 1310 ms. Trace:
W20260709 13:11:32.984640 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.990900  3393 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:32.992887 30556 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:11:33.025954 30556 pending_rounds.cc:85] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 6
I20260709 13:11:33.026182 30556 pending_rounds.cc:107] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:11:33.026420 30556 raft_consensus.cc:2889] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:33.026585 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50786.6us
I20260709 13:11:32.978392  3388 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:11:32.993531  3168 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:33.001772  3449 log.cc:927] Time spent T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.207s	user 0.000s	sys 0.007s
I20260709 13:11:33.001978  3287 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.002791  3456 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.004294 30376 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.040686 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.010139  3360 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.025417  3393 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:33.012823  3309 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:33.048345  3435 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:33.013298  3272 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.976627 30451 leader_election.cc:400] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:33.053710 30451 leader_election.cc:403] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.022605 30482 rpcz_store.cc:276] 0709 13:11:31.963888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.004514 (+ 40626us) service_pool.cc:224] Handling call
0709 13:11:32.004849 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.416544 (+411695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.983311 (+566767us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400360954. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:32.983468 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944874880}
I20260709 13:11:33.023130 30558 rpcz_store.cc:276] 0709 13:11:31.671811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.439582 (+767771us) service_pool.cc:224] Handling call
0709 13:11:32.439862 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.724874 (+285012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.982348 (+257474us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54000ed8d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:32.982530 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528881024}
I20260709 13:11:33.021690 30557 rpcz_store.cc:276] 0709 13:11:31.266281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.395233 (+1128952us) service_pool.cc:224] Handling call
0709 13:11:32.424120 (+ 28887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.704432 (+280312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.983262 (+278830us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000389d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:32.983431 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643395968}
I20260709 13:11:33.034983 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:33.037437 30555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2274) took 1336 ms. Trace:
I20260709 13:11:33.038640 30552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2268) took 1403 ms. Trace:
I20260709 13:11:33.055364 30552 rpcz_store.cc:276] 0709 13:11:31.635030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.437048 (+802018us) service_pool.cc:224] Handling call
0709 13:11:32.437339 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.828291 (+390952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.038345 (+210054us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54003f2d54. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:33.038570 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897687936}
I20260709 13:11:33.054980 30555 rpcz_store.cc:276] 0709 13:11:31.700520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.473310 (+772790us) service_pool.cc:224] Handling call
0709 13:11:32.498218 (+ 24908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.498493 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:32.741350 (+242857us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.036128 (+294778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.036176 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:33.036213 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.036681 (+   468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.036789 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10100,"prepare.queue_time_us":50518,"prepare.run_cpu_time_us":8501,"prepare.run_wall_time_us":95885,"raft.queue_time_us":11332,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8609,"thread_start_us":526806,"threads_started":2}
I20260709 13:11:33.010848  3408 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:33.060042 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 83533.5us
I20260709 13:11:33.045241 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:33.049130 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.048169  3286 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:33.037326  3355 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.070785 30557 raft_consensus.cc:1275] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.036356  3277 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:33.043974  3279 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:33.064334  3131 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:33.064831  3435 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.039860  3381 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:33.066809 30558 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.037019  3168 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:33.041328  3443 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.062963 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.088045 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:33.095218 31144 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.096390 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.068828  3456 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.091889 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.066308  3272 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.083984  2883 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.104404 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.088716  3279 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.101747  3286 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.059211  3416 consensus_queue.cc:1048] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:11:33.111642  3360 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:33.114444 30408 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.101559  3287 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.114044 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.110558  3393 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.113754  2883 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.123332  3272 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.127166 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.144790 30374 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:33.092272  3361 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:11:33.102438  3313 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:33.150157 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.114825  3279 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.112155  3435 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.103173  3443 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.178709  3443 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.183939 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.187544 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:33.190835 30553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53492 (request call id 973) took 1798 ms (client timeout 1560 ms). Trace:
W20260709 13:11:33.191393 30553 rpcz_store.cc:269] 0709 13:11:31.392440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.392927 (+   487us) service_pool.cc:224] Handling call
0709 13:11:33.190604 (+1797677us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003f2354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450ad2fa 00007fa04a06eb17 00007fa0435e96d4 00007fa0435e9662 00007fa0435e9591 00007fa0435e950c 00007fa0435e87c2 00007fa0433e448c 00007fa0433e38c6 00007fa0433e326f
0709 13:11:33.190748 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842187008}
I20260709 13:11:33.102771  3381 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:33.176725  3464 log.cc:927] Time spent T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:11:33.194638 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.199174 30410 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:33.197134 30403 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:33.198328 30408 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:33.090217 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.147037  3459 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:11:33.091768 30559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.013s	sys 0.019s
W20260709 13:11:33.210608 30559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.013s	sys 0.019s
I20260709 13:11:33.145422 31144 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:33.212821 30305 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 13 to 14, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.215981 30559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2273) took 1520 ms. Trace:
I20260709 13:11:33.216414 30559 rpcz_store.cc:276] 0709 13:11:31.695313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.452292 (+756979us) service_pool.cc:224] Handling call
0709 13:11:32.460107 (+  7815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.460367 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:32.495480 (+ 35113us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.215613 (+720133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.215663 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:33.215705 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.215827 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.215933 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15648,"prepare.queue_time_us":35915,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2514,"thread_start_us":715276,"threads_started":1}
I20260709 13:11:33.211107  3152 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:33.237082 30305 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 1 to 13. New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.213373  3389 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:33.269042 30305 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 10, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 10 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.235075  3022 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:33.276621  3468 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:11:33.276366 30305 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.278151 30305 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 12 to 13, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:33.279335 30302 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 198) took 21241 ms (client timeout 15000 ms). Trace:
I20260709 13:11:33.232103  3162 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:11:33.237406  3216 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.280443 30305 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 6 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:33.283399 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 252667us
W20260709 13:11:33.285048 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 186396us
W20260709 13:11:33.284739 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 234305us
W20260709 13:11:33.288695 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 196915us
I20260709 13:11:33.291728 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:33.292064 30553 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:11:33.265769  3435 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.294586 30402 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:33.278144  3463 log.cc:927] Time spent T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:11:33.305728 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.317833 30305 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.319583 30305 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 10 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:33.321250 30305 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 7 to 10, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 10 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.339083 30482 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:33.338979 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.340807 30486 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:33.341727 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:33.347067 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.283813  3022 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.354676 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:33.356395 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60338.1us
I20260709 13:11:33.373694 30482 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
W20260709 13:11:33.362843 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 193524us
I20260709 13:11:33.371241 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.374014 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:33.335125  3309 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.349969  3436 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.388126 30305 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 3 to 14. New cstate: current_term: 14 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:33.304277  3216 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.324030  3435 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.352213  3388 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:33.407325  3470 log.cc:927] Time spent T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:33.407578  3388 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.409824  3388 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.395328  3436 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.403473  3131 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:33.404162  3231 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:33.381754  2883 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.378091  3479 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:33.413316  3435 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.416532 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:33.424551 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 121577us
W20260709 13:11:33.424353 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 105875us
I20260709 13:11:33.414533  3357 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:33.279752 30302 rpcz_store.cc:269] 0709 13:11:12.053866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.056225 (+  2359us) service_pool.cc:224] Handling call
0709 13:11:26.331899 (+14275674us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b54001686a8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa048a13161 00007fa048a9d3af 00007fa048a9eb11 00007fa04af9f2d1 00007fa04af9fb2f 00007fa04ae5ed4b 00007fa04af66c3e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc
0709 13:11:33.279059 (+6947160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:26.707549 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:26.728806 (+ 21257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:26.731054 (+  2248us) write_op.cc:435] Acquired schema lock
0709 13:11:26.731786 (+   732us) tablet.cc:662] Decoding operations
0709 13:11:26.774875 (+ 43089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:26.774962 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:26.775004 (+    42us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:11:26.777233 (+  2229us) tablet.cc:701] Row locks acquired
0709 13:11:26.777264 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:11:26.777477 (+   213us) write_op.cc:270] Start()
0709 13:11:26.777654 (+   177us) write_op.cc:276] Timestamp: P: 1783602686777406 usec, L: 0
0709 13:11:26.777682 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:27.047207 (+269525us) log.cc:844] Serialized 8209 byte log entry
0709 13:11:27.309109 (+261902us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b180037d7a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:27.509612 (+200503us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a4e28 00007fa048adf581 00007fa048aded58 00007fa048ae39f1 00007fa048ae39a9 00007fa048ae3939 00007fa048ae3901 00007fa048ae2b2d 000000000038f354 000000000038f199
0709 13:11:27.518528 (+  8916us) op_driver.cc:464] REPLICATION: finished
0709 13:11:27.609501 (+ 90973us) write_op.cc:301] APPLY: starting
0709 13:11:27.609607 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:27.730851 (+121244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:27.730893 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:28.302965 (+572072us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:28.303426 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:11:28.303483 (+    57us) write_op.cc:312] APPLY: finished
0709 13:11:28.304036 (+   553us) log.cc:844] Serialized 188 byte log entry
0709 13:11:28.304228 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:28.304502 (+   274us) write_op.cc:454] Released schema lock
0709 13:11:28.304592 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:28.305189 (+   597us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:28.305233 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6506,"reported_tablets":53,"spinlock_wait_cycles":85480832,"child_traces":[["op",{"apply.queue_time_us":90592,"apply.run_cpu_time_us":36067,"apply.run_wall_time_us":695688,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91991,"num_ops":21,"prepare.queue_time_us":354177,"prepare.run_cpu_time_us":55105,"prepare.run_wall_time_us":814874,"raft.queue_time_us":201362,"raft.run_cpu_time_us":19633,"raft.run_wall_time_us":90833,"replication_time_us":740654,"spinlock_wait_cycles":307838208,"thread_start_us":848090,"threads_started":4,"wal-append.queue_time_us":230719,"wal-append.run_cpu_time_us":28802,"wal-append.run_wall_time_us":2004011}]]}
I20260709 13:11:33.442745 30305 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 12, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 12 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.445135 30305 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 10 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.423475  3441 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:33.447453 30305 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:33.449482 30305 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 7 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:33.451462 30305 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 13 to 14, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.454725 30305 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 5 to 7, term changed from 7 to 10, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to <none>, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:33.459199 30305 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 7 to 11, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.424546  3381 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.387934  3309 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.423684  3013 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:11:33.472064  3436 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:33.480468 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 106577us
I20260709 13:11:33.443630  3357 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:33.481365 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:33.484108 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 98674.4us
I20260709 13:11:33.470376  3441 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:33.476725  3022 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.488368 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.489020 30404 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:33.492815  3361 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:11:33.487059  3441 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:33.489890  3360 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:11:33.522233  3473 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:11:33.529742 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:33.541532 30485 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:33.541736 30524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.546573 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.549921 30485 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:33.521931  3320 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:33.529129  3484 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:11:33.551757 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 209575us
I20260709 13:11:33.520473  3361 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:11:33.557227 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:33.557480 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:33.510947  3479 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:11:33.549710  3472 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:11:33.564252 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:33.564986 31146 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:33.554778  3287 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:33.550343  3456 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.567912  3456 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:33.571987 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.572952 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:33.555933 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.559150 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.566938 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:33.570483  3456 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.580883  3456 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:33.581365  3456 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:33.581744  3168 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.553501  3392 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.591109 30402 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:33.558145  2883 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:33.600055 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:33.601545  3329 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:33.602553 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:33.564728  3131 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:33.602553 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 48193.1us
I20260709 13:11:33.607820 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.603466 30559 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:33.565289  3216 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.601959  3168 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.579767  3379 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:33.623598 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.629750  3378 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:33.630300  3378 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.630745  3378 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.630775  3404 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.631613  3404 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.634146  3404 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.634490 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.635771 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.636054  3404 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:33.636637  3508 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:33.635816 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:33.641387 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:33.582207  3456 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.650110 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.627178  3379 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.651389  3379 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.653470 30406 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:33.603513  3392 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.604944  3388 consensus_queue.cc:1048] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:11:33.609978  3445 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:11:33.645934  3404 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:33.652259  3376 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:33.664036 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:33.643011  3309 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:33.669927  3502 log.cc:927] Time spent T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:33.664758  3298 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:11:33.671868  3309 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.672376  3309 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.674367  3309 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.677922 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.678546 30406 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:33.678921 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.680979 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.681318 30553 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:33.683037 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.685673 30486 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:33.688004 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.610036  2883 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.691102 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:33.688755 30482 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:33.693655 31146 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:11:33.668794  3404 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.705821  3379 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.739723  3379 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.740129  3491 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:33.692747  3376 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:33.741487  3491 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:33.741693  3376 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.741922  3491 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:33.742237  3376 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.743119  3491 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.744601  3491 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.748075  3378 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:33.749825  3458 log.cc:927] Time spent T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.481s	user 0.000s	sys 0.003s
I20260709 13:11:33.716312  3392 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.716113  3500 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:33.722333  3479 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:33.758781  3479 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:33.759660  3479 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.724766  2883 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.700997  3404 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.733325  3152 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:33.762243  3152 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.758581 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.764547  3212 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.764673 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.767019 30405 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:33.769755  3376 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:33.774044  3279 consensus_meta.cc:287] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
I20260709 13:11:33.774720  3279 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.750408  3378 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.783447  3441 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.787490 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:33.787683 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:33.788175 30553 raft_consensus.cc:2368] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 18. Current term is 19.
I20260709 13:11:33.789270 30450 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:33.790831  3388 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:33.794237 31118 leader_election.cc:400] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 18. Current term is 19.
I20260709 13:11:33.794574 31118 leader_election.cc:403] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.801965 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:33.808998 30478 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 18: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:33.814752 30486 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:33.780709  3479 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.791219  3388 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.818379 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:33.781917  3379 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:33.809981  3441 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.810882  3109 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:33.836475 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.827576  3388 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.840797  3393 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.849189 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:33.853870 30557 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:11:33.854292 30557 pending_rounds.cc:85] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 8
I20260709 13:11:33.854496 30557 pending_rounds.cc:107] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:11:33.854743 30557 raft_consensus.cc:2889] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.830205  3497 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:11:33.856809 30554 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:33.859459  3376 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.860611  3404 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.863119 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:33.869441 30407 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.870476  3279 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.872346 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:33.833834  3379 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:33.879599  3357 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.866214  3152 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.891635 30553 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:33.891639 30406 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:33.893244  3356 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:33.893693  3356 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:33.894593  3356 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.895644  3356 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.896224 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:33.896391 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:33.897367 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:33.897905 30411 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.902324 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:33.902578 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.904974 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:33.905548 31146 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.907763  3386 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.917547 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.907779 30560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38014 (request call id 2419) took 1110 ms. Trace:
I20260709 13:11:33.918509 30560 rpcz_store.cc:276] 0709 13:11:32.796868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.925921 (+129053us) service_pool.cc:224] Handling call
0709 13:11:32.926368 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:32.936322 (+  9954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.936355 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:32.936978 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 13:11:33.211930 (+274952us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.232585 (+ 20655us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.237156 (+  4571us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.536489 (+299333us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b18004afb60. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa0450a1060 00007fa0450b3716 00007fa0450c4287 00007fa0450c4208
0709 13:11:33.536691 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.536788 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.720839 (+184051us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18004afb60. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc522 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:33.736693 (+ 15854us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18004afb60. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc522 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:33.748028 (+ 11335us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18004afb60. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1
0709 13:11:33.883509 (+135481us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b18004afb60. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041fbc3f3 00007fa041fbe7c1 00007fa041fbe779 00007fa041fbe709 00007fa041fbe6d1 00007fa041fbd9cd 000000000038f354 000000000038f199 00007fa041f9f83a
0709 13:11:33.907558 (+ 24049us) raft_consensus.cc:1685] finished
0709 13:11:33.907580 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.907721 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32568,"prepare.queue_time_us":47383,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":314501,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":46203,"spinlock_wait_cycles":49641600,"thread_start_us":244332,"threads_started":1,"wal-append.queue_time_us":293439}
I20260709 13:11:33.921525 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:33.915833 31146 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:33.908181 30557 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.925513 30406 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:33.926517 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:33.927286 30406 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:33.928977 30411 raft_consensus.cc:2468] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:33.872668  3404 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:33.936173  3152 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:33.937992  3357 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.942631  3386 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:33.945333 30557 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:33.945722 30405 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:33.946388 30407 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:33.981427 30406 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:33.948074 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:33.921581 30376 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:33.983279 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 61769.4us
W20260709 13:11:33.969780 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 67530.5us
I20260709 13:11:33.975344 30409 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:33.977409 31117 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:33.945077  3109 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d for earlier term 18. Current term is 19.
I20260709 13:11:33.987489 30450 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:33.988600 30524 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:33.999923 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:33.905012  3379 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:33.976758  3212 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:34.001936 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:34.009291 31147 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:34.002746 30376 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:34.015875 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:33.996167  3152 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:34.020483 30376 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.035159 30524 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:34.037182 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.008723  3212 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.003906  3013 raft_consensus.cc:2804] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:34.013108  3313 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:34.013181  3360 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:34.007004  3393 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:34.051937 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.039409  3168 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.052894  3360 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:34.078531  3517 log.cc:927] Time spent T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:34.078858  3360 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.018838  3287 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:34.035624  3152 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.015699  3404 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:11:34.082352 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.055527 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:34.049182  3392 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:34.048975  3212 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.084978 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.097373 30552 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.047216  3436 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:34.096449 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.051748  3313 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.076534  3013 raft_consensus.cc:697] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:34.096835  3361 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:34.105885 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.109766 30552 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:34.110857  3509 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 13:11:34.111690  3518 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:11:34.112620  3363 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:34.113351  3524 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:34.104892  3361 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.115192  3361 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.116852  3298 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:34.118462  3298 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:34.120491  3388 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.121519  3131 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:34.121922  3131 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:34.123512  3386 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.123934  3509 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:34.124392  3509 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:34.125224  3509 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.127004  3131 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:34.128175  3523 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:34.128400  3131 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.122542  3388 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.095199  3152 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:34.135563  3298 consensus_queue.cc:1175] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "027e191e31da4af2bc83c5ddc0c15d05" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 11 } }
I20260709 13:11:34.126471  3509 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.138952  3013 consensus_queue.cc:237] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.100986  3392 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.143420 30551 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:34.143569  3392 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.102116  3313 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.151041 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.151065 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.153986 30481 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:34.155316 30481 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:34.156257 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:34.156827 30478 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.163858 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:34.166478 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 58348.4us
I20260709 13:11:34.168241 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.099408  3287 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:34.175565 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:34.176724 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.177874 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.178457 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:34.176606 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.165750  3396 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.166038  3404 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.240803 30478 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
W20260709 13:11:34.242421 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 51106.9us
I20260709 13:11:34.181483  3168 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.182216  2883 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.247200 30556 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:11:34.181267  3405 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:34.252130 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.165807  3360 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:34.278012 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 100211us
I20260709 13:11:34.278369 30481 raft_consensus.cc:2410] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:11:34.181787  3378 consensus_queue.cc:1059] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:11:34.243824  3349 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.244763  3381 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:34.285305 30482 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 16. Ops: []
I20260709 13:11:34.240865  3212 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:34.368311 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 194470us
W20260709 13:11:34.368590 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.368929 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.251433  3286 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.241532  3396 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.277702  3386 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:34.245900  3404 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.232800  3287 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:34.403332  3534 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:34.285347  3479 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:34.407136  3479 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:34.411015  3521 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:11:34.279987  3405 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.424906  3405 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.284376  3361 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.427830 30485 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:34.364799  3349 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.390093  3286 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:34.392099  3527 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:11:34.436051  3404 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.395280  3386 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.275983  2883 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.438570  3386 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.439997  2883 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:34.444058 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 75220.3us
I20260709 13:11:34.446666 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.447853 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.449016 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.449301  3313 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.450186 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.450544  3377 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.451301  3377 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.453408  3162 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:34.453769  3377 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.458300  3272 raft_consensus.cc:3055] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:34.458755  3272 raft_consensus.cc:740] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.459635  3272 consensus_queue.cc:260] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.460652  3272 raft_consensus.cc:3060] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:34.461922  3526 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.463s	user 0.008s	sys 0.002s
I20260709 13:11:34.467152 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.363583  3392 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:34.281019  3456 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.474047 30559 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:34.478154 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:34.368201  3260 consensus_queue.cc:1059] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:11:34.436138  3286 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:34.518947 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.506032  3393 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:34.520712 30405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:34.510607  3357 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.565995 30405 raft_consensus.cc:606] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.573112 30405 raft_consensus.cc:614] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:34.566933 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 51129.6us
I20260709 13:11:34.568437 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.569893 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.575613 30551 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:34.570535 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.570676 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.571035 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.577066 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.578440  3379 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:34.579036  3379 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.506418  3456 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.588193 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.493571  3152 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.515981  2883 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:11:34.598989 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.600844 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.601711 30478 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:34.582207  3393 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.599700 30551 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:34.606797 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.607802 30478 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:34.586441  3453 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:34.609382 30407 raft_consensus.cc:1240] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:34.589864  3376 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:34.594249  3379 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:34.595856  3313 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.583155  3357 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.631877 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:11:34.698020 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 66241.9us
W20260709 13:11:34.699690 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 87339.8us
W20260709 13:11:34.700605 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 104007us
I20260709 13:11:34.703011 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.631206  3453 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.707577  3453 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.710501 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.712168 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:34.712756 30406 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.714838  3168 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:34.715375  3168 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.715852  3168 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.716111 30408 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:34.717808  3515 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:34.719074 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.720570  3286 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:34.721033  3286 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:34.721459  3286 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.722136 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.695163  3381 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:34.723263  3381 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.723994 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.724120  3381 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.724905 30555 raft_consensus.cc:2410] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:11:34.725385  3381 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:34.728045  3525 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.680s	user 0.001s	sys 0.000s
I20260709 13:11:34.728752  3357 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.729336  3396 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.737047  3152 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.737572  3361 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.740068  3393 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.741010 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.741195 30404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:34.741719 30404 raft_consensus.cc:606] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.742056 30404 raft_consensus.cc:614] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:34.739984 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.747201  3152 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:34.746006 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.750597  3375 raft_consensus.cc:3055] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:34.751055  3375 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.751922  3375 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.753223  3375 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.754623  3168 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.636871  3376 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:34.767357  3479 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.768543  3360 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.785331  3349 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:34.797423 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.810474 30404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:34.811532 30404 raft_consensus.cc:606] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.812116 30404 raft_consensus.cc:614] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:34.812876 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 109958us
I20260709 13:11:34.814075 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.815718  3287 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.816972 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.818280 30406 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:34.820942 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:34.835781 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:34.861373 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.816423  3404 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:34.864751  3535 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:11:34.854080  3356 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:34.855057  3485 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:34.848382  3445 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.886716 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.850078  3379 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:11:34.866582  3212 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.837284  3287 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.900465 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:34.900815 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:34.904043 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:34.871604 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.895856 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 81996.5us
I20260709 13:11:34.909447 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.913719 30559 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:34.877771  3168 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.939415 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.902321  2883 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:34.917493  3386 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:34.919418 30523 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.890743  3356 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:34.928038 30559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:34.945278 30559 raft_consensus.cc:606] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.945631 30559 raft_consensus.cc:614] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:34.931809  3536 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:11:34.945901 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.935913  3456 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:34.936051 30479 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:34.948302 30551 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:34.938431  3152 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.948390 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:34.944396 30450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.018s	sys 0.039s
W20260709 13:11:34.935166  3538 log.cc:927] Time spent T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.205s	user 0.000s	sys 0.003s
I20260709 13:11:34.937985  3287 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:34.958038 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:34.964809 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:34.893369  3485 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:34.948081  3168 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:34.981283 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:34.992709 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:34.955901  2883 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:34.987633 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:34.994323 30403 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.991571 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:34.998281 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:34.999013 30553 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.002264 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.005182 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:35.005582 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:35.006213 30410 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.958952  3386 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:34.969223  3404 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.977862  3392 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:35.010927 30407 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:34.953061  3356 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.028827 30486 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:11:35.029373 30486 pending_rounds.cc:85] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 8
I20260709 13:11:35.029639 30486 pending_rounds.cc:107] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:35.029923 30486 raft_consensus.cc:2889] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.035226 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:35.040690 30484 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:35.042373 30552 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:35.006088  3509 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.056862 30410 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:35.046140 30403 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:35.048220 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:35.065282 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.065528 30553 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:35.095985 30478 raft_consensus.cc:1240] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:11:35.097018 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:35.099148 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 49915.4us
I20260709 13:11:35.039975  3212 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.006366  3168 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.136463 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.144011 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:35.144284 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44312.2us
I20260709 13:11:35.020823  3386 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.054207  3152 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:35.163764 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.055573  3497 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:11:35.165417 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:35.237977  3131 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.238422  3361 consensus_queue.cc:1059] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:35.258626 30374 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:35.259909 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 400771us
W20260709 13:11:35.221577  3546 log.cc:927] Time spent T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:11:35.166239 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:35.220132  3545 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:35.145800  3392 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.210929  3396 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:35.207630  3152 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.283792 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.145309  3404 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:35.245556 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 63960.8us
I20260709 13:11:35.143036  3376 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:35.254953 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 89613us
I20260709 13:11:35.286783 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:35.256151  3543 log.cc:927] Time spent T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:11:35.258299  3309 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:35.290634 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.279894  3375 consensus_meta.cc:287] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.517s	user 0.018s	sys 0.001s
I20260709 13:11:35.297432 30374 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.260074  3131 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.281443  3287 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:35.314476 30557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2303) took 1333 ms. Trace:
I20260709 13:11:35.315093 30557 rpcz_store.cc:276] 0709 13:11:33.981597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.150537 (+168940us) service_pool.cc:224] Handling call
0709 13:11:34.163102 (+ 12565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.174932 (+ 11830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.174976 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.175599 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.464155 (+288556us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b48001c0158. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa049fd2aa1 00007fa049fc9b37 00007fa049fc99ca 00007fa04a0c126f 00007fa04a0c0f37 00007fa04a0d555c 00007fa04a0d5508 00007fa04a0d5488 00007fa04a0d5443 00007fa04a0d46ec 00007fa048ffea96
0709 13:11:34.465968 (+  1813us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800359380. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:34.839339 (+373371us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:34.839402 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.839515 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.314227 (+474712us) raft_consensus.cc:1685] finished
0709 13:11:35.314255 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.314413 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11190,"raft.queue_time_us":14089,"raft.run_cpu_time_us":10418,"raft.run_wall_time_us":283212,"spinlock_wait_cycles":19366144,"thread_start_us":373140,"threads_started":1,"wal-append.queue_time_us":771881}
I20260709 13:11:35.292860  3393 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.321056 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:35.303102  3547 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:35.326833 30558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2300) took 1414 ms. Trace:
I20260709 13:11:35.327365 30558 rpcz_store.cc:276] 0709 13:11:33.912200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.942189 (+ 29989us) service_pool.cc:224] Handling call
0709 13:11:34.397067 (+454878us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b5800003398. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:11:34.397297 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.567979 (+170682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.568027 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.568616 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.820241 (+251625us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:34.820299 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.852468 (+ 32169us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003f3754. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:34.852549 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.326541 (+473992us) raft_consensus.cc:1685] finished
0709 13:11:35.326569 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.326754 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1116,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":10908,"spinlock_wait_cycles":448054016,"thread_start_us":250948,"threads_started":1,"wal-append.queue_time_us":386950}
I20260709 13:11:35.319777  3485 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:35.332921  3286 consensus_meta.cc:287] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.611s	user 0.015s	sys 0.000s
I20260709 13:11:35.332437  3109 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.345975  3286 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:35.351800  3550 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:11:35.360023 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:35.364661 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:35.365702 30403 raft_consensus.cc:2393] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:35.373000  3556 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:35.373610  3556 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.333213  3547 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.381002  3556 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.382612  3386 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.382934 30554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2308) took 1348 ms. Trace:
I20260709 13:11:35.369485  3109 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.383453 30554 rpcz_store.cc:276] 0709 13:11:34.035047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.161374 (+126327us) service_pool.cc:224] Handling call
0709 13:11:34.161717 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.177818 (+ 16101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.177864 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.178414 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.747115 (+568701us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b1800382840. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c490d1 00007fa045064a0f
0709 13:11:35.160701 (+413586us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:35.160757 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.160851 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.382531 (+221680us) raft_consensus.cc:1685] finished
0709 13:11:35.382564 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.382860 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129585,"raft.queue_time_us":83293,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5089,"spinlock_wait_cycles":49268480,"thread_start_us":413346,"threads_started":1,"wal-append.queue_time_us":1082797}
I20260709 13:11:35.386046  3109 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.386736  3152 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.387036  3544 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:35.387761  3131 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.387862 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:35.388427  3168 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.388964  3298 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:35.389528  3298 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:35.390336  3298 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.358425 31144 raft_consensus.cc:1240] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:35.392076  3286 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.405400 30450 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:35.408757  3544 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.419649  3287 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:35.420519 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 123156us
I20260709 13:11:35.422150  3287 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.431571  3309 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:35.470826 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 166953us
I20260709 13:11:35.468444  3361 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.472314 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.474928  3361 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.472311 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.486380 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.490897 30477 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:35.494104 30558 raft_consensus.cc:1275] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:11:35.494666 30558 pending_rounds.cc:85] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 10
I20260709 13:11:35.494988 30558 pending_rounds.cc:107] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:11:35.495298 30558 raft_consensus.cc:2889] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.496806 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.499645 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:35.501794 31144 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
W20260709 13:11:35.503322  3381 consensus_meta.cc:287] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.777s	user 0.016s	sys 0.000s
W20260709 13:11:35.526587 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.450883  3309 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.544159 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:35.546020 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66531.3us
I20260709 13:11:35.527489  3349 consensus_queue.cc:1048] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:35.546809  3131 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:35.562615  3131 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.563169  3131 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.564955  3492 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:35.565446  3492 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:35.568797 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:35.569680 30486 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 14: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:11:35.584321  3541 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.849s	user 0.007s	sys 0.000s
I20260709 13:11:35.585589 30402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53716 (request call id 2376) took 1672 ms. Trace:
I20260709 13:11:35.585974 30402 rpcz_store.cc:276] 0709 13:11:33.913139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.943210 (+ 30071us) service_pool.cc:224] Handling call
0709 13:11:34.432879 (+489669us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b5800005198. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041f84b71 00007fa041f84a22 00007fa04ae9dc09 00007fa049ff7ee0 00007fa04a0c10ab 00007fa04a0c1131 00007fa04a082fc0 00007fa04a06d929 00007fa04a06d3d2 00007fa0435e4bd4
0709 13:11:34.433084 (+   205us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.433477 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.433507 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.434033 (+   526us) log.cc:844] Serialized 52 byte log entry
0709 13:11:34.610998 (+176965us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:34.611043 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.611115 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.583784 (+972669us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:35.585356 (+  1572us) raft_consensus.cc:1685] finished
0709 13:11:35.585383 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.585510 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5655,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":201676800,"thread_start_us":176587,"threads_started":1,"wal-append.queue_time_us":301229}
I20260709 13:11:35.566306  3492 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.603660  3492 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:35.610868  3216 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:35.611515  3216 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:35.615311  3542 log.cc:927] Time spent T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.730s	user 0.005s	sys 0.001s
W20260709 13:11:35.619551  3540 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.003s	sys 0.011s
W20260709 13:11:35.619925  3540 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.004s	sys 0.011s
I20260709 13:11:35.622442  3547 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.627164  3216 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:35.631036 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.631449 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.633569 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.636533 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.637246 30558 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:35.638479 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.639665 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:35.635636  3539 log.cc:927] Time spent T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.901s	user 0.002s	sys 0.004s
I20260709 13:11:35.648583 30559 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:35.649509 30559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:35.650017 30559 raft_consensus.cc:606] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.650290 30559 raft_consensus.cc:614] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:35.656488  3131 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.657513 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:35.660368 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:35.662487 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:35.664695 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.667922  3152 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:35.668619  3152 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.671039  3478 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.671315  3569 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:35.671582  3478 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.672005  3569 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.673708  3478 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.676859 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.677739 30559 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:35.679903 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.683935 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.683316 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.679592  3459 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:35.687995  3459 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.689144  3555 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:35.689662  3555 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.690169  3459 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:35.679281  3556 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.691259  3556 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.691875  3555 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.692325 30402 raft_consensus.cc:2393] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:35.692755  3436 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.693274  3556 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.685524  3286 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:35.681412  3287 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:35.694082  3287 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.696194  3287 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.696188 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:35.697008 31147 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.680395  3574 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.697921  3574 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.700029  3574 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.701304 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.701627 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.702373 30482 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 17: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:35.699952 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.703234  3152 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.703375 30486 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
I20260709 13:11:35.674355  3569 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.693982  3286 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.706159  3286 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.707816 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:35.708880 30376 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:35.709990 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.710402  3379 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:35.710994  3379 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:35.710492  3569 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:35.713709 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.715579 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.717605 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.718341 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.718403 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.712898 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.721135 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.723816 30553 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:35.724079 30559 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:35.723234 31147 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:35.727921 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:35.728873 30376 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:35.742444 30478 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:35.744515 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.751526 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.752101 31117 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:35.711416  3379 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:35.720956  3131 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:35.752274 30478 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:35.758390 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:35.738273  3556 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:35.738090  3286 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:35.764168  3578 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:11:35.765362 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 44507us
I20260709 13:11:35.744390  3574 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.741343  3569 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:35.766245 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.769140  3286 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:35.772962 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:35.773345  3286 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:35.765151  3349 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:35.767280  3556 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.774552  3556 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.782017 30451 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:35.791755  3360 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:35.794898  3564 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:11:35.816777 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59926.3us
I20260709 13:11:35.815358  3360 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:35.839349  3584 log.cc:927] Time spent T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:35.831955  3569 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.852284 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:35.864996  3551 log.cc:927] Time spent T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.541s	user 0.000s	sys 0.004s
I20260709 13:11:35.866128 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2316) took 1358 ms. Trace:
I20260709 13:11:35.866503 30556 rpcz_store.cc:276] 0709 13:11:34.507821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.751032 (+243211us) service_pool.cc:224] Handling call
0709 13:11:34.751340 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.752567 (+  1227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.752610 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.753018 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.028287 (+275269us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:35.028324 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.028393 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.864478 (+836085us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:35.865847 (+  1369us) raft_consensus.cc:1685] finished
0709 13:11:35.865871 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.866070 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":737,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":75753344,"thread_start_us":274973,"threads_started":1,"wal-append.queue_time_us":539757}
W20260709 13:11:35.867936  3579 log.cc:927] Time spent T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:11:35.875283 30374 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.875605 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.875526  3393 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:35.877872 30374 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:35.878077  3393 consensus_queue.cc:1243] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:35.878602  3393 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:35.878950  3393 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:35.879181  3436 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.879781  3393 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.880352  3436 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:35.880949  3393 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.820629  3564 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:35.884153  3564 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:35.831243  3360 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:35.902799  3361 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:35.906302 30523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.913196 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:35.913817 30556 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
W20260709 13:11:35.916796  3583 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:35.922412 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:35.923481  3393 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:35.923918  3393 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:35.924324  3393 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.931499  3393 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.933594  3393 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:35.937353  3212 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.937994  3212 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.940517  3212 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:35.946967 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:35.948587 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:35.955691  3286 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:35.960325  3286 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:35.966841 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 89030.5us
I20260709 13:11:36.022264 30374 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.023275  3152 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:36.024360 30374 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.025336  3152 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:35.969106  3379 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:35.987289 30526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.989615 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:35.991797 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.029423 30403 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:36.030900  3379 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:35.994724 30479 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:35.996980 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:36.001619 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:36.034806 30486 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:36.013437 30404 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:36.041213 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.041705 30557 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
W20260709 13:11:36.043900 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 54363.3us
I20260709 13:11:36.044003  3568 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:36.044534  3568 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.044848  3568 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.047580 30376 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:36.047706 30478 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:36.049448  3396 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:36.108104 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60606.9us
I20260709 13:11:36.049603 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:36.109230 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 59721.3us
I20260709 13:11:36.051409 30560 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:36.056535  3568 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.112547  3568 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.113227  3507 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:36.109690  3379 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:36.114883 30408 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:36.115264 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:36.115986  3569 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:36.116474  3569 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.117306  3569 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.115748  3379 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.121560 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.121243  3379 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.122138 30551 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.123919 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.124653  3456 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:36.125135  3456 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:36.125929  3456 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.113672  3507 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.129628  3507 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:36.060950  3360 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.062071  3566 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:36.087383  3564 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:36.135790  3564 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.097276 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:36.138279 30477 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 17: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:36.099685 30486 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:36.103449 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:36.139289 30479 raft_consensus.cc:2368] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15.
I20260709 13:11:36.137832  3360 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.100772  3556 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.137832  3564 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.140551 30402 raft_consensus.cc:2368] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:36.134503 30551 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:36.144661 30524 leader_election.cc:400] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19.
I20260709 13:11:36.148375 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.148975 30556 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.148855 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.149930 30560 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:36.154577  3556 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.147550 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.156152  3568 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:36.165366 30556 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:36.166236 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:36.167476 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:36.168227 30403 raft_consensus.cc:2393] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:36.168148 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.165411 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:36.151506 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 400567us
I20260709 13:11:36.170758 30374 leader_election.cc:400] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Vote denied by peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247) with higher term. Message: Invalid argument: T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15.
I20260709 13:11:36.171916 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.172946 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.179646 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:36.180414 30479 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.175396  3566 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:36.188005  3361 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:36.188434  3566 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:36.188640  3361 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:36.190874  3566 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.191128  3361 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.159411  3381 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:36.175560  3152 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.196148  3152 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.198269  3152 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.198350  3109 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.198918  3109 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.199999  3507 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.200919  3109 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.186085  3286 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:36.202924 30557 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:36.213339 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:36.214851 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:36.215699 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
I20260709 13:11:36.217492 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:36.219146 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:36.220690 30374 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.222592 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:36.186954  3564 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:36.230551 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.232363 31147 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:36.234977 31147 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:36.226765  3556 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:36.242744 31147 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:36.227603  3564 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:36.247620 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.248528 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:36.249529 30556 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:36.253778 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.256748  3556 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.260779 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.262161 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.268489  3286 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:36.277259 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.269140 30556 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:36.272584 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:36.280421 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.281553 30525 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.283365 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:36.253378  3564 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:36.286935 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.287011 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.290354 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:36.295913 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.295354 30301 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.298883 30479 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:36.299619 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:36.299955 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.302304  3392 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:36.301295  3109 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:36.301551  3013 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.303004  3386 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.300489 30301 catalog_manager.cc:5697] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 6 to 7, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 7 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.352667 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.355760 30376 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.357507 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.330610  3563 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:36.344341  3478 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:11:36.300999  3286 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:36.333189  3355 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:36.339254  3507 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:36.305369  3396 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:11:36.302839  3379 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:11:36.390125 30482 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:36.373721 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:36.387372 30551 raft_consensus.cc:1240] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:36.393563 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:36.369925  3563 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.375092  3152 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.378770  3555 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:36.383471  3436 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:36.304165  3456 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:11:36.405257  3563 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:36.402910  3459 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:36.351984  3556 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.403146  3363 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:36.440693 30557 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:11:36.441622 30557 pending_rounds.cc:85] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 7
I20260709 13:11:36.441860 30557 pending_rounds.cc:107] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:11:36.442229 30557 raft_consensus.cc:2889] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.412621  3568 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:36.457334  3568 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.459559  3568 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:36.439540  3506 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:36.465306  3506 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.437680  3608 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:36.496536  3608 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.410794  3447 consensus_queue.cc:1059] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:36.444013  3361 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:36.499022  3447 consensus_queue.cc:1243] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer ce312b0d7a1747c8898a748f8d76df81 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:36.499109  3361 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.500376  3447 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:36.500748  3447 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.501550  3447 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.505831 31149 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:36.456305  3363 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:36.509859  3386 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:36.510262  3386 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.510748  3363 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:36.511068  3386 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.518851  3447 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.525861  3386 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:36.531610 30551 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:36.539408 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:36.540344 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:36.550902 30403 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:36.553454  3612 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:36.554186 30301 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 18, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:36.555811 30301 catalog_manager.cc:5697] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 5 to 9, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 9 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.569849  3392 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:36.577982 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 140750us
I20260709 13:11:36.597057  3564 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.598420 30477 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:36.605741  3564 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.607821 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:36.609900  3608 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:36.610482  3361 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:36.610828  3506 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:36.617108 30560 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:36.633394 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.636868 30553 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:36.638947 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.640651 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:36.648484  3479 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.649024  3479 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.651135  3479 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:36.650381 30552 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:36.652180 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:36.651965 30301 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.654111  3479 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:36.653501 30301 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 17, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:36.656728 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:36.657217 30305 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 192) took 18222 ms (client timeout 15000 ms). Trace:
I20260709 13:11:36.657720 30301 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 15, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:36.661345 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:36.666801 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.674094 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:36.676687 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:36.679703 30477 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:36.682029 30477 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:36.685525 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.688169 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:36.695174  3131 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:36.695654 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.697599 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.700284 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:36.701953  3563 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.666275  3612 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:36.683535  3506 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:11:36.713574 30410 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:36.590564  3568 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:11:36.733101 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:36.739916 30404 raft_consensus.cc:2368] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:36.718065  3577 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:36.750244 30301 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.751245  3555 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:36.751713  3555 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:36.752007 30301 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 12, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:36.752600  3555 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.753873  3555 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.753844 30301 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 11, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:11:36.754822  3287 consensus_queue.cc:1175] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce312b0d7a1747c8898a748f8d76df81" responder_term: 15 status { last_received { term: 15 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:36.755520 30301 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.757156 30301 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 14, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 14 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.758278  3610 consensus_queue.cc:1059] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:36.759063  3610 consensus_queue.cc:1243] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:36.759670  3610 raft_consensus.cc:3055] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:36.760010  3610 raft_consensus.cc:740] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:36.759106 30301 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:36.760825  3610 consensus_queue.cc:260] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:36.761991  3610 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.761358 30301 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 11, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.731458  3506 consensus_queue.cc:1243] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 027e191e31da4af2bc83c5ddc0c15d05 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:11:36.657637 30305 rpcz_store.cc:269] 0709 13:11:18.434514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.437008 (+  2494us) service_pool.cc:224] Handling call
0709 13:11:36.657147 (+18220139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:33.865173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:33.865851 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:33.865905 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:11:33.865925 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:33.874896 (+  8971us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:33.874991 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:33.875025 (+    34us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:33.876511 (+  1486us) tablet.cc:701] Row locks acquired
0709 13:11:33.876564 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:11:33.876765 (+   201us) write_op.cc:270] Start()
0709 13:11:33.876922 (+   157us) write_op.cc:276] Timestamp: P: 1783602693876698 usec, L: 0
0709 13:11:33.876942 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:11:33.877620 (+   678us) log.cc:844] Serialized 7464 byte log entry
0709 13:11:34.739246 (+861626us) op_driver.cc:464] REPLICATION: finished
0709 13:11:35.608151 (+868905us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa041f9f0ac 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa048adfef0
0709 13:11:35.612001 (+  3850us) write_op.cc:301] APPLY: starting
0709 13:11:35.612089 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:35.844881 (+232792us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:35.844912 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:35.861208 (+ 16296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:35.861529 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:11:35.861576 (+    47us) write_op.cc:312] APPLY: finished
0709 13:11:35.861977 (+   401us) log.cc:844] Serialized 172 byte log entry
0709 13:11:36.072043 (+210066us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:36.072244 (+   201us) write_op.cc:454] Released schema lock
0709 13:11:36.072326 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:36.072800 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:36.072836 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2562610,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":872490,"apply.run_cpu_time_us":24544,"apply.run_wall_time_us":460746,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83623,"num_ops":19,"prepare.queue_time_us":298143,"prepare.run_cpu_time_us":26826,"prepare.run_wall_time_us":152696,"raft.queue_time_us":326636,"raft.run_cpu_time_us":15538,"raft.run_wall_time_us":881367,"replication_time_us":862147,"spinlock_wait_cycles":177439616,"thread_start_us":1619439,"threads_started":5,"wal-append.queue_time_us":364827,"wal-append.run_cpu_time_us":17314,"wal-append.run_wall_time_us":1557456}]]}
I20260709 13:11:36.739493  3131 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:36.781610 30450 leader_election.cc:400] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14.
I20260709 13:11:36.782003 30478 raft_consensus.cc:1240] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:36.809388 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 96674.4us
I20260709 13:11:36.755561  3569 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 13:11:36.820804 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 110425us
I20260709 13:11:36.763427 30301 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 18, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:11:36.843333  3611 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:36.816361  3608 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:36.812000  3447 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.996073 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:37.023268  3447 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.026430  3447 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:37.028084 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 295098us
I20260709 13:11:37.028251 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:37.028970 30478 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:37.009096 30301 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:11:37.013864  3616 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.195s	user 0.000s	sys 0.004s
W20260709 13:11:37.017035 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 206221us
I20260709 13:11:37.028927 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:36.843959  3131 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.030298 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:37.030908  3563 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:37.046922 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.062642  3619 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.253s	user 0.002s	sys 0.005s
I20260709 13:11:37.071971 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:37.047554  3617 log.cc:927] Time spent T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.307s	user 0.000s	sys 0.005s
I20260709 13:11:37.075363 30551 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:37.069742  3447 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:37.079466  3447 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.079833  3447 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:37.082743 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 91769us
W20260709 13:11:37.087096 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 58255.1us
I20260709 13:11:37.087807 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:37.089147 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:37.090233 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:37.092890 30402 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:11:37.093297 30402 pending_rounds.cc:85] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 8
I20260709 13:11:37.093160  3509 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:37.093828  3615 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:37.099237 30478 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:37.093756 30402 pending_rounds.cc:107] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:37.104238 30410 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:11:37.104379 30402 raft_consensus.cc:2889] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.104743 30410 pending_rounds.cc:85] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Aborting all ops after (but not including) 8
I20260709 13:11:37.105088 30410 pending_rounds.cc:107] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:37.105386 30410 raft_consensus.cc:2889] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.109123 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:37.109807 30551 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:37.112586 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68547.6us
W20260709 13:11:37.132391 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 330416us
I20260709 13:11:37.093170  3363 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.152536 30551 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:37.118412  3478 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:37.160364  3392 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.167160  3392 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.169216  3392 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:37.204252 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 113982us
W20260709 13:11:37.208168 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 106035us
W20260709 13:11:37.212049 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 101208us
I20260709 13:11:37.201910 30301 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 14, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 14 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:11:37.204124 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 101941us
I20260709 13:11:37.222764 30557 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:11:37.223431 30557 pending_rounds.cc:85] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 11
I20260709 13:11:37.223860 30557 pending_rounds.cc:107] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:37.224189 30557 raft_consensus.cc:2889] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.226538 30301 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 15, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 15 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.244350 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:37.248287  3152 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:37.248904 30559 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:37.250358 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:37.242343 30560 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:37.268018 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 163889us
I20260709 13:11:37.284247  3479 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.284610  3509 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.313627 30559 pending_rounds.cc:85] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting all ops after (but not including) 10
I20260709 13:11:37.314018 30559 pending_rounds.cc:107] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:37.314260 30559 raft_consensus.cc:2889] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:37.335212 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 205716us
I20260709 13:11:37.358108 30301 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 11 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:37.474792 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:37.497409 30301 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.500030 30301 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.502934 30376 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:37.507072  3612 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:37.507863  3612 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:37.509248  3612 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.570748  3569 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:37.599161  3360 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:37.607626  3447 consensus_meta.cc:287] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.009s
I20260709 13:11:37.608114  3447 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.611618 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:37.612353 30478 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.617288  3479 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:37.620836 30301 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 11, leader changed from <none> to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:37.624588 30301 catalog_manager.cc:5697] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:37.631047  3447 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:37.648762 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:37.649631 30557 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.670068 30402 raft_consensus.cc:1240] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:37.627637 30301 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:37.682878 30478 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:37.688745 30557 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:37.690299 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:37.709625  3447 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:37.710299  3447 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:37.711983  3447 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.741102 30301 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.744048 30301 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.747079  3633 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:37.745819 30301 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 8 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 11 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.761886  3610 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.748014  3633 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.765003  3633 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:37.787109  3131 consensus_queue.cc:1059] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:11:37.788228 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:37.789036 30405 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:37.802812 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:37.803831 30553 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:37.782279 30301 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.806452  3131 consensus_queue.cc:1243] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 0472fa7187444a91b443058ef89fceb9 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:37.830063 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:37.832687  3641 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:37.833143  3641 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:37.833588  3641 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.839573  3564 raft_consensus.cc:3055] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:37.840029  3564 raft_consensus.cc:740] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:37.840947  3564 consensus_queue.cc:260] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.842167  3564 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:37.848994 30301 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 12, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:37.872984  3641 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:37.914873  3652 log.cc:927] Time spent T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:37.916968  3641 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:37.917820  3650 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:37.917938 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:37.918797 30560 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:37.929699 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:37.931565 30556 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:37.936642  3612 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:37.936929 30410 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:37.943161 30450 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:37.944265  3641 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:37.944911  3641 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:37.945819  3641 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:37.990803 30482 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:37.991191 30482 pending_rounds.cc:85] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 7
I20260709 13:11:37.991433 30482 pending_rounds.cc:107] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:37.991644 30482 raft_consensus.cc:2889] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.993893  3612 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:38.159224 30482 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:38.162122  3569 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:38.268545 30560 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:38.280565  3569 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:38.412498 30301 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 199) took 5972 ms. Trace:
I20260709 13:11:38.413328 30301 rpcz_store.cc:276] 0709 13:11:32.440075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.440395 (+   320us) service_pool.cc:224] Handling call
0709 13:11:38.412317 (+5971922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.017637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.020037 (+  2400us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.020089 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:11:38.020125 (+    36us) tablet.cc:662] Decoding operations
0709 13:11:38.022419 (+  2294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.022532 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.022565 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:11:38.031077 (+  8512us) tablet.cc:701] Row locks acquired
0709 13:11:38.031130 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:11:38.037399 (+  6269us) write_op.cc:270] Start()
0709 13:11:38.038908 (+  1509us) write_op.cc:276] Timestamp: P: 1783602698036942 usec, L: 0
0709 13:11:38.039342 (+   434us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.040242 (+   900us) log.cc:844] Serialized 11380 byte log entry
0709 13:11:38.116645 (+ 76403us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.130566 (+ 13921us) write_op.cc:301] APPLY: starting
0709 13:11:38.130674 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.197449 (+ 66775us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.197581 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.327430 (+129849us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.341633 (+ 14203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:11:38.341703 (+    70us) write_op.cc:312] APPLY: finished
0709 13:11:38.343220 (+  1517us) log.cc:844] Serialized 252 byte log entry
0709 13:11:38.343426 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.343644 (+   218us) write_op.cc:454] Released schema lock
0709 13:11:38.343727 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.355847 (+ 12120us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.355884 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":417636,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":13600,"apply.run_cpu_time_us":37425,"apply.run_wall_time_us":222697,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125463,"num_ops":29,"prepare.queue_time_us":32667,"prepare.run_cpu_time_us":12723,"prepare.run_wall_time_us":76258,"raft.queue_time_us":41630,"raft.run_cpu_time_us":9766,"raft.run_wall_time_us":18751,"replication_time_us":77117,"spinlock_wait_cycles":323840,"thread_start_us":102493,"threads_started":4,"wal-append.queue_time_us":30879}]]}
I20260709 13:11:38.421270 30560 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:38.437213 30307 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.439730 30402 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:38.439585  3564 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:38.446307  3564 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:38.463212  3628 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:38.463900  3628 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:38.468240 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:38.469873 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:38.472186 30525 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:38.473076  3610 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:38.475607  3628 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:38.538513 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:38.527971 30307 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:38.564109 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:38.561503 30307 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 5 to 10, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 10 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.589015  3671 tablet_replica.cc:333] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:11:38.590283  3671 raft_consensus.cc:2243] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:38.592212 30307 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.594564  3671 raft_consensus.cc:2272] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:38.608865  3671 ts_tablet_manager.cc:1916] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:38.659232  3671 ts_tablet_manager.cc:1929] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:11:38.659843  3671 log.cc:1199] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/3d180da17ba548e0ab1ebdfa7dfc1f0a
I20260709 13:11:38.662820 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:38.738039 30303 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.740831 30303 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:38.749956 30307 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 202) took 31047 ms (client timeout 15000 ms). Trace:
W20260709 13:11:38.752234 30307 rpcz_store.cc:269] 0709 13:11:07.706630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.707905 (+  1275us) service_pool.cc:224] Handling call
0709 13:11:09.114929 (+1407024us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:11:38.749838 (+29634909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.639628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.640155 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.640189 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:11:38.640206 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:38.640797 (+   591us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.640873 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.640901 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:11:38.641258 (+   357us) tablet.cc:701] Row locks acquired
0709 13:11:38.641276 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:38.641411 (+   135us) write_op.cc:270] Start()
0709 13:11:38.641520 (+   109us) write_op.cc:276] Timestamp: P: 1783602698641363 usec, L: 0
0709 13:11:38.641553 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.642193 (+   640us) log.cc:844] Serialized 1684 byte log entry
0709 13:11:38.672655 (+ 30462us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.674909 (+  2254us) write_op.cc:301] APPLY: starting
0709 13:11:38.674996 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.677227 (+  2231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.677310 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.700081 (+ 22771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.700546 (+   465us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:11:38.700588 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:38.700809 (+   221us) log.cc:844] Serialized 49 byte log entry
0709 13:11:38.700989 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.701082 (+    93us) write_op.cc:454] Released schema lock
0709 13:11:38.701134 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.701490 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.701517 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":479433,"reported_tablets":52,"spinlock_wait_cycles":86536320,"child_traces":[["op",{"apply.queue_time_us":2005,"apply.run_cpu_time_us":6403,"apply.run_wall_time_us":26530,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16736,"num_ops":4,"prepare.queue_time_us":40469,"prepare.run_cpu_time_us":2915,"prepare.run_wall_time_us":31981,"replication_time_us":30931,"thread_start_us":43687,"threads_started":1}]]}
I20260709 13:11:38.750789 30303 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 17 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 20 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.757238 30303 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.764901 30303 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 10 to 12, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.772859 30303 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 13 to 17, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 17 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.777637 30303 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 13 to 17, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:38.830895 30301 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.832288 30301 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.833803 30301 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 20 to 22, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 22 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.835325 30301 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 15, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.836786 30301 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.848417 30303 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with cas_config_opid_index 5: aborting the task: latest config opid_index 9; task opid_index 5
W20260709 13:11:38.851402 30303 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 105) took 14048 ms (client timeout 15000 ms). Trace:
W20260709 13:11:38.851738 30295 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 2e1b5d40df944767ab310e2bd822d5b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 7
I20260709 13:11:38.837937 30301 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.856686 30301 catalog_manager.cc:5697] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:38.887442 30301 catalog_manager.cc:5697] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:38.892642 30301 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 16, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
W20260709 13:11:38.854413 30303 rpcz_store.cc:269] 0709 13:11:24.803060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.803287 (+   227us) service_pool.cc:224] Handling call
0709 13:11:38.851318 (+14048031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.783927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.784472 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.784514 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:11:38.784532 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:38.785316 (+   784us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.785380 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.785409 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:38.785996 (+   587us) tablet.cc:701] Row locks acquired
0709 13:11:38.786015 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:38.786165 (+   150us) write_op.cc:270] Start()
0709 13:11:38.786292 (+   127us) write_op.cc:276] Timestamp: P: 1783602698786111 usec, L: 0
0709 13:11:38.786314 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.786998 (+   684us) log.cc:844] Serialized 2814 byte log entry
0709 13:11:38.788841 (+  1843us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.789141 (+   300us) write_op.cc:301] APPLY: starting
0709 13:11:38.789218 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.792737 (+  3519us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.792817 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.811068 (+ 18251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.811268 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:11:38.811311 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:38.811583 (+   272us) log.cc:844] Serialized 73 byte log entry
0709 13:11:38.812319 (+   736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.812431 (+   112us) write_op.cc:454] Released schema lock
0709 13:11:38.812483 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.812829 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.812860 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":133,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":97,"apply.run_cpu_time_us":8992,"apply.run_wall_time_us":23665,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29288,"num_ops":7,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":3405,"prepare.run_wall_time_us":3414,"replication_time_us":2399}]]}
I20260709 13:11:38.926643 30301 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.928810 30301 catalog_manager.cc:5697] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 16, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.930188 30301 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.935570 30301 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.943971 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:38.937311 30301 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.983798 30301 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.985177 30301 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 15, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.992312 30301 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.993781 30301 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.995293 30301 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:38.996652 30301 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.997887 30301 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 15 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:38.999285 30301 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 17, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.040400 30301 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 14, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:39.114471 31152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:39.115244 31152 raft_consensus.cc:606] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:39.115641 31152 raft_consensus.cc:630] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Rejecting request to transfer leadership because tablet server 0472fa7187444a91b443058ef89fceb9 is not a voter in the active config
I20260709 13:11:39.121100 31152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:39.121651 31152 raft_consensus.cc:606] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:39.124245 31152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:39.124794 31152 raft_consensus.cc:606] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:39.125834 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:39.135653 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:39.161300 30302 catalog_manager.cc:5697] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 3 to 7, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 8 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.175377 30302 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.176836 30302 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 9 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.179687 30302 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.181505 30302 catalog_manager.cc:5697] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 5 to 11, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 12 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.183314 30302 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.187862 30302 catalog_manager.cc:5697] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.291112 30306 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with cas_config_opid_index 5: aborting the task: latest config opid_index 9; task opid_index 5
I20260709 13:11:39.291867 30306 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet ba4c05796efa42489d11c8a49ba476ad with cas_config_opid_index 5: aborting the task: latest config opid_index 11; task opid_index 5
I20260709 13:11:39.292469 30306 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 2e1b5d40df944767ab310e2bd822d5b0 with cas_config_opid_index 3: aborting the task: latest config opid_index 7; task opid_index 3
W20260709 13:11:39.293887 30306 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 103) took 56374 ms (client timeout 15000 ms). Trace:
W20260709 13:11:39.294288 30306 rpcz_store.cc:269] 0709 13:10:42.919312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.919558 (+   246us) service_pool.cc:224] Handling call
0709 13:11:39.293783 (+56374225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160140,"reported_tablets":21}
I20260709 13:11:39.295544  3635 raft_consensus.cc:993] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:39.303073  3635 raft_consensus.cc:1081] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:39.304965 30402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:11:39.305563 30402 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.305888 30402 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.315820 30402 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.320299 30402 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:39.319176 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:39.321277 30486 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.322060 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:39.322629 31152 raft_consensus.cc:3055] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:39.322939 31152 raft_consensus.cc:740] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:39.331475 31152 consensus_queue.cc:260] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.332772 31152 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.336284 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:39.340570 30559 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.344808 30302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 193) took 2878 ms. Trace:
I20260709 13:11:39.348850 30486 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:39.354008 31152 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:39.352162 30374 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:39.345247 30302 rpcz_store.cc:276] 0709 13:11:36.466162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.466316 (+   154us) service_pool.cc:224] Handling call
0709 13:11:39.344717 (+2878401us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:39.193577 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:39.194069 (+   492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:39.194105 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:39.194120 (+    15us) tablet.cc:662] Decoding operations
0709 13:11:39.194885 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:39.194934 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:39.194959 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:39.195510 (+   551us) tablet.cc:701] Row locks acquired
0709 13:11:39.195528 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:39.195667 (+   139us) write_op.cc:270] Start()
0709 13:11:39.195794 (+   127us) write_op.cc:276] Timestamp: P: 1783602699195624 usec, L: 0
0709 13:11:39.195822 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:39.198537 (+  2715us) log.cc:844] Serialized 2814 byte log entry
0709 13:11:39.201640 (+  3103us) op_driver.cc:464] REPLICATION: finished
0709 13:11:39.201925 (+   285us) write_op.cc:301] APPLY: starting
0709 13:11:39.202001 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:39.205465 (+  3464us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:39.205554 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:39.209520 (+  3966us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:39.209706 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:11:39.209749 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:39.210022 (+   273us) log.cc:844] Serialized 73 byte log entry
0709 13:11:39.213366 (+  3344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:39.213468 (+   102us) write_op.cc:454] Released schema lock
0709 13:11:39.213514 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:39.219448 (+  5934us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:39.219477 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":185,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":8683,"apply.run_wall_time_us":11855,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29288,"num_ops":7,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":3284,"prepare.run_wall_time_us":7774,"replication_time_us":5687,"spinlock_wait_cycles":1684224}]]}
I20260709 13:11:39.382257 31149 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:39.383699  3447 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:39.385421 30402 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:39.386852  3628 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:11:39.403278  3610 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:39.406750 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:39.439682  3447 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:39.471027  3447 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:39.511740 30309 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 201) took 49593 ms (client timeout 15000 ms). Trace:
W20260709 13:11:39.512732 30309 rpcz_store.cc:269] 0709 13:10:49.917043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.917343 (+   300us) service_pool.cc:224] Handling call
0709 13:11:39.510630 (+49593287us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":52}
I20260709 13:11:39.532859  3610 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 7 to 10, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.536374 31152 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.595270 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 406b169640e341629c55637d07dd3d47 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:39.642535  3674 raft_consensus.cc:993] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:39.643214  3674 raft_consensus.cc:1081] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:39.655686 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1b5d40df944767ab310e2bd822d5b0 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:50714
I20260709 13:11:39.665659 30302 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 15, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 15 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.668241 30393 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4c05796efa42489d11c8a49ba476ad with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50714
I20260709 13:11:39.670009  3686 tablet_replica.cc:333] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:11:39.676261 30402 raft_consensus.cc:2955] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.691841 30405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:11:39.692711 30405 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.693492 30405 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:39.693717  3686 raft_consensus.cc:2243] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.694753  3686 raft_consensus.cc:2272] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.701926  3686 ts_tablet_manager.cc:1916] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.705415 30405 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.721517 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:39.722196 30553 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:39.760437 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:39.761193 31152 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:39.761530 31152 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:39.762413 31152 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.764282 31152 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:39.763362 30405 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:39.814096 31152 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:39.815852 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:39.816767  3682 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:39.817332  3682 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:39.817948 30302 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 7 to 10, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 11 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.818240  3682 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:39.823015 30309 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 18, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:39.866533 30553 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:39.912092 30302 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 10, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 10 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:39.926162 30308 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 203) took 12330 ms (client timeout 15000 ms). Trace:
I20260709 13:11:39.937922  3686 ts_tablet_manager.cc:1929] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 13:11:39.938508  3686 log.cc:1199] T 2e1b5d40df944767ab310e2bd822d5b0 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/2e1b5d40df944767ab310e2bd822d5b0
W20260709 13:11:39.926630 30308 rpcz_store.cc:269] 0709 13:11:27.595445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.597970 (+  2525us) service_pool.cc:224] Handling call
0709 13:11:39.925963 (+12327993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74078,"reported_tablets":52}
I20260709 13:11:39.941082 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 2e1b5d40df944767ab310e2bd822d5b0 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:39.943841  3686 tablet_replica.cc:333] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:11:39.945197  3686 raft_consensus.cc:2243] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.947319  3686 pending_rounds.cc:70] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Trying to abort 1 pending ops.
I20260709 13:11:39.947700  3686 pending_rounds.cc:77] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7305636587816919040 op_type: NO_OP noop_request { }
I20260709 13:11:39.949230  3686 raft_consensus.cc:2889] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:39.949754  3686 raft_consensus.cc:2272] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.953351  3686 ts_tablet_manager.cc:1916] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.977705  3686 ts_tablet_manager.cc:1929] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:11:39.988409 30303 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 106) took 1005 ms. Trace:
I20260709 13:11:39.988885 30303 rpcz_store.cc:276] 0709 13:11:38.980927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.981192 (+   265us) service_pool.cc:224] Handling call
0709 13:11:38.989175 (+  7983us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:11:39.986064 (+996889us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9361,"reported_tablets":20,"spinlock_wait_cycles":10449280}
I20260709 13:11:39.996366 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:39.986627  3686 log.cc:1199] T ba4c05796efa42489d11c8a49ba476ad P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/ba4c05796efa42489d11c8a49ba476ad
I20260709 13:11:40.016186 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 406b169640e341629c55637d07dd3d47 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38756
I20260709 13:11:40.017421 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 3d180da17ba548e0ab1ebdfa7dfc1f0a (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
W20260709 13:11:40.027431 30304 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 191) took 42573 ms (client timeout 15000 ms). Trace:
I20260709 13:11:40.046588 31152 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:40.046948 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet ba4c05796efa42489d11c8a49ba476ad (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
W20260709 13:11:40.028012 30304 rpcz_store.cc:269] 0709 13:10:57.454596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.458875 (+  4279us) service_pool.cc:224] Handling call
0709 13:10:57.663793 (+204918us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:11:40.027296 (+42363503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247555,"reported_tablets":52,"spinlock_wait_cycles":31139584}
I20260709 13:11:40.048677  3691 tablet_replica.cc:333] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:11:40.050295  3691 raft_consensus.cc:2243] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.051357  3691 raft_consensus.cc:2272] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.050326  3682 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:11:40.075702 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 57375.3us
I20260709 13:11:40.081771 30482 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:40.085022  3682 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:40.102769  3691 ts_tablet_manager.cc:1916] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:40.136783 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:40.158141  3691 ts_tablet_manager.cc:1929] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:11:40.170877  3691 log.cc:1199] T 406b169640e341629c55637d07dd3d47 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/406b169640e341629c55637d07dd3d47
I20260709 13:11:40.188915 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 406b169640e341629c55637d07dd3d47 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:40.312860 31149 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:40.317238  3682 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:40.337466 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 406b169640e341629c55637d07dd3d47 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:38756
I20260709 13:11:40.356503 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 406b169640e341629c55637d07dd3d47 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:40.409200 30560 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:40.449954  3447 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:40.507293 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 78260.7us
I20260709 13:11:41.042909 30482 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:11:41.060526 30451 consensus_peers.cc:597] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0500eacf70c44cb5bb9527f23aea9b1d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.063354 30553 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:41.066138  3692 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:41.084654 30405 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:41.086349  3641 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:41.114871  3131 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.121064 30560 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.132464 30404 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.131011 30482 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:41.157017 30303 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.186808 30405 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:41.196499 30556 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:11:41.199762 30451 consensus_peers.cc:597] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1640dd5756f749fd8546ca110299cc59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.204154  3712 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:41.208654  3714 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:41.231384  3641 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.235656 30402 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.313177 30304 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.321323 30405 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:11:41.340363 30376 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d97aadeef4e4fb9b4f6d566a7908278. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.345258 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:41.354302 30560 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.361222 30553 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:41.363415 30482 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:41.384912  3447 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:41.390790  3702 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:41.418169 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 61647.2us
I20260709 13:11:41.421043 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:41.421716 30484 raft_consensus.cc:606] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:41.434888 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:41.435563 30484 raft_consensus.cc:606] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:41.438516 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:41.439184 30484 raft_consensus.cc:606] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:41.442453 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:41.443086 30486 raft_consensus.cc:606] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:41.445935 30486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b473589cd94be59022580022e2de00"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:41.446494 30486 raft_consensus.cc:606] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:41.447845 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:41.449560 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:41.460723  3131 raft_consensus.cc:993] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.461261  3131 raft_consensus.cc:1081] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.473237 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:41.473834 30559 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.474195 30559 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:41.482475 30559 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.488485 30559 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:41.488965  3641 raft_consensus.cc:993] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.489526  3641 raft_consensus.cc:1081] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.491523 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:41.491992 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:41.492578 30404 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:41.492143 30486 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:41.494874 30486 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:41.495699 30486 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.497087 30486 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:41.509951  3702 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.535940 30556 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.491590 30560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:41.552659 30560 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.553151 30560 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.566612 30404 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:41.567495 30482 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:41.568064 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:41.569151  3666 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:41.569882  3666 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:41.570794  3666 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.575187 30484 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index -1 to 14, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.590175 30486 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:41.599756 30304 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 14, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.604714 30560 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.609191 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:41.609783 30404 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.631366 30560 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:41.642529 30402 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:41.644971 30451 consensus_peers.cc:597] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88cc3e301acf441dab14eb0be7a54db1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.653025 30555 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:41.657356 30404 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:41.655860 30309 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 16 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.699524 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:41.701678 30482 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.702983 30482 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:41.722427 30482 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.724402  3131 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:41.728875 30482 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.731233  3727 ts_tablet_manager.cc:933] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:41.732636 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46477.9us
I20260709 13:11:41.740734 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:41.746670  3712 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:41.760017  3641 raft_consensus.cc:993] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:41.760492  3641 raft_consensus.cc:1081] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:41.768819 30402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4b473589cd94be59022580022e2de00"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53716
I20260709 13:11:41.772059  3685 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.769677 30402 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.774174 30402 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.772699  3727 tablet_copy_client.cc:323] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:11:41.783960  3685 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:41.785972  3685 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:41.825704 30482 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:41.838724  3730 ts_tablet_manager.cc:933] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:41.848057 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 0500eacf70c44cb5bb9527f23aea9b1d from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:11:41.869853 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 0500eacf70c44cb5bb9527f23aea9b1d from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-0500eacf70c44cb5bb9527f23aea9b1d
I20260709 13:11:41.861459  3564 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.867538  3692 raft_consensus.cc:993] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.877943  3712 raft_consensus.cc:1081] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:41.877744 30404 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.880784 30402 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:41.887617 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:41.888237 30482 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.888597 30482 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:41.889369 30482 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:41.890502 30482 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.894289 30496 tablet_copy_source_session.cc:215] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:41.895212 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:41.896051 31152 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.895565 30402 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:41.900004  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500eacf70c44cb5bb9527f23aea9b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.901620 30482 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:41.908478 30374 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:41.920920 30309 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:41.943104 31152 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:41.945011  3702 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.967272  3702 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:41.968182  3702 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:41.997049 30304 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 13 to 14, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.018848  3739 ts_tablet_manager.cc:933] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:11:42.023391 30402 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:42.025238  3685 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:42.031097  3730 tablet_copy_client.cc:323] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
W20260709 13:11:42.033859 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 170016us
I20260709 13:11:42.037341 30482 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:42.038722  3734 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:42.054308 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 1640dd5756f749fd8546ca110299cc59 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:11:42.055001 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 1640dd5756f749fd8546ca110299cc59 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-1640dd5756f749fd8546ca110299cc59
I20260709 13:11:42.062429 30560 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:42.067272 30556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:42.067690  3739 tablet_copy_client.cc:323] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:11:42.067967 30556 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:42.068420 30556 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.069744 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet 3d97aadeef4e4fb9b4f6d566a7908278 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:11:42.070361 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet 3d97aadeef4e4fb9b4f6d566a7908278 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-3d97aadeef4e4fb9b4f6d566a7908278
I20260709 13:11:42.075174 30496 tablet_copy_source_session.cc:215] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:42.079917  3564 raft_consensus.cc:993] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:42.080422  3564 raft_consensus.cc:1081] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:42.083316 30421 tablet_copy_source_session.cc:215] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:42.075361 30556 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:42.090899 30405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53716
I20260709 13:11:42.091503 30405 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:42.091866 30405 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.096293 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:42.096894 30404 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.096527 30309 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 13 to 14, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 14 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.086164  3730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1640dd5756f749fd8546ca110299cc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.114993  3739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d97aadeef4e4fb9b4f6d566a7908278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.123317 30556 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:42.123046 30404 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:42.127796 30409 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:42.129225 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:42.129993 30478 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:42.130369 30478 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:42.132083 30524 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:42.128399 30405 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:42.138482 30405 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:42.131062 30478 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:42.139727 30478 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.142014 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:42.142607 30556 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.144762 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:42.145329 30484 raft_consensus.cc:3055] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:42.145630 30484 raft_consensus.cc:740] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:42.146754 30484 consensus_queue.cc:260] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:42.147786 30484 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.136384  3666 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:42.154189  3666 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:42.158464  3727 tablet_copy_client.cc:806] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.162210  3727 tablet_copy_client.cc:670] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.155105  3666 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:42.176034 30478 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:42.179605 30484 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:42.186828 30374 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:42.187937  3723 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:42.188422  3723 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:42.189205  3723 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:42.195147  3727 tablet_copy_client.cc:538] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.247413 30556 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
W20260709 13:11:42.254858 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64106.9us
I20260709 13:11:42.253871 30309 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 19 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.321072  3748 ts_tablet_manager.cc:933] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:42.345498 30556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:42.346136 30556 raft_consensus.cc:606] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Received request to transfer leadership
I20260709 13:11:42.358461 30482 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:11:42.371486 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 114033us
I20260709 13:11:42.377950 30402 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:42.378934 30556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:42.379415 30556 raft_consensus.cc:606] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Received request to transfer leadership
I20260709 13:11:42.387998  3748 tablet_copy_client.cc:323] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:11:42.389739 30496 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 88cc3e301acf441dab14eb0be7a54db1 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:11:42.390460 30496 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 88cc3e301acf441dab14eb0be7a54db1 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-88cc3e301acf441dab14eb0be7a54db1
W20260709 13:11:42.390668 30295 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0500eacf70c44cb5bb9527f23aea9b1d already in progress [suppressed 6 similar messages]
I20260709 13:11:42.400322 30496 tablet_copy_source_session.cc:215] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:42.376653  3666 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:42.420354  3748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88cc3e301acf441dab14eb0be7a54db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.420709 30309 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 15 to 16, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.421721  3685 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:42.428534  3727 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:42.434141  3730 tablet_copy_client.cc:806] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.450469 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:42.453008  3739 tablet_copy_client.cc:806] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.453598  3739 tablet_copy_client.cc:670] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.470760  3730 tablet_copy_client.cc:670] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.474861  3730 tablet_copy_client.cc:538] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.482301 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:42.482990 30551 raft_consensus.cc:606] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Received request to transfer leadership
W20260709 13:11:42.487422 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67637.4us
W20260709 13:11:42.497244 30357 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:11:42.497742 30357 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0500eacf70c44cb5bb9527f23aea9b1d already in progress
W20260709 13:11:42.498021 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0500eacf70c44cb5bb9527f23aea9b1d already in progress
I20260709 13:11:42.536828 30477 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:42.538143  3702 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:42.549477 30295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 60893.9us
W20260709 13:11:42.558596 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 80453.8us
I20260709 13:11:42.564873  3730 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:42.581389  3739 tablet_copy_client.cc:538] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.593549  3748 tablet_copy_client.cc:806] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.624003  3748 tablet_copy_client.cc:670] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.620649  3727 tablet_bootstrap.cc:700] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Time spent opening tablet: real 0.154s	user 0.003s	sys 0.000s
I20260709 13:11:42.635278 31149 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:42.637921  3748 tablet_copy_client.cc:538] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.650311  3739 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:42.655175  3723 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:42.673000  3748 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:42.740847 30477 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:42.742666  3723 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:42.747922 30551 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:42.755354  3752 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:42.758173 30405 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:42.765132  3685 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:42.770377 30525 consensus_peers.cc:597] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.838056 30484 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:42.840438  3666 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:42.898351  3726 raft_consensus.cc:993] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:42.898880  3726 raft_consensus.cc:1081] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:42.902139 30404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53732
I20260709 13:11:42.922611 30404 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:42.923054 30404 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:42.943778  3765 log.cc:927] Time spent T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:42.987991 30404 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.047660 30404 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:43.056964  3727 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.058135  3727 tablet_bootstrap.cc:492] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
W20260709 13:11:43.085705  3769 log.cc:927] Time spent T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:43.088714  3730 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.089787  3730 tablet_bootstrap.cc:492] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:11:43.103607  3727 ts_tablet_manager.cc:1403] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.675s	user 0.043s	sys 0.035s
I20260709 13:11:43.090569  3730 ts_tablet_manager.cc:1403] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.526s	user 0.030s	sys 0.013s
I20260709 13:11:43.112818 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:43.113493 30477 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.122959 30477 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 20.
I20260709 13:11:43.123948 30482 raft_consensus.cc:1240] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:43.125582 30374 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:43.126370  3723 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:43.126935  3723 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
W20260709 13:11:43.130806 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65590us
I20260709 13:11:43.130927  3733 consensus_queue.cc:1059] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:43.132740  3734 raft_consensus.cc:3055] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:43.133137  3734 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:43.133978  3734 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.134140  3730 raft_consensus.cc:359] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.135056  3730 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:11:43.135731  3730 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.137566  3730 ts_tablet_manager.cc:1434] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 13:11:43.140558  3727 raft_consensus.cc:359] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.127904  3723 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.145179  3734 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.184742  3748 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.185619  3748 tablet_bootstrap.cc:492] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:11:43.186471  3748 ts_tablet_manager.cc:1403] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.514s	user 0.047s	sys 0.021s
I20260709 13:11:43.149389 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:43.163576 30496 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-1640dd5756f749fd8546ca110299cc59 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:11:43.187141 30496 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-1640dd5756f749fd8546ca110299cc59 on tablet 1640dd5756f749fd8546ca110299cc59 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:43.188763  3727 raft_consensus.cc:740] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:11:43.189529  3727 consensus_queue.cc:260] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.193305  3748 raft_consensus.cc:359] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.210934  3748 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:11:43.212021  3748 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.199765 30559 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 20.
I20260709 13:11:43.215407  3748 ts_tablet_manager.cc:1434] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:11:43.216938  3727 ts_tablet_manager.cc:1434] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.002s
I20260709 13:11:43.217926 30496 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-88cc3e301acf441dab14eb0be7a54db1 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:11:43.218364 30496 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-88cc3e301acf441dab14eb0be7a54db1 on tablet 88cc3e301acf441dab14eb0be7a54db1 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:43.219579 30495 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-0500eacf70c44cb5bb9527f23aea9b1d received from {username='slave'} at 127.0.0.1:43256
I20260709 13:11:43.219985 30495 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-0500eacf70c44cb5bb9527f23aea9b1d on tablet 0500eacf70c44cb5bb9527f23aea9b1d with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:43.225483 31149 raft_consensus.cc:1217] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
W20260709 13:11:43.201141 30376 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.152.62:45705, user_credentials={real_user=slave}} blocked reactor thread for 57500.1us
I20260709 13:11:43.245333  3739 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.262825  3739 tablet_bootstrap.cc:492] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:11:43.263605  3739 ts_tablet_manager.cc:1403] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.614s	user 0.048s	sys 0.022s
I20260709 13:11:43.263893 31149 raft_consensus.cc:1217] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 13:11:43.271018  3739 raft_consensus.cc:359] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.275151  3739 raft_consensus.cc:740] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:11:43.266781 30302 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 19 to 20, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 20 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.275853  3739 consensus_queue.cc:260] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:43.390184  3739 ts_tablet_manager.cc:1434] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.126s	user 0.011s	sys 0.000s
I20260709 13:11:43.392230 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-3d97aadeef4e4fb9b4f6d566a7908278 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:11:43.392764 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-3d97aadeef4e4fb9b4f6d566a7908278 on tablet 3d97aadeef4e4fb9b4f6d566a7908278 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:43.493906 31147 raft_consensus.cc:1217] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 LEARNER]: Deduplicated request from leader. Original: 17.13->[17.14-17.14]   Dedup: 17.14->[]
I20260709 13:11:43.592953 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.619127  3641 raft_consensus.cc:1064] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:11:43.621425  3641 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:43.689137 31147 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:43.691089 30560 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:43.693504  3564 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:43.696925  3131 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:43.705307 30405 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:43.710331  3564 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:43.754977 31147 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Advancing to term 20
I20260709 13:11:43.761878  3564 raft_consensus.cc:1064] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:11:43.764261 31147 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:43.776315 30478 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:43.768338 30551 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:43.778007  3564 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:43.787350  3641 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:43.796856 30405 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:43.801285 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:43.801942 30478 raft_consensus.cc:606] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:43.779156  3723 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:11:43.805193 30404 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:43.807466  3131 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:43.807684 30551 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:43.808772 31147 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:43.811039  3131 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:11:43.815222  3131 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:43.815351 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:43.835286 30477 raft_consensus.cc:606] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:43.827316  3722 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:11:43.863289 31149 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:43.913203  3131 raft_consensus.cc:993] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:43.919222  3712 raft_consensus.cc:1081] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:43.897545  3749 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:11:43.928982 30551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:43.929602 30551 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.929961 30551 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:43.931223 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:43.931874 30477 raft_consensus.cc:606] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:43.927817 30302 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.977813  3641 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:11:43.991266 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74021.3us
I20260709 13:11:43.996909 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:43.997675 30478 raft_consensus.cc:606] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:44.033581 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:44.037297 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:44.033243 30559 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.034053 30551 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:44.061365 30560 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:44.078220 30402 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.080302 30551 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:44.094306 31147 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.154085 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:44.161551 30477 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:44.161984 30477 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:44.162802 30477 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:44.176352  3796 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:44.159071  3780 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:44.204576 30477 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:44.215188 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43598.6us
W20260709 13:11:44.217779 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 141226us
W20260709 13:11:44.232332 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 67141.4us
I20260709 13:11:44.235273 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:44.236140 30405 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.242653  3795 raft_consensus.cc:993] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:44.243281  3795 raft_consensus.cc:1081] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:44.295197 30304 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.334024 30405 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:44.358816 30477 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:44.408519 30551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:44.409092 30551 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.409420 30551 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:44.403090  3782 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.175s	user 0.006s	sys 0.011s
I20260709 13:11:44.438016 30551 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:44.473369 30551 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:44.502776 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:44.506639 30409 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.531687 30409 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:44.537597 30524 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:44.546054 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73357.4us
I20260709 13:11:44.549302 30524 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:44.545866  3793 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:44.556102 30406 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:44.579979 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:44.591853 31149 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.596951 31149 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:44.561010  3814 raft_consensus.cc:2804] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:44.640537 30479 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:44.664562 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 254167us
I20260709 13:11:44.646394  3814 raft_consensus.cc:697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:44.654757  3793 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:44.659101  3796 raft_consensus.cc:993] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:44.669011  3793 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:44.672160  3786 raft_consensus.cc:1064] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:11:44.677148  3786 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:44.691237  3814 consensus_queue.cc:237] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:44.694670 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 140864us
I20260709 13:11:44.722579 31149 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:11:44.727974  3802 raft_consensus.cc:1064] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:11:44.731362  3802 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:44.734575 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 70781.5us
I20260709 13:11:44.735749 30479 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:44.736552  3564 consensus_queue.cc:1059] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:44.737633  3712 raft_consensus.cc:3055] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:44.738044  3712 raft_consensus.cc:740] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:44.738893  3712 consensus_queue.cc:260] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:44.739336  3807 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:44.740319  3796 raft_consensus.cc:1081] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:11:44.743419  3723 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:44.744421  3712 raft_consensus.cc:3060] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.753584  3564 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.764607 30477 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:44.766731  3723 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:44.780360 31149 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.785848 30303 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:44.787576 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 52267.6us
I20260709 13:11:44.792380 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88cc3e301acf441dab14eb0be7a54db1 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:44.802191 31147 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:44.802910 30402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53716
I20260709 13:11:44.803570 30402 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.804000 30402 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.804823 31152 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:44.808024 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 88cc3e301acf441dab14eb0be7a54db1 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:50714
I20260709 13:11:44.813946 30402 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:44.817102 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 269286us
I20260709 13:11:44.820708  3795 raft_consensus.cc:993] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:44.821295  3795 raft_consensus.cc:1081] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:44.831187 30559 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:44.841665  3825 tablet_replica.cc:333] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:11:44.847457 30559 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:44.860100 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:44.861071  3825 raft_consensus.cc:2243] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.868235 30477 raft_consensus.cc:2468] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:44.875591 30304 catalog_manager.cc:5697] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 15 to 16, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 16 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.877278  3825 raft_consensus.cc:2272] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:44.877765 30450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.880620  3802 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:44.882171  3825 ts_tablet_manager.cc:1916] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:44.882814  3749 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:44.893603 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:44.893797 30402 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:44.894285 30479 raft_consensus.cc:3055] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:44.894626 30479 raft_consensus.cc:740] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:44.895396 30479 consensus_queue.cc:260] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:44.896458 30479 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.906188 30479 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:44.877485 30304 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 12 to 11, term changed from 16 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:44.907816 30374 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:44.932464  3723 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:44.933123  3723 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:44.934129  3723 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:44.950351 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 58436us
I20260709 13:11:44.950137  3825 ts_tablet_manager.cc:1929] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 13:11:44.957887  3749 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:44.953804  3825 log.cc:1199] T 88cc3e301acf441dab14eb0be7a54db1 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/88cc3e301acf441dab14eb0be7a54db1
I20260709 13:11:44.960309 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 88cc3e301acf441dab14eb0be7a54db1 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:44.963299 30560 raft_consensus.cc:1240] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:44.963936 30559 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:11:44.967412  3753 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:44.973769 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:44.974328 30556 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:44.988451 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:11:44.989046 30559 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.989404 30559 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.987185 30304 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 15 to 16, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.001493 30402 raft_consensus.cc:1240] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:45.015111 30556 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:45.016969 30559 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:45.029515 30559 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:45.039142 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.045279 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:45.046065 30406 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:45.055764 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:45.056413 30479 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:45.056699 30479 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:45.057400 30479 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:45.059998 30479 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:45.057374  3795 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:11:45.076007 30411 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:45.105551 30551 raft_consensus.cc:2955] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.106458 30477 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:45.117800  3723 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.118227  3722 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.146993  3734 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:45.154678 31147 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:45.156504  3685 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:45.157317 30479 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:45.158165 30406 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:45.158505  3685 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:45.158987 30411 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:45.177444 31149 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.187325 30524 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:45.187044 31152 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.211555 30479 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:45.223815 30477 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.211380  3821 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:45.256857  3814 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:11:45.318449 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 69461.5us
W20260709 13:11:45.378676 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 172951us
I20260709 13:11:45.389479 30406 raft_consensus.cc:1275] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:45.384908 30304 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1), VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2), VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3), VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.433269  3821 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:45.434444  3821 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:45.434615 30477 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.443547  3819 consensus_queue.cc:1048] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:45.445469  3785 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.469329 30304 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 12 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.479710 30304 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 14 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.508246 30479 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:11:45.519646 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 48797.4us
I20260709 13:11:45.524711  3832 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:45.549822 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 131515us
W20260709 13:11:45.560460 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 72380us
I20260709 13:11:45.589622 30559 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:45.589708 30555 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:45.623679  3832 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:45.625962 30559 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:11:45.630719 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84545.1us
W20260709 13:11:45.635207 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 165925us
I20260709 13:11:45.658681 30304 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 16 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:45.674194 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 83943.6us
W20260709 13:11:45.804816 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 68212.3us
W20260709 13:11:45.811189 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65962.2us
W20260709 13:11:45.809340 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 84479.7us
W20260709 13:11:45.879825 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84587.5us
I20260709 13:11:45.976892 30484 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:45.984388 30402 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:45.989086 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 107522us
I20260709 13:11:46.003942 31147 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:46.012171 30402 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:46.019284  3848 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:46.025281  3848 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:46.037760  3843 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.050029 30411 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:46.055822 30555 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:46.060171 30556 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:11:46.063493 30485 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:46.063956 31152 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:11:46.070492  3836 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.077749 31152 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:46.079507  3867 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:46.083848  3855 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:46.089963  3749 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.090937 30484 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:46.086989 31147 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.091060  3855 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.111936  3848 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.113986  3855 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.120580 31152 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.122891 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0500eacf70c44cb5bb9527f23aea9b1d with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:46.123255 30484 raft_consensus.cc:2955] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.116993 31149 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.136119  3734 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:11:46.137107 30303 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 15 to 16, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 20 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.159489 30485 raft_consensus.cc:2955] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 12 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.186237 30551 raft_consensus.cc:2955] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 15 to 16, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:46.187279 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1640dd5756f749fd8546ca110299cc59 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:46.225111 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d97aadeef4e4fb9b4f6d566a7908278 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:46.228286 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 0500eacf70c44cb5bb9527f23aea9b1d with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:37434
I20260709 13:11:47.461187  3881 tablet_replica.cc:333] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:11:47.462512  3881 raft_consensus.cc:2243] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:47.465619  3881 raft_consensus.cc:2272] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:47.482594  3881 ts_tablet_manager.cc:1916] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:48.949693  3881 ts_tablet_manager.cc:1929] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 13:11:48.950846  3881 log.cc:1199] T 0500eacf70c44cb5bb9527f23aea9b1d P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/0500eacf70c44cb5bb9527f23aea9b1d
I20260709 13:11:48.954897  3881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37434 (request call id 8) took 2726 ms. Trace:
I20260709 13:11:48.955418  3881 rpcz_store.cc:276] 0709 13:11:46.227942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.228089 (+   147us) service_pool.cc:224] Handling call
0709 13:11:47.457445 (+1229356us) ts_tablet_manager.cc:1151] Deleting tablet 0500eacf70c44cb5bb9527f23aea9b1d
0709 13:11:47.457899 (+   454us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:11:48.931393 (+1473494us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:48.949258 (+ 17865us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:48.954670 (+  5412us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226383,"threads_started":1}
W20260709 13:11:48.960161 31118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.348s	user 0.058s	sys 0.115s
W20260709 13:11:48.960623 31118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.349s	user 0.058s	sys 0.115s
I20260709 13:11:48.985306  3885 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:11:48.986763 31119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.383s	user 0.030s	sys 0.078s
W20260709 13:11:48.987289 31119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.384s	user 0.030s	sys 0.079s
I20260709 13:11:48.986545  3885 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:48.987728  3886 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:48.988667  3886 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:48.990656  3885 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:48.991447  3885 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:48.992290  3885 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:48.994640  3887 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:48.995105  3885 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:48.996712  3887 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.002333  3887 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:48.991822  3886 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.021443  3886 raft_consensus.cc:493] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.023502  3885 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.026293  3885 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.034960  3885 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.035660  3891 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.036566  3891 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.038924  3886 raft_consensus.cc:515] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.041422  3886 leader_election.cc:290] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:49.043102 31117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.378s	user 0.010s	sys 0.022s
I20260709 13:11:49.044631  3892 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.045439  3892 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.048362  3887 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.048581  3890 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.049144  3889 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.049721  3888 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.051901  3887 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.052892  3888 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.055028  3887 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.055688  3887 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.056239  3888 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.056406  3887 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.051934  3889 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.061734  3889 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.062326  3889 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.073413  3889 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.073966  3887 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.074600  3887 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.076129  3889 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.076741  3889 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.076192  3887 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.064657  3890 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.077447  3889 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.074126  3893 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.085119  3893 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.086436  3889 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.088672  3893 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.078063  3891 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.096477  3890 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.098439  3887 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.100569  3888 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.101465  3888 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.104321  3888 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.115909  3887 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.116895  3886 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.116897  3887 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.117941  3886 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.120702  3887 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.121760  3886 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.121691  3887 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.122794  3890 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.123019  3888 raft_consensus.cc:493] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.125308  3893 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.125478  3887 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.125849  3888 raft_consensus.cc:515] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.126209  3893 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.128293  3887 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.128656  3888 leader_election.cc:290] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.124641  3890 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.124207  3885 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.128895  3886 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.128716  3893 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.130844  3896 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.171590  3898 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.172189  3896 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.172662  3898 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.173923  3890 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.174774  3888 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.175177  3896 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.172075  3885 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.175697  3888 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.177493  3885 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.177814  3888 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.178036  3885 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.179641  3886 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.180589  3898 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.417646  3886 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.377249  3885 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.158447  3887 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.431540  3888 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.432092  3897 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.432698  3904 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.432415  3888 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.433147  3897 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.433609  3886 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.433550  3904 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.434437  3886 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.435657  3897 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.435779  3888 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.436043  3904 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.437063  3886 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.438566  3887 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.441956  3887 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.443427  3900 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.444335  3900 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.451666  3900 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.454622  3885 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.454881  3897 raft_consensus.cc:493] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.455629  3897 raft_consensus.cc:515] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.457945  3897 leader_election.cc:290] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.466164  3896 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.467149  3896 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.468366  3898 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.469132  3898 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.476169  3896 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.478188  3854 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.482834  3854 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.480252  3698 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.471536  3900 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.479777  3898 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.514246  3882 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.515183  3882 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.517088 30485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 3015) took 3361 ms. Trace:
I20260709 13:11:49.518325  3882 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.488924  3896 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.525588  3887 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.526095  3883 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.527010  3895 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.528772  3866 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.529119  3889 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.517527 30485 rpcz_store.cc:276] 0709 13:11:46.155039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.157378 (+  2339us) service_pool.cc:224] Handling call
0709 13:11:46.157878 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.158243 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.158270 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.159181 (+   911us) log.cc:844] Serialized 494 byte log entry
0709 13:11:46.159374 (+   193us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:46.263374 (+104000us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.264815 (+  1441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.264887 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.264928 (+    41us) raft_consensus.cc:1685] finished
0709 13:11:46.264940 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.516844 (+3251904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35104,"raft.queue_time_us":110,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":149}
I20260709 13:11:49.537190  3899 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.537413  3850 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.507319  3898 raft_consensus.cc:493] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.541080  3850 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.544842  3906 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.544677  3896 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.545615  3906 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.505753  3698 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.552781  3840 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.552937  3903 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.553591  3840 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.553831  3903 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.555115  3804 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.556162  3840 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.556793  3903 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.559131  3885 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.559954  3885 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.541324  3897 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.563169  3897 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.554494  3887 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.565750  3897 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.567018  3883 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.565929  3887 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.555863  3804 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.547511  3850 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.547504  3784 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.625669  3850 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.628515  3897 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.629739  3850 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.630579  3897 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.629467  3898 raft_consensus.cc:515] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.632453  3850 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.572247  3885 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.627015  3866 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.626911  3899 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.648670  3906 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.643049  3889 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.646767  3894 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.646878  3907 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.568441  3900 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.656780  3894 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.659590  3784 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.661273  3891 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.662194  3784 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.633821  3895 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.661984  3891 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.662901  3896 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.696079  3899 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.687723  3885 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.690089  3908 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.684070  3898 leader_election.cc:290] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.649215  3866 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.697423  3908 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.698225  3895 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.686383  3886 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.699925  3886 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.700323  3908 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.703030  3885 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.693414 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:49.704730  3886 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.704613 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.645061  3893 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.709682  3893 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.710567 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.710788  3889 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.653980  3850 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.712100  3893 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.711905  3850 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.664232  3854 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.706267  3900 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.706557 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.707017 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.669725  3883 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.668496  3698 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.707858 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.642725  3897 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.626653  3804 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:49.686075 30541 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 3.457s	user 0.023s	sys 0.022s
I20260709 13:11:49.695106  3907 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.668354  3903 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.729451 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:49.730553 30541 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 3.502s	user 0.025s	sys 0.023s
I20260709 13:11:49.719337 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.730561 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.733384  3886 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.734632  3885 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.734275  3886 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.737365  3886 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.738005  3886 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.738669  3886 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.739457  3901 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.740175  3901 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.728193 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.738899  3897 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.738971  3891 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.741679 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.740696  3892 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.748090  3897 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.749536  3907 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.749852  3886 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.738912  3894 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.750839 30303 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 12 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:49.752998  3901 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.756227 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.759622 30406 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 11.
I20260709 13:11:49.673934  3902 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.753327 30303 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 15 to 16, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:49.768260 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:49.771176 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.771904 31146 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:49.750545  3897 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.791365 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.792042 31146 raft_consensus.cc:1813] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Handling vote request from an unknown peer 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:49.792646 31146 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:11:49.789943  3897 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.794044  3897 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.795293  3850 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.785383  3903 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.797293  3902 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.800141  3888 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.800885 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet 0500eacf70c44cb5bb9527f23aea9b1d (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:49.800843  3888 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.801784  3886 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.802852  3885 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.803592  3885 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.802973  3905 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.804533  3905 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.807853  3885 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.808151  3905 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.802399  3886 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.808738  3888 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.810452  3903 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.811192 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.810453  3886 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:49.814759  3897 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.816241 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.817231 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.820312 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.820951 30403 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:49.821703 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.822955 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.787362  3901 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.823559 30402 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:49.823663  3901 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.825637 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.826246 30406 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:49.833696 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.834359 30405 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:49.837541 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.844386 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.849710 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.851751  3910 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.852172 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.853595 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.826297  3901 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.861250  3890 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:49.861533  3892 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.861975  3890 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.862254  3892 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.867523 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c4e8b43b5248a6b8811c7335522edb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.868232 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.827615  3902 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.869513 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.870599  3900 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.870833 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.871541 31147 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:49.871332  3900 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.873382  3913 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.874292  3913 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.884110  3912 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.884667  3913 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.884800  3912 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.885289  3913 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.886330  3913 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.886715  3906 raft_consensus.cc:493] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.887327  3906 raft_consensus.cc:515] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.852516  3910 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.889110  3902 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.889760  3902 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.892179 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.892786  3915 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.893532  3915 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.895562  3891 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.896301  3891 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.949407 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.957798 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.958623 30406 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:49.956096  3910 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.959656 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.960005  3913 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.960134 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:49.948848 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 57668.7us
I20260709 13:11:49.959328  3906 leader_election.cc:290] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.961428  3902 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.961819  3906 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:49.955008  3915 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.962742  3890 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.962874 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.958056  3912 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.962980 31117 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:49.960613  3913 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.963757 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.964381  3850 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:49.964811  3850 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.965204  3850 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.968709 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:49.969478 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:49.969228  3906 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.970391 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.972249 31149 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 10.
I20260709 13:11:49.972263 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.974381 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.971513 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.976320  3918 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:49.976435 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.977326 31146 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:49.975104 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.976724 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:49.978168 30402 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:11:49.983084  3906 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.992455 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.992229  3918 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.993585 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:49.994242 30404 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:49.993918  3850 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:49.995479  3892 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.994541  3918 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:49.996716 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:49.979216  3913 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:49.997731  3892 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:49.998383  3892 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:49.998843  3892 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.999501  3913 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:49.950423  3899 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.000416  3899 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.009826 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.010753  3850 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.011756 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.012449 30411 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 9.
I20260709 13:11:50.015316 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.015470 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.016081 30403 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 11.
I20260709 13:11:50.016551 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.015934 30411 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:50.017230 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.017127 30409 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:50.018194 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.019367 30402 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:50.019799 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.014468  3892 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.028051  3892 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.002606  3899 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.030637 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.033128 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:50.039461 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.040261 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.042891 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:50.044102  3891 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.046172 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.046830 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.047398 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.050572  3899 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.051263  3899 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.053277  3899 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.053603 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:50.054575  3913 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.055510  3913 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.057554  3913 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.058182  3899 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.059015  3921 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.060087  3918 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.060398 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7503235ec641f7b8929ebbf8124038" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.059809  3921 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.060853 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.061992 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913c2d18b15848cd98ab0ff37874cc23" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.062364 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.063213 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.063833 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.060768  3918 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.065634 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.065917  3918 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.062564  3921 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.063279  3913 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.066382 30559 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:50.067018 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.068986 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.071430 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.071053 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.069303 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.079820 30556 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:50.070852 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.076951 30560 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:50.085119 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:50.069933 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.070295 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.087380 30525 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:50.070612 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.054527  3910 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:50.091965  3901 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.092434  3901 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.092831  3901 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.091821 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.093318 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.094432  3906 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.094664  3907 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.095167  3906 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.095319  3907 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.096423 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.097095 30560 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:50.097460  3906 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.097878 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.098265 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.098537 30552 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:50.099460 30553 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:50.100003  3906 raft_consensus.cc:493] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.100525 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.100627  3906 raft_consensus.cc:515] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.089207  3916 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:50.103099  3916 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.103511  3916 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:50.104161  3906 leader_election.cc:290] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.105000  3912 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.105525  3912 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.107023  3910 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.107126 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.107460  3910 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:50.107800  3912 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.108408  3912 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.109030  3912 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.097479  3907 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.099119 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.111222  3912 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.111361 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.103899 30450 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:50.114455 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.114748  3907 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:50.115197  3907 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.115566  3907 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.116118 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.117043  3913 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.119246 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.058983  3899 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.124625 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.148203 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.148838  3899 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.148953 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.149283 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34313dd02b6470d81b73b13d5cf157f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.149682 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.150112 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.150808 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.151134 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.151242 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.124966 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.127668 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.152576 30553 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:50.152612 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:50.150404 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.153546 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:50.109620 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.133941 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.136567  3906 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:50.137637 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.138713 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.138993 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.139118 30559 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:50.140604 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.141911  3907 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.068917  3918 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.143016 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.144584 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.151823 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.151850 30560 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
I20260709 13:11:50.153887 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.153412 30551 raft_consensus.cc:2468] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:50.186652 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.187148 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.187162 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.188522  3907 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.192164 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.190332 30484 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:50.197280 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.197202 30477 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:50.198834 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.200896 30486 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 8.
I20260709 13:11:50.203560  3921 raft_consensus.cc:493] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.204244  3921 raft_consensus.cc:515] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.204640 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.205911  3890 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.206286  3890 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.206760  3890 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.197268 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.200266 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.211293 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.206339  3921 leader_election.cc:290] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.213699 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.217953 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.199527  3899 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.220033 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.224045 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.214587  3918 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.230938  3913 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.222034  3902 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.231146  3899 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.232033  3902 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.232801  3918 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.233441  3899 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.234119 30485 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:50.239362  3923 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.244302 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.244012 30376 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.239995  3923 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.209435  3906 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.247435 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.250447 30376 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.248407 31118 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:50.251643 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.253818 30486 raft_consensus.cc:2393] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 10: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:11:50.253044 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.253300 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.253680 31118 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.322185 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.292737 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.335790 30477 raft_consensus.cc:1813] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Handling vote request from an unknown peer 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.274971  3901 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.256793 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.308935 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.357056 30479 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:50.358214 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.254891  3784 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.358966  3784 raft_consensus.cc:493] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.359411  3784 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.359763 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.360352  3906 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.361186 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.362428 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.363636 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.293596 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.252703  3889 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:50.275432  3919 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.267997 30376 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.279978  3916 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.369694 30552 raft_consensus.cc:1240] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:50.370299  3916 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.371516  3919 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.371959  3919 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.372444  3927 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.372854  3927 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.373224  3927 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.262915  3923 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.373828 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:50.375896  3901 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.376461 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:50.376889 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 123290us
I20260709 13:11:50.377355 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.377419 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:50.377624 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.377415  3903 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.378396  3926 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.380223 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.375839 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.303706 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.254319  3893 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:50.375738  3910 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.387516 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.388545 31118 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.302757 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.336434 30477 raft_consensus.cc:2410] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:11:50.336618 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.337857 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.340034 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.343107 31147 raft_consensus.cc:1240] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:50.343154 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.291442  3890 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.256358  3902 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.389827 30478 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:50.392536 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.392931 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.393720 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.250573  3887 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:50.394182 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.394321  3890 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.366024 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:50.368160 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 100288us
I20260709 13:11:50.396360 30486 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:50.396780 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.397428  3901 consensus_queue.cc:1059] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:50.396701 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.398322 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.398303 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.397297 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.400486 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.400761  3890 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:50.401193  3890 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.401423  3887 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.401576  3890 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:50.401917  3887 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.400612 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.390502  3926 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.399816 30376 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.408349  3893 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:50.408733  3893 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.409093  3893 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:50.409273 30376 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.259680  3900 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.415628 30557 raft_consensus.cc:2393] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 19: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:50.416270  3901 raft_consensus.cc:3055] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:50.416677 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.417470  3910 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.417565 30480 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:50.419239  3784 raft_consensus.cc:515] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.400447 30486 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:50.420460 31149 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:50.421218 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.421394  3784 leader_election.cc:290] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.420195 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:50.418605 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.416687  3901 raft_consensus.cc:740] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:50.423552 30376 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.423666  3890 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.389974 30483 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 13.
I20260709 13:11:50.423827  3901 consensus_queue.cc:260] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.424490  3891 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.425242  3901 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.364800 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.404282  3887 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.394323 30478 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:50.371881 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.400593 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.396193 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.422302 31147 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:50.422338  3889 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.435137 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.421802 30486 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 14.
I20260709 13:11:50.425266 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.390368 31118 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:11:50.447111 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 56828.9us
I20260709 13:11:50.449024 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.278580 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.450258 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:50.451237 30554 raft_consensus.cc:2393] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:50.461897 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:50.433894  3890 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.463110  3919 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.463922 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.461773  3927 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.465371  3919 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.467232 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.446424 30481 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
W20260709 13:11:50.468227 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 253439us
I20260709 13:11:50.445924 30479 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:50.470031 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.470640 30477 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:50.471364 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.472114 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:50.437281 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.473239 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.471587 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.474191 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.476502 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.477481 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.477517 30410 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:50.479328 30405 raft_consensus.cc:1240] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:50.469270  3926 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:50.479759 30524 leader_election.cc:304] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.481168 30524 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.481424 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.482467 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:50.482760 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.475457  3910 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:50.526548  3910 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.527004  3910 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:50.527787 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.534183 31147 raft_consensus.cc:2468] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:50.535068 31144 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:50.535768 30525 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:50.536715 30553 raft_consensus.cc:1240] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:50.538208 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.538944 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.539072  3897 raft_consensus.cc:2804] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:50.539651  3897 raft_consensus.cc:697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:50.540058 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.540500  3897 consensus_queue.cc:237] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.540966 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.541290  3893 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.542135 31152 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:50.542407 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.542876 30405 raft_consensus.cc:1240] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:50.519274  3916 raft_consensus.cc:2749] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:50.543349 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.524102  3888 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:50.544867  3888 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.545132 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.546434 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.547191  3927 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.547338 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.483572 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.547688 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.548454 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.539989 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.548657 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.548789 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.525447 30410 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:50.548508 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.545320  3888 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:50.541214 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.499581 30480 raft_consensus.cc:1240] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.537142 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.483903 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.563194 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.498024 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:50.571868  3910 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.572841 30451 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.574184  3910 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:50.575862  3887 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.577332  3893 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.579582 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 1640dd5756f749fd8546ca110299cc59 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:50714
I20260709 13:11:50.581001 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 235) took 1723 ms. Trace:
I20260709 13:11:50.583319 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.584337 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.584473 31152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.584797 31153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.585038 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.586180 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.592978 30309 rpcz_store.cc:276] 0709 13:11:48.857605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.703246 (+845641us) service_pool.cc:224] Handling call
0709 13:11:50.580731 (+877485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2519,"reported_tablets":1}
I20260709 13:11:50.589473 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.590543 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.586649 30304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 220) took 4342 ms. Trace:
I20260709 13:11:50.595525 30304 rpcz_store.cc:276] 0709 13:11:46.244239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.245319 (+  1080us) service_pool.cc:224] Handling call
0709 13:11:50.586467 (+4341148us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:11:50.595937 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d97aadeef4e4fb9b4f6d566a7908278 with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:38756
W20260709 13:11:50.605753 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 112960us
I20260709 13:11:50.619254 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.620193  3930 tablet_replica.cc:333] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:11:50.621176 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.622543 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.624419  3902 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.625404 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:11:50.627712 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:50.628336  3917 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:50.628677  3900 consensus_queue.cc:1059] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:50.629493  3914 consensus_queue.cc:1059] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:50.629745  3900 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:50.629693  3917 consensus_queue.cc:1059] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:50.630317  3900 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.631652  3906 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:50.632179  3906 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.632215  3900 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.633736  3900 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.633548  3906 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.630563  3914 raft_consensus.cc:3055] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:50.634948  3914 raft_consensus.cc:740] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.635762  3906 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.635864  3914 consensus_queue.cc:260] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.637295  3914 raft_consensus.cc:3060] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:50.630857  3923 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:50.638921  3923 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.639812  3923 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.641013  3923 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:50.674386 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 101713us
I20260709 13:11:50.680996  3887 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.682363 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.685400 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:50.688006 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.688915  3906 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:50.690177 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.690994  3906 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.692741 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.694072 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.700639  3888 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.484481 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.708690 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1b5d40df944767ab310e2bd822d5b0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.483968 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
W20260709 13:11:50.714183 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 230273us
I20260709 13:11:50.715346  3897 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:50.715888  3897 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.716223 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.716343  3897 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:50.720784 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:50.722049 30523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.152.2:33247 timed out after 1.650s (SENT)
I20260709 13:11:50.735373 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.736392  3930 raft_consensus.cc:2243] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.737380  3930 raft_consensus.cc:2272] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.731837  3906 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:50.734599 30524 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.750802 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.752179 30524 leader_election.cc:304] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.757663  3916 raft_consensus.cc:2749] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:50.761996 30451 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.762444 30524 leader_election.cc:304] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.765774 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d4ac70a018496ba2020b90313c013e" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:50.765337 30451 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.759639  3901 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.767488 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.768453 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.775312 30451 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.765744  3906 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.766989  3905 raft_consensus.cc:2749] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.778070 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.779313 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.769853  3901 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.773674  3910 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.770987  3902 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.773871  3886 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.782721  3886 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.783160  3886 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.783233 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.784381  3930 ts_tablet_manager.cc:1916] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:50.780846  3907 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.786875 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.787955 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.774515  3888 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:50.792081 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567508f2962f473b8fac20c97a240f35" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.793448 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.794863  3890 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:50.779034  3915 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:50.797916  3915 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.799223  3932 tablet_replica.cc:333] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:11:50.800377  3932 raft_consensus.cc:2243] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.801528  3932 raft_consensus.cc:2272] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.801820 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.803675  3915 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:50.805567 30451 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.790409 31116 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:50.809302 30451 raft_consensus.cc:2686] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:50.810036 30451 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.811282  3902 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:50.817821  3902 consensus_queue.cc:1059] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:50.818524  3930 ts_tablet_manager.cc:1929] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:11:50.819051  3930 log.cc:1199] T 1640dd5756f749fd8546ca110299cc59 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/1640dd5756f749fd8546ca110299cc59
I20260709 13:11:50.819160  3900 raft_consensus.cc:3055] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:50.780795  3901 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.822131  3900 raft_consensus.cc:740] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.824822 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 1640dd5756f749fd8546ca110299cc59 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:50.823956  3900 consensus_queue.cc:260] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.826741  3900 raft_consensus.cc:3060] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:50.831040  3926 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:50.834376  3897 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:50.837422 31177 debug-util.cc:398] Leaking SignalData structure 0x7b0800250440 after lost signal to thread 29283
I20260709 13:11:50.838229 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:50.838570 31177 debug-util.cc:398] Leaking SignalData structure 0x7b0800236ec0 after lost signal to thread 30343
I20260709 13:11:50.839485 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:50.839883 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6a40 after lost signal to thread 30435
I20260709 13:11:50.840590 30374 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
W20260709 13:11:50.840991 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcb40 after lost signal to thread 30510
W20260709 13:11:50.842118 31177 debug-util.cc:398] Leaking SignalData structure 0x7b080031cc60 after lost signal to thread 30584
I20260709 13:11:50.842483  3887 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:50.842942  3887 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
W20260709 13:11:50.843326 31177 debug-util.cc:398] Leaking SignalData structure 0x7b08003daf00 after lost signal to thread 31180
I20260709 13:11:50.844867 30480 raft_consensus.cc:2468] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:50.845387  3893 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.845850  3893 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:50.846220  3893 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.846195  3932 ts_tablet_manager.cc:1916] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:50.843501 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.848887  3890 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.849359  3890 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.851353  3900 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.855544 30303 catalog_manager.cc:5697] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 19 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.849547 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:50.875962  3914 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.859726 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.876871 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.877758  3892 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.861989  3893 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.878216  3926 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.860766  3890 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.879935  3893 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:50.877532 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.880919  3903 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:50.843397  3887 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.882184 31116 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.837436  3897 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:50.883210  3903 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.883559  3903 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.883899  3903 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.891120  3903 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.894315  3903 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.892338 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.895807 31116 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.896585  3926 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:50.891623 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.897387  3906 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.898165  3890 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.898226 30451 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.900624  3906 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:50.903962  3850 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.904546  3850 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.905017  3850 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.912680 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.914017 30451 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:11:50.917271 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49898.2us
I20260709 13:11:50.919703 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:50.920924 30410 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:50.923396  3915 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.925920  3915 consensus_queue.cc:1059] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:50.928339  3907 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:50.928514  3850 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.928859  3907 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.930111  3907 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.931798  3907 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.809351  3886 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.918232 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.937963 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.936137 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.940220 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.936592  3784 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:50.941305  3914 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.936748  3893 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.945808 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.946194  3893 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.946795  3893 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.947175  3850 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:50.952337 30374 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.954185 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:11:50.953573 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 185158us
I20260709 13:11:50.955173 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.954458 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.956027 30524 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.956202 31116 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:50.957044 30451 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.957084 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.958200 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.958804  3897 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:50.958981  3916 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:50.959295 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.959312  3897 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.959852  3906 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.960134  3897 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:50.960387  3784 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:50.960803  3784 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.960898 30551 raft_consensus.cc:1240] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:50.961194  3784 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:50.961884 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:50.962781  3919 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.958824  3905 raft_consensus.cc:2749] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:50.963332  3919 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.963729  3919 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.964382  3901 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:50.959381  3916 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.967430  3916 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:50.958899  3926 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:50.970187 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.971014  3905 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:50.971364  3905 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.971699  3905 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:50.953483  3900 consensus_queue.cc:1059] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:11:50.973497  3900 raft_consensus.cc:3055] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:50.973860  3900 raft_consensus.cc:740] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:50.974823  3900 consensus_queue.cc:260] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.976089  3900 raft_consensus.cc:3060] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.966974  3892 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:50.978072 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.979161 30524 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.979206 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.980247 30451 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.980305 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:50.981107 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.981915 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:50.955423 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.977757  3914 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:50.983999 30374 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:50.984299  3910 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:50.982739  3923 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:50.984912 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.985709 30482 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 15: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:50.983352  3906 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:50.987185  3912 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:50.988107 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:50.988458  3927 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:50.988859  3927 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:50.989257  3927 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:50.989599  3784 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:50.982633  3915 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:50.991374  3888 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:50.991771  3888 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.992103  3888 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:50.984746  3910 raft_consensus.cc:493] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:50.995345  3910 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:50.997350  3893 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.001565 30482 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
I20260709 13:11:51.003978 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.004314 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.004935 30374 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.005941 30374 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:51.007367 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88cc3e301acf441dab14eb0be7a54db1" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.009189 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.011865 30451 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.012028 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.007054 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.027715 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:50.984754  3898 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:51.035305 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.035888 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4c05796efa42489d11c8a49ba476ad" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:51.038748 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.023264  3902 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:51.043684 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.000517  3890 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.045432 30451 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.023311  3891 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.967913  3897 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.048061 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.059254 30482 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
W20260709 13:11:51.050124 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44284us
I20260709 13:11:51.056324 30480 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
W20260709 13:11:51.062065 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54837.6us
I20260709 13:11:51.041028  3898 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.046353  3912 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.057386  3923 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.048679  3906 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.057516  3914 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:51.048568  3891 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.061805  3917 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:51.084925 30449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.066816  3890 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:51.068887  3898 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.088570  3891 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:51.107185 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 44470.2us
I20260709 13:11:51.109968 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.087394  3893 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.112226  3941 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:51.112671  3897 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.115015  3887 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.116014  3886 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.117190  3887 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:51.121536  3888 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.090122  3890 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.123345  3890 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:51.123977  3901 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.124629  3784 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.115236  3916 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.137770  3901 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.112730  3941 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:51.138979  3941 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.140115  3916 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.139979  3905 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.142160  3905 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.144806  3919 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.146080  3890 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.147642  3888 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.149040  3891 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:51.152350 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 85505.6us
I20260709 13:11:51.158830 30374 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.161592 30479 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:51.129308  3910 raft_consensus.cc:515] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.165679 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:51.254184 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 88608us
I20260709 13:11:51.174757  3927 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.171937  3890 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.159801  3919 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.257400  3905 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.197528 30477 raft_consensus.cc:2468] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:51.248301  3941 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.260298  3941 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.260967  3941 consensus_queue.cc:1059] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:51.261382  3910 leader_election.cc:290] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:51.262108  3944 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:51.224582 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.262945  3944 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:11:51.237107 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 256821us
I20260709 13:11:51.264106  3944 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.265172 30524 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.266220  3944 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:51.184005  3891 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.163384 30374 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.271870 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:51.273962  3905 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.275620 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.276446  3938 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.280435 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.281443  3938 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:51.248020  3898 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.285739  3898 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.245291  3932 ts_tablet_manager.cc:1929] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.15
I20260709 13:11:51.286666  3932 log.cc:1199] T 3d97aadeef4e4fb9b4f6d566a7908278 P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/3d97aadeef4e4fb9b4f6d566a7908278
I20260709 13:11:51.288815 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 3d97aadeef4e4fb9b4f6d566a7908278 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:11:51.164297  3892 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:51.295673 30523 leader_election.cc:304] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.298391 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.298835  3892 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:51.299371  3938 raft_consensus.cc:2749] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.299552  3892 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.300117  3938 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.300426 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.300165 30409 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:51.302067 30523 leader_election.cc:304] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.302860  3910 raft_consensus.cc:2749] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.304129 30523 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.305317  3944 raft_consensus.cc:2749] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:51.257535  3927 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.307086 30523 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.307862  3910 raft_consensus.cc:2804] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:51.308372  3910 raft_consensus.cc:697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.309222  3910 consensus_queue.cc:237] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.310784 31146 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:51.267239 30524 leader_election.cc:304] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.311978  3944 raft_consensus.cc:2749] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:51.312209 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 148975us
I20260709 13:11:51.312961  3890 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:51.313097 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.313553  3890 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.314085  3890 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.314224 30523 leader_election.cc:304] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.314612 30409 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:51.315083  3944 raft_consensus.cc:2749] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.316895 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:51.318508 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:51.318850 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.319780 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:51.319917 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:51.320446  3945 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:51.321282 31146 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:51.321367 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:51.322047 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.322422 31116 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.323539  3902 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.322741 30482 raft_consensus.cc:2393] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:51.322475  3915 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:51.312121 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 44981.2us
I20260709 13:11:51.325778  3902 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.330117 30557 raft_consensus.cc:1240] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:51.326452  3914 consensus_queue.cc:1059] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:51.331149  3914 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:51.331504  3914 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.331557 30551 raft_consensus.cc:1240] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:51.331943 30555 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:51.332337  3914 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.333506  3914 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:51.334612 30555 raft_consensus.cc:1240] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:51.323904  3903 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.329762 30553 raft_consensus.cc:1240] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:51.337255 30555 raft_consensus.cc:1240] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:51.328562 30451 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:51.339318 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.340116 30478 raft_consensus.cc:2393] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:51.340066  3907 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.340631 30484 raft_consensus.cc:1275] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:51.340922  3907 consensus_queue.cc:1059] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:51.341125 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.342000 30480 raft_consensus.cc:2393] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 17: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:51.341068  3902 consensus_queue.cc:1059] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:51.340880 30523 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.341934  3907 raft_consensus.cc:3055] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:51.342872  3907 raft_consensus.cc:740] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.342965 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.343348 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.339295 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.343770  3902 raft_consensus.cc:3055] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:51.343727  3907 consensus_queue.cc:260] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.344321  3902 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.345161  3907 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.345283  3902 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.346760 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.347002  3902 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:51.351208  3923 consensus_queue.cc:1059] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:51.352005  3910 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.352571  3915 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:51.352926  3915 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.353720  3915 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.354334  3910 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:51.354743 30309 catalog_manager.cc:5697] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.355561  3923 consensus_queue.cc:1059] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:51.356716  3900 raft_consensus.cc:3055] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:51.357060  3900 raft_consensus.cc:740] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.351644 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.357923 30482 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:51.360707  3915 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:51.358058  3900 consensus_queue.cc:260] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.366004  3900 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.368225 30479 raft_consensus.cc:2468] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:51.369609  3923 consensus_queue.cc:1059] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:51.369766 30523 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.370185 30524 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.370590  3923 raft_consensus.cc:3055] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:51.370944  3944 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.370975  3923 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:51.370882  3910 raft_consensus.cc:2804] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:51.372219  3923 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.313539 30374 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.372828 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.373561  3923 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.373698  3941 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.372231  3910 raft_consensus.cc:697] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.375703  3910 consensus_queue.cc:237] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:51.382179 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 58506.9us
I20260709 13:11:51.386168 31116 leader_election.cc:304] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:51.387241 31116 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.393095  3949 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:51.394264  3949 raft_consensus.cc:2804] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:51.396232  3891 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.420192  3891 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.424202  3891 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.396049  3919 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:51.395424  3944 consensus_queue.cc:1048] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:11:51.425510  3919 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.395130  3941 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:11:51.427429  3938 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:51.427802  3938 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.427980 30477 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:51.427987  3919 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.428642  3938 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.397017  3883 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:51.429607  3883 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:51.429911  3938 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:51.397696 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84218.5us
I20260709 13:11:51.430451  3883 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.412127  3892 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.431365 30374 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.431919  3883 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:51.432415  3891 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:51.432982  3891 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:51.393508  3890 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.434911  3949 raft_consensus.cc:697] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:51.436112  3890 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:51.436300  3949 consensus_queue.cc:237] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.397954  3893 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:51.438489  3893 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:51.439576  3893 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.432201 30374 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.443614 30374 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.445501 31147 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:51.396759  3784 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:51.446902  3919 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:51.447569  3919 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:51.447705  3943 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:51.448225  3943 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:51.448559  3919 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.449116  3943 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.452701 31147 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:51.458001 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.458350 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.457691 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.460953 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.462019 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.462000 30523 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:51.387241 30524 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:51.465581 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78399.8us
I20260709 13:11:51.469287 30524 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.473935 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.477492 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.486779 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.487238 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.490346 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.485687 30376 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.491343 30409 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:51.467062  3944 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:51.471199  3941 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.499040 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.501644 30402 raft_consensus.cc:2393] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:51.502672 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:51.502892  3944 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.503239 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:51.503995  3944 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.465183  3938 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:11:51.506089 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.506366 30406 raft_consensus.cc:1240] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:51.482102  3947 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.509706 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.509002 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.507841 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.506929 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.508460 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.518114 30409 raft_consensus.cc:1240] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:51.518396 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.521430 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.521989 30376 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.523869 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:51.524109 30374 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.527581 30408 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:51.505493  3942 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:11:51.540122 30411 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:51.539762 30303 catalog_manager.cc:5697] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 15 to 16, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 16 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.542977 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.464018  3891 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.551194  3927 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:51.551098  3892 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:51.555354  3905 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:51.555760  3905 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.556553  3905 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.551086 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.557998  3905 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:51.515815  3898 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.563313  3943 raft_consensus.cc:2749] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:51.563668 30376 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.565622  3938 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:51.566013  3938 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.566639 30309 catalog_manager.cc:5697] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 12 to 13, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.566964  3938 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.562615 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.578341  3938 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.586956 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:51.589629 30411 raft_consensus.cc:1240] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.594303 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.595774 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.596077 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.596843 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.597553 30557 raft_consensus.cc:2393] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:51.599264  3937 consensus_queue.cc:1059] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:51.600263  3937 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:51.600572  3937 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:51.601431  3937 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.602898 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.577076 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.613727 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.624881 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.625238 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.607017  3937 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.611379  3892 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.635681  3887 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:51.636168 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59168.8us
I20260709 13:11:51.652483 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:51.655191  3887 consensus_queue.cc:1059] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:51.656261  3887 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:51.656637  3887 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:51.657150 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.657442  3887 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.657989  3946 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.659016  3887 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:51.678313 30404 raft_consensus.cc:1240] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:51.681082  3894 consensus_queue.cc:1059] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:51.688478 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:51.712384 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.736019 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.742095 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.747395 30482 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:51.757762 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.756512  3938 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:11:51.772989  3945 raft_consensus.cc:3055] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:51.773515  3945 raft_consensus.cc:740] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:51.777699 30485 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:51.780539  3938 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:51.788726 30309 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 16 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.797474 30303 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 17 to 18, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 18 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.811978 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
W20260709 13:11:51.827332  3958 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:51.774416  3945 consensus_queue.cc:260] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:51.849639  3945 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:51.856439 30309 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 15 to 16, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 16 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.875553 30309 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 17 to 18, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 18 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.786790  3959 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:51.877107 30309 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 11 to 12, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 12 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.890306 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:51.895939 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9205df4217c4ceca542cc35ed79d43e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:51.897233 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:51.898381 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:51.899070 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:51.903862 30411 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:51.901064 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a7575b0e686483ca3a32ff9be16a338" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:51.906720 30403 raft_consensus.cc:1240] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:51.907940 30404 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:51.886842  3959 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:51.910861  3959 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.911890 30558 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:51.916165 30560 raft_consensus.cc:2393] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:51.919126 30404 raft_consensus.cc:3060] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.912879 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.925206 30376 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.927057  3943 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.930002 30404 raft_consensus.cc:1275] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:51.930896  3948 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.931636 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.937027 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.938047 30376 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.938884  3891 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.939427  3891 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.939970  3891 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:51.941825 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.942437  3943 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.942835 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.944456 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.945079  3948 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:51.945360 30481 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:51.945688  3948 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:51.946748 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.948151  3946 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.948350 30481 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:11:51.949285 30376 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.949862  3946 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:51.953930 30524 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:51.950093  3948 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.958632 30481 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:51.969686 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.970572 30524 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.950389  3959 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.974671 30524 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.967386  3938 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:11:51.976162  3910 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:51.980357  3942 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:51.980453  3910 consensus_queue.cc:1059] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:51.981623  3942 raft_consensus.cc:3055] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:51.981986  3942 raft_consensus.cc:740] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.982921  3942 consensus_queue.cc:260] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:51.984485  3942 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.987232  3938 consensus_queue.cc:1059] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:51.988198  3888 raft_consensus.cc:3055] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:51.973472  3916 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.988565 30524 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.988548  3888 raft_consensus.cc:740] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:51.966432  3897 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:51.994380 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.995417 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:51.971061  3944 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:52.005553  3944 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:51.965272  3949 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:11:52.012923 30524 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.006120  3897 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.004254  3938 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:52.006393  3905 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:52.008113  3944 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.027531  3959 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.011144  3888 consensus_queue.cc:260] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.028977  3888 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.028676  3944 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.029865  3944 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:52.032068 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:52.032344 30478 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:52.053578 30479 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 20.
I20260709 13:11:52.063066  3943 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:52.066115 30374 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.073855  3948 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:52.080293  3948 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:52.081171  3948 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.082890  3941 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:52.083420 30480 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:52.087620 30485 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:52.091578  3910 raft_consensus.cc:2749] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.088831  3898 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:11:52.095204 30525 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 497264cf15754f0e9029cd057a54a7fb. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:52.119692 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 104114us
W20260709 13:11:52.119189 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 106310us
I20260709 13:11:52.122822 30524 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.123564  3941 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:52.143402 30483 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:52.128551  3898 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:11:52.155023  3974 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:52.158409  3916 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:52.164734  3888 consensus_queue.cc:1059] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:52.166605  3916 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.169428  3974 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:52.170068  3974 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.171171  3974 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.173103  3974 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:52.178200  3916 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.179469  3916 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:52.180961  3888 raft_consensus.cc:3055] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:52.181365  3888 raft_consensus.cc:740] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.182189  3888 consensus_queue.cc:260] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.183593  3888 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.185513 30558 raft_consensus.cc:1275] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:11:52.195710 30376 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.196421  3977 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.196959 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.197711 30403 raft_consensus.cc:1275] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:52.198042 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.198328  3941 consensus_queue.cc:1048] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:52.198863  3891 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:52.199051  3959 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.199664  3891 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.201594  3944 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:52.202018  3944 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.205361  3850 consensus_queue.cc:1048] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:52.201846 30376 leader_election.cc:304] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.213080 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.213838  3943 raft_consensus.cc:2749] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.214046  3891 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:52.216416 30403 raft_consensus.cc:1240] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:52.218616 30403 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:52.218578  3975 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:52.203042  3944 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.231877 30560 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:52.232321  3944 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:52.236641 30555 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:52.243309 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.244143 30555 raft_consensus.cc:2393] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 20: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:52.247917 30555 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:52.251026 30404 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:52.255697  3974 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.256203 30560 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:52.259799  3887 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:52.261231  3959 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:52.266111  3959 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:52.231021  3891 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.252192 30309 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 19 to 20, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 20 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.279822  3976 consensus_queue.cc:1059] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:52.284096  3957 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:52.255203  3941 consensus_queue.cc:1048] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:52.301491  3974 raft_consensus.cc:3055] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:52.304281 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 49113.8us
I20260709 13:11:52.302779  3974 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:52.360981  3974 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:52.394093  3974 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:52.412137  3887 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:52.412990  3887 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.449035  3887 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.451953 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.452617 30479 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
I20260709 13:11:52.453824 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.457084  3985 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:52.457546  3985 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:52.458038  3985 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:52.459509  3984 log.cc:927] Time spent T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:11:52.477630  3992 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:52.520655  3945 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.528853  3914 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
W20260709 13:11:52.536201 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 126208us
I20260709 13:11:52.535211  3914 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.546234  3914 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.547220 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.547876 30555 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:52.548843 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:52.548863 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.549697 31146 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.552601  3914 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:52.553150  3914 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:52.553596  3914 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:52.555075  3970 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.555579  3970 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.556285 30556 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:52.557572  3970 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.559154 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.559906 30551 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 19: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:52.561739 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.562285 30404 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:52.562433  3943 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.540925  3945 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.563365 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.564328 30556 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:52.564827  3945 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.565377 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.566453  3970 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:52.566625 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.566870  3970 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.567270  3970 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:52.567271 30556 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:52.578542  3985 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.589545 30482 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:52.594682  3985 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.595513 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:52.596462 31118 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:52.603577 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.604578 30404 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 12.
I20260709 13:11:52.611413 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.612519 30556 raft_consensus.cc:2393] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 in current term 19: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:11:52.609871  3999 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:52.615833  3999 raft_consensus.cc:493] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.616189  3999 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.616281  3919 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:52.630260  3914 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.635092  3999 raft_consensus.cc:515] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.635819  3970 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.637789 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.638082  3970 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.639355 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.639937 30555 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.637787 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406b169640e341629c55637d07dd3d47" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:52.643903 30404 raft_consensus.cc:3060] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.644006 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:52.644637 30403 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:52.644945 30485 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
I20260709 13:11:52.645882 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.647195 30560 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:52.646180 30374 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:52.648736 30556 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:52.651034 30555 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:52.652738 30404 raft_consensus.cc:2468] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:52.653865 31117 leader_election.cc:304] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:52.654726  3850 raft_consensus.cc:2804] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:52.655224  3850 raft_consensus.cc:697] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:52.655858  3893 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:52.656433  3893 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:52.656112  3850 consensus_queue.cc:237] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.657342  3893 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.649863 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.647261  3999 leader_election.cc:290] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.685724 30403 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:52.687389  3970 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:52.686803 30450 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.687992  3970 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:52.688866  3970 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.690796  4001 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:52.691329  4001 raft_consensus.cc:697] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:52.694137  4001 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.703341  3914 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.704762 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:52.710639 31146 raft_consensus.cc:2393] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.705408 30560 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:52.743444  3970 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:52.749155  3970 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.750504 30304 catalog_manager.cc:5697] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 11 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.753260 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:52.753885 31146 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:52.753818 30303 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.755191 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.756153  3970 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.781309 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.782167 30403 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:52.788182  3970 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:52.817431  3970 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:52.817901  3970 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:52.829284  3998 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.829909  3998 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.833501 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.834128 30403 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 9.
I20260709 13:11:52.836570 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:52.837347  3999 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:52.837731  3999 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.838076  3999 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.835068  3919 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.843061  4002 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:52.843703  4002 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.842958  3919 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.844940 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.847055 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:52.847806 31146 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 20: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.846232  4001 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:52.849598  4001 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.850641 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.851248 30478 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:52.851732  4001 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.847750  3919 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.852221 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.852291 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.853266  3919 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:52.853391 30551 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:52.853675  3919 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.854054  3919 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.855021 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:52.855165 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.852733 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.855798 31146 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.856128 30560 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:52.856990  3998 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:52.857394 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:52.858186  3914 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:52.858671  3914 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:52.859086  3914 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:52.861783  3999 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.845872  4002 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.864786 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:52.865314 30403 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:52.866523  3914 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.868729  3914 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.858239  4001 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:52.870208 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:52.884300 31146 raft_consensus.cc:2393] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.885411  4001 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:52.872933 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.885986  4001 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:52.886149 30551 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:52.873730 30403 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 10.
I20260709 13:11:52.868211  3970 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.870951 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.894104 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:52.895622 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:52.895859  3996 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:52.896373  3996 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:52.897228  3996 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.894384  3919 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.900694 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:52.902209 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:52.902797 30482 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.903930  3919 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.906116  4001 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.905187 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.908735 30551 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.908876 30560 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:52.910104 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:52.910857  4002 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:52.896488 30403 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:52.907976  3914 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.918182  3914 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.921147  3914 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.923871 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.926679 30560 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:52.927178 31146 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:11:52.928109 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.928355 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.928489 30482 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:52.928907 30451 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:52.929050 30403 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:52.930203 30551 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:52.929792 30374 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:52.934044 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:52.934547 30303 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 17 to 18, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.907554  3970 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.937635  4008 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:52.931293  3914 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:52.929662  3998 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.936661  3887 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:52.939910  3887 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:52.939802  3998 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.939069  3914 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.940677 30303 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.941610  3914 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:52.942490 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.942732  4001 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:52.940812  3887 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:52.945446 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:52.946453 31146 raft_consensus.cc:2393] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 20: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:52.948577 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:52.933732  4002 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:52.951182  3949 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.962881  3949 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.963162  4002 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.935774  3999 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 10 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:52.969033 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.969122  3949 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:52.970340 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.969033 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:52.971503 30403 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:52.970988 30560 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
I20260709 13:11:52.973031 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.974320 31118 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:52.969113  3998 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.972426  4008 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:52.976516  3850 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.977039  3850 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.977325  4008 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:52.978552 30551 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:52.979245  3850 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:52.980055 30451 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:52.981561 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:52.982161 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:52.982199 30478 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 20.
I20260709 13:11:52.982919 30551 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 20.
I20260709 13:11:52.983989 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:52.987963  3850 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:52.988587  3850 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.988724 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:52.989100  3850 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:52.980993  3949 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:52.994053 30303 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.981117  3999 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:52.985261  3970 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:53.003144  3949 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.012835  3999 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.036695  3914 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.039330  4010 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:53.039897  4010 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.041841 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.042459 30403 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:53.042992  4010 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:53.043206 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:53.047003  3999 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:53.040385 30309 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 9 to 11, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.051337  4001 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.051715 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.051894  4001 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.052452 30404 raft_consensus.cc:2368] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
I20260709 13:11:53.054133  4001 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.054620  4001 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.061666 30403 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.062017  4001 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.062310 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.056962 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.062924 30560 raft_consensus.cc:3060] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:53.063298 30404 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.027575  3970 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:53.064658  3970 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.056248 30450 leader_election.cc:400] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
I20260709 13:11:53.068897 30450 leader_election.cc:403] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.056284 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.070024 30551 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:53.070140 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.070746 30556 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:53.072844 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.075417 30560 raft_consensus.cc:2468] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.076658  4010 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.028560  3949 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:53.089648  3927 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.090183  3927 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.091415  4010 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.067519  3914 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.070746  4001 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.114499 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.115231 30560 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:11:53.092429  3927 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:53.119140 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 46379.6us
I20260709 13:11:53.122396 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.123199 30451 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:53.117980  4011 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:11:53.119480  3898 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.147789 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 91272.7us
I20260709 13:11:53.125262  4008 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:53.122819  3914 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.157426 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:53.158375 31149 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 10.
I20260709 13:11:53.166946  4015 raft_consensus.cc:2804] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:53.167573  4015 raft_consensus.cc:697] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:53.148149  4002 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.168361 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:53.170290 30403 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:53.158955  4008 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.190428  4008 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:53.168959  4017 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:53.177378 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.179898  4010 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.182861  3999 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.173012  3948 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:53.176774 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.183499  3949 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.174423  4002 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.185726 30556 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:53.188441 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.207772 30551 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.207875 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.208547 30556 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:53.194559 30402 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.202025 30411 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.157701  3898 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.210935 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.204773  3999 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.201576  3948 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.199890  4017 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.215206  4017 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:53.192423  4015 consensus_queue.cc:237] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.208786  3949 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.217360 30560 raft_consensus.cc:1275] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:53.199177  3944 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.186434  3850 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.214847  3948 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.212159  4001 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:53.215229  4002 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.229287  4001 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.229727  4001 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:53.218385 30479 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:53.208783  4010 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:53.219655  3996 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:53.222216 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.236809 30560 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:53.221004 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.238237 30402 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:53.231417 30556 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:11:53.240423 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.240514 31118 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:53.239754 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.242270 30411 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.245857  3970 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:53.249038  3999 consensus_queue.cc:1048] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:53.241875  4020 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:11:53.246534  3970 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.253618  3970 raft_consensus.cc:3060] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.260851  3850 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.264078 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.264645 30555 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:53.265527  4014 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:53.266070  4014 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:53.267091 30402 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:53.269521  3898 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:53.271404 30555 raft_consensus.cc:2468] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 21.
I20260709 13:11:53.228364  3944 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.276379 30402 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:53.277330  3944 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.228662 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:53.278368 30551 raft_consensus.cc:606] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:53.278733 30551 raft_consensus.cc:614] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.288730  4010 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:53.289291 31118 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:53.292804  3914 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 9. Current term is 10.
I20260709 13:11:53.294037 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.294585 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.266966  4014 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.291010  3949 raft_consensus.cc:2804] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:53.298601 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 126828us
I20260709 13:11:53.297647 30303 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 15 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.300510 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.305367 30411 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
I20260709 13:11:53.296890 31117 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:53.327658 30524 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:53.333781 30303 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 11 to 12, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:53.341058  3850 raft_consensus.cc:2804] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:53.304518  4008 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.389585  3948 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.390159  4019 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.395546 30556 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:53.352931  4010 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.404963 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:53.360471  4016 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:53.409307 31146 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:53.391522  3850 raft_consensus.cc:697] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 16 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
W20260709 13:11:53.423949 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 50204.9us
W20260709 13:11:53.425278 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 97725.4us
I20260709 13:11:53.416464  3996 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.417465  4030 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:53.419822  3974 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.390990  4019 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.412941  3949 raft_consensus.cc:697] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:53.433564 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.434646 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.435362 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.436064  4019 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.412256  4010 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.438326 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.452212 30556 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.416980  4015 consensus_queue.cc:1059] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:11:53.453647 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.430950  4030 raft_consensus.cc:493] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.413437  4016 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.443212  3974 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.472684  4010 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.473717 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.474367 30402 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:53.475317  3914 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:53.475525 30524 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:53.475777  3914 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.443413  4002 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.476217  3914 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:53.488765 30485 raft_consensus.cc:3060] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:53.432883  3996 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.469296  4030 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.499294 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:53.500811 30402 raft_consensus.cc:606] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:53.480458  3949 consensus_queue.cc:237] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:53.517035  4023 log.cc:927] Time spent T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.199s	user 0.000s	sys 0.005s
I20260709 13:11:53.485414  4002 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.525651  3996 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.526764 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.527441 30560 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:53.532384 30485 raft_consensus.cc:2468] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:53.534243  3888 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:53.534946  3888 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.535351  3888 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:53.535555 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:53.536393  4017 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.537322  4029 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:53.537725  4029 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.538048  4029 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:53.542502 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.476903  3850 consensus_queue.cc:237] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.543197 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.546216 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.547075 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:53.547021 30479 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 12.
W20260709 13:11:53.553465 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 108521us
I20260709 13:11:53.542416  4016 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:53.574208 31149 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:53.574054 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.545245  4017 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.546573  3948 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:53.583479 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.586028 30402 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.584208 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.584465 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.587088 30411 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 15: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.585340 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.586624 30403 raft_consensus.cc:2393] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 12: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.605656 30555 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:53.605854 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.606937 30404 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.588286 30406 raft_consensus.cc:2368] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
I20260709 13:11:53.563896  4031 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.608424 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:53.654577 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 179114us
W20260709 13:11:53.655145 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 46804.5us
I20260709 13:11:53.616297 30551 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:53.573987  4008 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.619691  4017 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:53.620759  4002 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.629942  3914 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.663103 30559 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:53.587702  4019 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:11:53.636101  4001 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.637949  4036 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:53.671648  4036 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:53.672695  4036 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.643615  3970 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:53.647274 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 199262us
I20260709 13:11:53.653493 30553 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:53.675771  3970 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.677105  4001 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.679642 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:53.680243 31146 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.630578  4030 raft_consensus.cc:515] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.680640 30477 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:53.681993 30556 raft_consensus.cc:2368] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:53.683313  4030 leader_election.cc:290] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.683908 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.691002 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.691771 30482 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.684417 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.692875 30557 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:53.699148  3888 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.701470  3888 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.707041 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.707687 30481 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:53.664326  4031 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.710783  4031 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.662825  3927 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:53.713357  3927 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.716444  3927 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.716814  3998 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:53.721904  3914 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.723695 30403 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:53.726883 31146 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:53.728688 30481 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:53.732400 30523 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.736615 30557 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 12.
I20260709 13:11:53.743924 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:53.744696 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.745472 30402 raft_consensus.cc:2393] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.746063 30450 leader_election.cc:400] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
I20260709 13:11:53.746206 30403 raft_consensus.cc:2393] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.746400 30450 leader_election.cc:403] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.745298 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.757323 30409 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.771133 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.780010 30404 raft_consensus.cc:2393] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:53.759250  3914 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16.
W20260709 13:11:53.791538 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 183543us
W20260709 13:11:53.792037 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 132743us
W20260709 13:11:53.787289 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 287514us
I20260709 13:11:53.795109 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0efe22046955442f80d17ac45b08253b" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.799266 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:53.800472 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.793731 30560 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:53.801309 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:53.801419 30409 raft_consensus.cc:3060] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.800945 30404 raft_consensus.cc:3060] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:53.788288 30482 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:53.802414 31147 raft_consensus.cc:1240] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:53.797328 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.772923  4050 raft_consensus.cc:2804] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:53.805788 30451 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:53.806739 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.807796 30553 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:53.808683 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:53.763347  4042 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:11:53.811543 30553 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:53.811905 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.812114 30523 leader_election.cc:304] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:53.812932 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:53.818555 30404 raft_consensus.cc:2468] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:53.829952 30560 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.821417  4019 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:53.831719  4019 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:53.832577  4019 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.835014  4043 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:11:53.837540 30554 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:53.837925  4008 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:53.839679  3888 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.840276  3888 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.841461  3893 raft_consensus.cc:993] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:53.841910  3893 raft_consensus.cc:1081] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:53.842821  4056 raft_consensus.cc:2804] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:53.843360  4056 raft_consensus.cc:697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:53.809482  3943 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:53.844202  4056 consensus_queue.cc:237] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.844830  3943 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:53.849727  4029 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.814570  3944 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.853116 31147 raft_consensus.cc:1240] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:53.831084  4024 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.489s	user 0.002s	sys 0.002s
I20260709 13:11:53.853585 31146 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:53.853125 30478 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:53.851074  3944 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:53.807662  3914 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:53.845903  3943 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:53.815328  4016 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:53.877997 30553 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:11:53.879400 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 74451.1us
I20260709 13:11:53.879066  3948 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.884584  3948 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.885725 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.886602 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:53.887266 30480 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:53.887616 30480 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.891067 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:53.891858 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:53.902386 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 90350.2us
I20260709 13:11:53.908031 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:53.911334 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.881492  4016 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:53.921375 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 98931.6us
I20260709 13:11:53.916934 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:53.923981  4016 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.925860  4039 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.926463  4039 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.871794  3914 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:53.899978  4020 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.918423  4051 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:53.899749  3919 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.902510  3948 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.934619 30480 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:53.936761 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.940089 30552 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:53.948654 30559 raft_consensus.cc:2468] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:53.950100 30451 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:53.951076 30480 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.952252 30479 raft_consensus.cc:2410] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:53.930222  4029 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:53.938952  4021 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:53.976593 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:53.951789  3974 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.980832 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:53.981518 30556 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:53.981544 30451 leader_election.cc:400] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:53.983104 30451 leader_election.cc:403] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.948206  3919 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:53.988386 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65535.5us
I20260709 13:11:53.997608  4036 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:54.000347  3914 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:54.001293  4064 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 13:11:53.991211  3891 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:11:54.007586  4054 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:54.016702 30552 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:53.977906  3944 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:53.939636  4020 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.043856 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:53.983150  4021 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:11:54.087399 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 43666.7us
W20260709 13:11:54.094391 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 64450.2us
I20260709 13:11:54.096705 30556 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
W20260709 13:11:54.105000 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 224766us
I20260709 13:11:54.092597  4051 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.097081  3945 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:54.100287  3914 raft_consensus.cc:2804] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:54.114086  4072 raft_consensus.cc:2749] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783) with higher term. Message: Invalid argument: T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13.
I20260709 13:11:54.115871  3919 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.117393  4055 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:54.118968  4021 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.120719  3945 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:54.124277  4020 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.126081 30409 raft_consensus.cc:2468] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:11:54.110128  3948 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:11:54.181459  3945 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.153867 30552 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:54.153852 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.187356 30556 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 16.
I20260709 13:11:54.155790 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.188439 30559 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
I20260709 13:11:54.158274 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.189292 30555 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
W20260709 13:11:54.192626 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 224253us
I20260709 13:11:54.157343  3914 raft_consensus.cc:697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.160274  3927 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.223815 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:54.225751 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:54.227667 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:54.233515  3914 consensus_queue.cc:237] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.218266  4051 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.251380  3927 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:54.266355 30477 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:11:54.266826 30477 pending_rounds.cc:85] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 14
I20260709 13:11:54.267118 30477 pending_rounds.cc:107] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:11:54.267450 30477 raft_consensus.cc:2889] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.291651 30409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:54.292555 30409 raft_consensus.cc:606] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.298378 30558 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:11:54.333390 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 351982us
I20260709 13:11:54.326156  3998 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:11:54.344247 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:54.349117 30451 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:54.352017 30556 raft_consensus.cc:1240] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:11:54.352455 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:54.353132 30409 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
W20260709 13:11:54.334795  4050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.010s
I20260709 13:11:54.355683 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.363943 30524 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.365048 30524 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:54.355168  4058 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.487s	user 0.004s	sys 0.011s
I20260709 13:11:54.358800  4050 raft_consensus.cc:697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:54.389585  4082 raft_consensus.cc:2804] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:54.394160  4073 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:54.394775  4073 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.395131  4073 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:54.397912  4083 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:11:54.399302  4090 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:11:54.408385  4083 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:54.408814  4083 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.409744  4083 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.411487  4082 raft_consensus.cc:697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.412328  4092 consensus_queue.cc:1059] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:54.412484  4082 consensus_queue.cc:237] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.415515  4069 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:54.419844  4083 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.426826 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:54.426827 30404 raft_consensus.cc:1275] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:54.427649 30403 raft_consensus.cc:2393] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 14: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:54.435125 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:54.435822 30409 raft_consensus.cc:3055] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:54.436007 30406 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:54.436108 30409 raft_consensus.cc:740] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:54.436954 30409 consensus_queue.cc:260] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.447479 30409 raft_consensus.cc:3060] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:54.435108  3985 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.448485 30450 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:54.465440 30409 raft_consensus.cc:2468] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 13.
I20260709 13:11:54.460676  3970 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:54.454131  3985 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.477620  3985 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:54.478910  4085 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:11:54.451843  4001 consensus_queue.cc:1048] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:11:54.480567 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:54.485375  4080 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:54.496284 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.496979 30555 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 18.
I20260709 13:11:54.483670  4045 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:54.472888  4050 consensus_queue.cc:237] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.513105 30556 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:11:54.512859  4004 log.cc:927] Time spent T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.698s	user 0.012s	sys 0.000s
I20260709 13:11:54.518465 30408 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:54.522007 30556 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:54.525321 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:54.501881  4045 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.527051 30477 raft_consensus.cc:1240] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:54.533226  4089 raft_consensus.cc:993] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:54.533771  4089 raft_consensus.cc:1081] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:54.533977  4072 consensus_queue.cc:1059] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:54.534965  4045 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.520577  4019 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:11:54.540674 30555 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:54.564149 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:54.542718  4010 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:11:54.570238  4043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.011s	sys 0.048s
I20260709 13:11:54.600490 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:54.601305 30480 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:54.601835 30480 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:54.579466  4043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.011s	sys 0.048s
I20260709 13:11:54.612262 30451 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:54.584961  4073 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:54.615824  3888 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:54.578405  3970 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.632450  4072 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.634136  4002 consensus_queue.cc:1059] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:11:54.645222 30557 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:54.649863 30481 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:54.655757 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:54.656606 31146 raft_consensus.cc:606] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.622133  4036 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:54.666770  4042 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:54.668286  4042 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:54.668817  4042 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.671036  4002 consensus_queue.cc:1243] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer 19556a24b91d452d98668a3709fbc29d log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:54.672420 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:54.674646  4036 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.677178  4036 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.677942 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:54.678138 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:54.682438  3850 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:54.685757  4045 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.687132 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.687906 30480 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.696883 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.697655  4045 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.698320 30480 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:54.690999  4098 log.cc:927] Time spent T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:54.693181 30302 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 19 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.698239  4045 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:54.701488 30559 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:54.690513 30303 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 245) took 1460 ms. Trace:
I20260709 13:11:54.710610 30408 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:54.712047 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:54.712028 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:54.717017 30553 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.719024 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:11:54.724021 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 59758us
I20260709 13:11:54.725854 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.734148 30553 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:54.735679 30451 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:54.737514 30376 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.736930  3887 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:54.722595  3898 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:54.721896  4045 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:54.740217  3887 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.759130 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:54.725167  4082 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:11:54.739236  4068 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:11:54.766651 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:54.742168  3985 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.756155  4045 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:54.757539  3887 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:54.775641 30404 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:54.770262 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.771792  4040 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:11:54.772045 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:54.780743 30482 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:11:54.781189 30482 pending_rounds.cc:85] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 13
I20260709 13:11:54.781406 30482 pending_rounds.cc:107] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:11:54.781636 30482 raft_consensus.cc:2889] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.784430 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:54.785202 30408 raft_consensus.cc:3055] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:54.786571 30406 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:54.788400 30404 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:54.789099  4021 raft_consensus.cc:3055] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:54.789553  4021 raft_consensus.cc:740] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.790421  4021 consensus_queue.cc:260] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.791615  4021 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:54.798448  4056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.017s	sys 0.004s
W20260709 13:11:54.798888  4056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.017s	sys 0.005s
I20260709 13:11:54.764384  4042 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:54.803323  4039 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.803246  4045 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.804643 30552 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:54.766770  4017 raft_consensus.cc:2804] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:54.785550 30408 raft_consensus.cc:740] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:54.805883  4017 raft_consensus.cc:697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.814731 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:54.818133 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497264cf15754f0e9029cd057a54a7fb" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:54.819005 30482 raft_consensus.cc:3060] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:54.812314 30408 consensus_queue.cc:260] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.777956  3996 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:54.714617 30303 rpcz_store.cc:276] 0709 13:11:53.229658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.236217 (+  6559us) service_pool.cc:224] Handling call
0709 13:11:54.690424 (+1454207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:53.359650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:53.446861 (+ 87211us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:53.451183 (+  4322us) write_op.cc:435] Acquired schema lock
0709 13:11:53.451211 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:53.505899 (+ 54688us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:53.510770 (+  4871us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:53.512841 (+  2071us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:53.586308 (+ 73467us) tablet.cc:701] Row locks acquired
0709 13:11:53.588795 (+  2487us) write_op.cc:260] PREPARE: finished
0709 13:11:53.614470 (+ 25675us) write_op.cc:270] Start()
0709 13:11:53.624046 (+  9576us) write_op.cc:276] Timestamp: P: 1783602713608229 usec, L: 0
0709 13:11:53.624079 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:53.639410 (+ 15331us) log.cc:844] Serialized 913 byte log entry
0709 13:11:53.822031 (+182621us) op_driver.cc:464] REPLICATION: finished
0709 13:11:54.015634 (+193603us) write_op.cc:301] APPLY: starting
0709 13:11:54.054112 (+ 38478us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:54.222264 (+168152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:54.222359 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:54.223629 (+  1270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:54.223817 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:11:54.223859 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:54.224045 (+   186us) log.cc:844] Serialized 33 byte log entry
0709 13:11:54.224214 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:54.224300 (+    86us) write_op.cc:454] Released schema lock
0709 13:11:54.224340 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:54.225157 (+   817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:54.225199 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4050,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":124154,"apply.run_cpu_time_us":5173,"apply.run_wall_time_us":238081,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":1715,"prepare.run_cpu_time_us":4423,"prepare.run_wall_time_us":288734,"replication_time_us":165357,"thread_start_us":73913,"threads_started":1}]]}
I20260709 13:11:54.832034 30482 raft_consensus.cc:2468] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:11:54.833366 30523 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:54.787245  3985 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:54.836777 30408 raft_consensus.cc:3060] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.881757  3898 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.876365  4038 raft_consensus.cc:2804] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:54.828512  4031 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.879030  4017 consensus_queue.cc:237] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.876546  4034 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:11:54.887033 30478 raft_consensus.cc:3055] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:54.805896  4045 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:54.892522 30478 raft_consensus.cc:740] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:54.899380 30553 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:54.895341 30478 consensus_queue.cc:260] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:54.905118 30478 raft_consensus.cc:3060] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:54.894850  3898 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:54.921434 30478 raft_consensus.cc:1275] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:11:54.921876 30478 pending_rounds.cc:85] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 13
I20260709 13:11:54.922092 30478 pending_rounds.cc:107] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:11:54.922330 30478 raft_consensus.cc:2889] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:54.923328 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 107529us
W20260709 13:11:54.912858  4108 log.cc:927] Time spent T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:11:54.913802  4038 raft_consensus.cc:697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:54.935463  3949 consensus_queue.cc:1048] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:11:54.906230  3945 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:11:54.939953  3887 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:54.897517  4031 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:55.003810 30408 raft_consensus.cc:2468] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
W20260709 13:11:55.020572 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 72409.8us
W20260709 13:11:55.031025  4106 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:11:55.057243  4073 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:55.057667  4038 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:11:55.037779  4058 log.cc:927] Time spent T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.004s
I20260709 13:11:55.069124  4031 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:55.068885  3898 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.071465  3898 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:55.094067  4008 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:11:55.105186  3887 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:55.109431  4016 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:55.118024 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 248) took 1369 ms. Trace:
I20260709 13:11:55.118458 30309 rpcz_store.cc:276] 0709 13:11:53.748132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.748294 (+   162us) service_pool.cc:224] Handling call
0709 13:11:54.307811 (+559517us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400168854. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:11:55.117951 (+810140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381684,"reported_tablets":1,"spinlock_wait_cycles":326178176}
I20260709 13:11:55.124111 30479 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:55.126336 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:55.136183 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:55.141543 30554 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:55.145517 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:55.158735 30450 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:55.160069  4036 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:55.161774  4073 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:55.161916  3887 raft_consensus.cc:493] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:55.162423  4073 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.162535  3887 raft_consensus.cc:515] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.164775  4073 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:55.165514  4036 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:55.168431 30402 raft_consensus.cc:1275] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:55.163151 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:55.170282 30403 raft_consensus.cc:1275] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:55.171654 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ff8d501cb144d0ba1527bbf7c10597" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:55.205031 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:55.207659 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 173605us
I20260709 13:11:55.209983 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:55.210770 30407 raft_consensus.cc:1240] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:55.213084 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:55.214092 30558 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:55.215973 30411 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:55.218649 30403 raft_consensus.cc:1275] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:55.221807 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:55.234881 31146 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:55.237181 30407 raft_consensus.cc:1240] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:55.238901 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:55.239886 30405 raft_consensus.cc:1275] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:55.243688 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:55.246163 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.251952 30376 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.203539  4036 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:11:55.319446 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67911.4us
W20260709 13:11:55.356161 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 111361us
I20260709 13:11:55.215706  4041 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:11:55.361207 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 88303.4us
I20260709 13:11:55.219887  4014 consensus_queue.cc:1048] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:11:55.307251  3948 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:55.437161 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 203623us
W20260709 13:11:55.437664 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 78301.1us
I20260709 13:11:55.305015  4008 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
W20260709 13:11:55.453291 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 201418us
I20260709 13:11:55.400919  4117 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:55.459343 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.462110 30376 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.467406 30407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:55.468207  4035 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:55.468266 30407 raft_consensus.cc:606] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.470882  3927 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:55.390547  4101 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:11:55.430233  4010 consensus_queue.cc:1048] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:55.473584  4040 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.434242  4061 consensus_queue.cc:1048] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:55.531289 30554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:54800
I20260709 13:11:55.532465 30554 raft_consensus.cc:606] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:55.528491  4118 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:11:55.541376  4126 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:11:55.549919 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.553316 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:11:55.590929 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 281820us
I20260709 13:11:55.592463 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.537858  3887 leader_election.cc:290] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:55.600486 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:55.602387 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:55.534322  4040 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:55.618757  4040 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:55.626513  4061 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:55.726541 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 273140us
W20260709 13:11:55.744917 30558 consensus_meta.cc:287] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:11:55.745437 30558 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
W20260709 13:11:55.746551 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 147156us
I20260709 13:11:55.673282  4050 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:55.770100 30477 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:55.772840 30554 raft_consensus.cc:1240] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:55.775115 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 303079us
I20260709 13:11:55.786334 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:55.788074 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ed30c25a2940f2b0a16f63a49eb1a6" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:55.765453  4134 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:55.780463  4050 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:55.831023  4050 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:55.831758  4050 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:55.838089 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54817.4us
W20260709 13:11:55.836861 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 72864us
I20260709 13:11:55.835269  4061 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:55.840355  4101 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.832368  4050 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.825690  4134 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:55.879959 30376 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.843438  4051 consensus_queue.cc:1059] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:11:55.888993 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 109153us
I20260709 13:11:55.890151 30376 leader_election.cc:304] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.886053  4117 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:55.902462 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:55.906834 30555 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:55.911186  4008 consensus_queue.cc:1059] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:55.916507  4050 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:55.870321  4101 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:55.919248  4101 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:11:55.919842 30525 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 497264cf15754f0e9029cd057a54a7fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.920872  4117 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:55.922000  4117 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.923086  3850 raft_consensus.cc:993] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:55.923628  3850 raft_consensus.cc:1081] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:55.862232  4061 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:55.926826 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:55.896914  4031 raft_consensus.cc:2749] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:55.933487 30407 raft_consensus.cc:1275] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:55.936053 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:55.930843  4146 raft_consensus.cc:3055] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:55.941131 30405 raft_consensus.cc:1240] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:55.971109 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:55.935354  4030 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:55.980060 30451 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:55.986618  4136 consensus_queue.cc:1048] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:11:55.988961  4136 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:55.937408  4035 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:55.992396  4142 raft_consensus.cc:993] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:55.992914  4142 raft_consensus.cc:1081] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:55.966341  4146 raft_consensus.cc:740] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:55.964533  4031 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:55.986680  4138 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:11:55.985074  4036 consensus_queue.cc:1059] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:11:56.008471  4050 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:56.025282 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 45301.3us
I20260709 13:11:55.977310  4148 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:56.036419 30302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 136) took 1937 ms. Trace:
I20260709 13:11:56.058092 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.062741 30407 raft_consensus.cc:1240] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting Update request from peer ce312b0d7a1747c8898a748f8d76df81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:56.061678  4134 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.115479  4161 consensus_queue.cc:1059] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:56.116701  4161 raft_consensus.cc:3055] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:56.117069  4161 raft_consensus.cc:740] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:56.117938  4161 consensus_queue.cc:260] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.119388  4161 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:56.121259  4123 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.584s	user 0.000s	sys 0.005s
I20260709 13:11:56.053180  4016 raft_consensus.cc:3055] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:56.111340  4033 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:56.046965  4019 consensus_queue.cc:1048] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:11:56.131902  4016 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:56.088824 30302 rpcz_store.cc:276] 0709 13:11:54.098790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.098917 (+   127us) service_pool.cc:224] Handling call
0709 13:11:56.036350 (+1937433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:54.789840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:54.790385 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:54.790433 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:54.790456 (+    23us) tablet.cc:662] Decoding operations
0709 13:11:54.790826 (+   370us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:54.790897 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:54.790930 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:54.791100 (+   170us) tablet.cc:701] Row locks acquired
0709 13:11:54.791119 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:54.791267 (+   148us) write_op.cc:270] Start()
0709 13:11:54.791370 (+   103us) write_op.cc:276] Timestamp: P: 1783602714791220 usec, L: 0
0709 13:11:54.791389 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:54.792039 (+   650us) log.cc:844] Serialized 533 byte log entry
0709 13:11:55.041558 (+249519us) op_driver.cc:464] REPLICATION: finished
0709 13:11:55.241135 (+199577us) write_op.cc:301] APPLY: starting
0709 13:11:55.241215 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:55.242281 (+  1066us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:55.242397 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:55.362645 (+120248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:55.428256 (+ 65611us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:55.452752 (+ 24496us) write_op.cc:312] APPLY: finished
0709 13:11:55.474808 (+ 22056us) log.cc:844] Serialized 25 byte log entry
0709 13:11:55.494798 (+ 19990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.590268 (+ 95470us) write_op.cc:454] Released schema lock
0709 13:11:55.596220 (+  5952us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:55.769210 (+172990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.771941 (+  2731us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272025,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":189869,"apply.run_cpu_time_us":11032,"apply.run_wall_time_us":441130,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":65039,"prepare.run_cpu_time_us":2482,"prepare.run_wall_time_us":2482,"replication_time_us":162356,"thread_start_us":197998,"threads_started":2}]]}
I20260709 13:11:56.033021  4050 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:56.164819  4151 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:11:56.032886  4146 consensus_queue.cc:260] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.162380  4161 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.183842  4031 raft_consensus.cc:493] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.184473  4031 raft_consensus.cc:515] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.185143 30408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 2990) took 1030 ms. Trace:
I20260709 13:11:56.181309  4161 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.186488  4031 leader_election.cc:290] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.185532 30408 rpcz_store.cc:276] 0709 13:11:55.155063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.155170 (+   107us) service_pool.cc:224] Handling call
0709 13:11:55.155469 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.155672 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.155699 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.036785 (+881086us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b2c000014c8. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa0439a2a11 00007fa0439b2372 00007fa0450e4a01 00007fa0450a943a 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2
0709 13:11:56.037217 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.137133 (+ 99916us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.137168 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.137487 (+   319us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.184836 (+ 47349us) raft_consensus.cc:1685] finished
0709 13:11:56.184857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.185086 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18505984,"thread_start_us":99561,"threads_started":1,"wal-append.queue_time_us":130759}
W20260709 13:11:56.187196  4130 log.cc:927] Time spent T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.652s	user 0.005s	sys 0.005s
I20260709 13:11:56.187767  4161 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.152406  4033 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.189872  4033 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:56.189747 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38000 (request call id 2871) took 1072 ms. Trace:
I20260709 13:11:56.178314  4016 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.190416 30556 rpcz_store.cc:276] 0709 13:11:55.117332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.117479 (+   147us) service_pool.cc:224] Handling call
0709 13:11:55.117935 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.118406 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.118449 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.119061 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.346466 (+227405us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:55.346527 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.346628 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.186558 (+839930us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:56.189341 (+  2783us) raft_consensus.cc:1685] finished
0709 13:11:56.189370 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.189643 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1396,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2739,"spinlock_wait_cycles":16241920,"thread_start_us":226855,"threads_started":1,"wal-append.queue_time_us":339222}
I20260709 13:11:56.194796  4016 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.198153 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.199744 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.205166 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.210137 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.212422  4089 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:56.221005  3996 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.221284  4089 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.221640  3996 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.213451  4002 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:56.229161  4029 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.229760  4029 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.231107 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.231931  4029 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:56.232285  4061 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:56.238238  4002 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.238606 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.239305 30408 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:56.218396  4146 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:56.224145  4089 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:56.257261  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.010s	sys 0.005s
I20260709 13:11:56.258760  4050 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:56.258653  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.010s	sys 0.005s
I20260709 13:11:56.265715  4079 raft_consensus.cc:3055] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:56.266173  4079 raft_consensus.cc:740] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:56.238821  4002 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.267068  4079 consensus_queue.cc:260] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.268357  4079 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:56.269476  4002 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.245733  3996 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:56.272876 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.245987  4016 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.276397  3970 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.276868  4072 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.276937  3970 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.277587  4072 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.278829  3914 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.275470  4016 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.279381  3914 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.280088  4072 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.281445  3914 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.285985 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.286497 30486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34018
I20260709 13:11:56.286911 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.287024 30486 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.288009 30486 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.290207 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.291461 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.292074 30485 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:11:56.266156 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.296451 30408 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:56.308075 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.308221 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.315136 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.316918 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:43256
I20260709 13:11:56.317484 30482 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.317842 30482 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:56.306686 30486 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.332052 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.332836 30479 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:56.342430 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
W20260709 13:11:56.346911  4163 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:11:56.316653  4069 raft_consensus.cc:493] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:11:56.355207  4069 raft_consensus.cc:515] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.362668  4016 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.364996 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.375852 30451 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.320258  4019 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.379292 30450 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.380511 30450 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.379107  4019 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.384447 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.387532 30408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:56.388463 30408 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.390410  4002 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:56.382308  4161 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.392078 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.396193  4146 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.398494 30486 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.401116 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:56.401854 30560 raft_consensus.cc:3055] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:56.402241 30560 raft_consensus.cc:740] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:56.401453 30451 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.425807 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.425956 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.428407  4140 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.436287  4135 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:56.436589 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:56.439081  4069 leader_election.cc:290] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.441412 30560 consensus_queue.cc:260] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.442463 30560 raft_consensus.cc:3060] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.445086 30486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.446269 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.446899 30478 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:11:56.458140  4019 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.460289 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.462505 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.463990 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.466490 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.467880 30560 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:56.468979 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.468832 30302 catalog_manager.cc:5697] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.470455 30302 catalog_manager.cc:5697] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:56.461695 30482 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.502959 30302 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:56.503898 30479 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:56.504429 30302 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 15 to 16, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:56.508402 30408 raft_consensus.cc:2468] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:56.506242 30302 catalog_manager.cc:5697] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.509290 30409 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:56.476081 30451 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:56.517480 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.518483 30524 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.528102 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.544816 30524 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:56.557437 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:56.558080 30560 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:56.535913  4161 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.527410  3914 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:11:56.550458  4163 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:56.568681 30409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.551115  4142 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.527413  4016 raft_consensus.cc:2804] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:56.571072 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.581076 30560 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:56.583595 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.584834 30451 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:56.589196 30560 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:11:56.625247  4170 log.cc:927] Time spent T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:56.595943  4008 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.628541  4143 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:56.631672  4079 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:11:56.632325  4079 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.598971  4072 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:56.639045  4072 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:56.640017  4072 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.643697  4008 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.644246  4008 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:56.572204  4161 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.650876  3970 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.662012 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.662199 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.655229  4161 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.615978  3887 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:56.658957 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d180da17ba548e0ab1ebdfa7dfc1f0a" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.659827 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.680155 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.681092 30479 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:11:56.682984  4135 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.685356 30479 pending_rounds.cc:85] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Aborting all ops after (but not including) 11
I20260709 13:11:56.685453 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.686623 30479 pending_rounds.cc:107] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:56.687006 30479 raft_consensus.cc:2889] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:56.572350  3914 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.683373  4079 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.693466  3914 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.694770 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:56.704418  4008 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.707984 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.709189  4135 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.710387 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.711642  4135 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:56.712037  4135 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.712400  4135 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:56.736724 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.740222 31116 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.747361 30482 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 14 election: Requested vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:56.752104 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7846efa5da12423cb3343cd5f3483869" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:56.752285 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.761855  4137 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:56.762310  4137 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:56.762671  4137 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:56.761871 30374 leader_election.cc:304] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.752857  4150 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.754056  4169 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:56.771306 30374 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.766052  4129 raft_consensus.cc:993] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:56.776232 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:56.785761 30523 leader_election.cc:304] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.749833  4135 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.772261  4140 consensus_queue.cc:1059] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:11:56.772403  4020 raft_consensus.cc:2749] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.773016  4150 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:56.785193  4067 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:56.818908  4172 ts_tablet_manager.cc:933] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.812650  4143 raft_consensus.cc:2749] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.818085  4068 raft_consensus.cc:493] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.817741  3985 raft_consensus.cc:1081] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:56.808748  4075 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:11:56.831238  4150 raft_consensus.cc:3060] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:56.855485  4176 log.cc:927] Time spent T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:56.891088 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:56.891728 30479 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:56.892092 30479 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.848457  4068 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:11:56.903987 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 303444us
I20260709 13:11:56.926038 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:56.929919 30479 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:56.934270 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.936923 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.954344 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:56.956707 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:56.961746 30479 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:56.964426 30560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:56.964977 30560 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.973088 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:56.977571 30523 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:56.962141  3970 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:56.978873  4061 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:56.975155  4135 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:56.979710  4177 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:11:56.998884 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.032399 30451 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:57.031347 30560 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:57.031330  4146 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:57.067806 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca06fa0758d044ec9b556e21520124e6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:57.068496 30411 raft_consensus.cc:3055] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:57.042723  4072 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:57.068841 30411 raft_consensus.cc:740] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:57.079156  4172 tablet_copy_client.cc:323] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:11:57.044936  4016 raft_consensus.cc:697] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:57.064160  4068 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:57.190151 30411 consensus_queue.cc:260] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.197614 30411 raft_consensus.cc:3060] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:57.207176  4183 log.cc:927] Time spent T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:11:57.080772  3998 raft_consensus.cc:3055] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:57.189934  4179 log.cc:927] Time spent T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:11:57.194449  4181 log.cc:927] Time spent T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 13:11:57.196324  4177 log.cc:927] Time spent T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:57.215857  3998 raft_consensus.cc:740] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:57.252365  4137 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:57.254665  4137 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:57.259474  3998 consensus_queue.cc:260] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:57.260797  3998 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:57.187407 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 117690us
I20260709 13:11:57.207237  4016 consensus_queue.cc:237] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.285537 30411 raft_consensus.cc:2468] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:57.299124 30450 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:57.307051 30551 raft_consensus.cc:1240] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:57.334244 30481 raft_consensus.cc:1240] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:57.311970  4119 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.258441  4150 raft_consensus.cc:515] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:57.344094 31150 raft_consensus.cc:1240] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:57.350548  4030 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:57.351184  4030 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.353461  4030 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:57.331668  4198 raft_consensus.cc:2804] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:57.356318 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:57.358175 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:57.358250 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:57.359187 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:11:57.359783 31146 raft_consensus.cc:2410] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:11:57.362861 30560 raft_consensus.cc:1240] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Rejecting Update request from peer 19556a24b91d452d98668a3709fbc29d for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:57.363551 30451 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:57.365626 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet 497264cf15754f0e9029cd057a54a7fb from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:11:57.366295 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet 497264cf15754f0e9029cd057a54a7fb from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-497264cf15754f0e9029cd057a54a7fb
W20260709 13:11:57.367990  4189 log.cc:927] Time spent T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 13:11:57.373476 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:57.374320 30477 raft_consensus.cc:2410] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0472fa7187444a91b443058ef89fceb9 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:11:57.376750 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:57.377547 30411 raft_consensus.cc:2393] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 19: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:57.379441 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
W20260709 13:11:57.434055 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 52341.3us
W20260709 13:11:57.435137 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 74292.3us
I20260709 13:11:57.342797  4119 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.363798  4198 raft_consensus.cc:697] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:57.376797  3970 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:57.455312 30560 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:57.431470  4030 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:57.491303  4150 leader_election.cc:290] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:57.471421  4030 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:11:57.502822 30525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.506091  4119 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:57.503168  4198 consensus_queue.cc:237] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.504541  4030 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:57.518082 30556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 1377) took 1195 ms. Trace:
I20260709 13:11:57.518492 30556 rpcz_store.cc:276] 0709 13:11:56.322766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.323061 (+   295us) service_pool.cc:224] Handling call
0709 13:11:56.323486 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.462896 (+139410us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:56.537134 (+ 74238us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.555846 (+ 18712us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b18004a2e40. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f9ee07 00007fa04adf9ab9 00007fa041fbb69b 00007fa041fb993f 00007fa041fbbc02 00007fa044c4320b 00007fa044c48d23 00007fa044c4923a 00007fa0450b3a2a
0709 13:11:56.810793 (+254947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.810849 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:56.810904 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.911641 (+100737us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b18004a2e40. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f8a2a6 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419
0709 13:11:57.517834 (+606193us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003f2354. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa0450a9e01 00007fa0450a883e 00007fa04a06d419 00007fa0435e4bd4 00007fa0435e4b62 00007fa0435e4a91 00007fa0435e4a0c 00007fa0435e3cc2 00007fa0433e448c 00007fa0433e38c6
0709 13:11:57.517885 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.518021 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74058,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":6802,"raft.queue_time_us":1060,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5599,"spinlock_wait_cycles":374525568,"thread_start_us":253355,"threads_started":1,"wal-append.queue_time_us":394330}
I20260709 13:11:57.521639 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:57.524066  3914 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:57.529592  4173 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.685s	user 0.003s	sys 0.000s
I20260709 13:11:57.531222 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34018 (request call id 3159) took 1246 ms. Trace:
I20260709 13:11:57.531688 30480 rpcz_store.cc:276] 0709 13:11:56.284837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.284945 (+   108us) service_pool.cc:224] Handling call
0709 13:11:56.285247 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.285596 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:56.285624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.286039 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.556841 (+270802us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.556881 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.556948 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.528933 (+971985us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:57.530846 (+  1913us) raft_consensus.cc:1685] finished
0709 13:11:57.530872 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.531116 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2505,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":39043328,"thread_start_us":270436,"threads_started":1,"wal-append.queue_time_us":527141}
W20260709 13:11:57.538360  4182 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
I20260709 13:11:57.543004 30403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53732 (request call id 3008) took 1040 ms. Trace:
I20260709 13:11:57.543444 30403 rpcz_store.cc:276] 0709 13:11:56.502391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.506962 (+  4571us) service_pool.cc:224] Handling call
0709 13:11:56.507675 (+   713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:56.513678 (+  6003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.513721 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:56.527393 (+ 13672us) log.cc:844] Serialized 525 byte log entry
0709 13:11:56.935077 (+407684us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.935132 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.935234 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.537506 (+602272us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:57.542600 (+  5094us) raft_consensus.cc:1685] finished
0709 13:11:57.542653 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.542928 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5463,"raft.queue_time_us":9113,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":11368,"spinlock_wait_cycles":21557632,"thread_start_us":370100,"threads_started":1,"wal-append.queue_time_us":501233}
I20260709 13:11:57.498092 30570 tablet_copy_source_session.cc:215] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:57.591593 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 143214us
I20260709 13:11:57.603834 30558 raft_consensus.cc:1240] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:57.585826  4008 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:11:57.607676 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:57.608389 30558 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 15.
W20260709 13:11:57.620537 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 155482us
I20260709 13:11:57.622074 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:57.622772  4002 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.623317  4002 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.622433 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:57.624505 30407 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:57.624377 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:57.625057 30481 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:57.625594  4002 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:57.629066 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:57.629726 30556 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:57.631014 30451 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
W20260709 13:11:57.632431 30377 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.635509 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:57.637432 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:57.616678  4019 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.636214 30481 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:11:57.652674 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:57.636142  4072 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:57.656051 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:57.656250 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba0b89a2fc4499a917166e3b4b88cf9" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:57.659075 30411 raft_consensus.cc:2393] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 13: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:57.641685  4184 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:57.660645  4072 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.645421  4019 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.666826 30376 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:57.666644  3893 consensus_queue.cc:1059] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:57.679903 31149 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:11:57.674979  4072 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:57.683362 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:57.695324  4169 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:57.693697  3948 raft_consensus.cc:2749] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:57.711611 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 67111.4us
I20260709 13:11:57.724355 30479 raft_consensus.cc:2468] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 13.
I20260709 13:11:57.732591 31116 leader_election.cc:304] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:57.737775  4211 raft_consensus.cc:2804] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:57.738355  4211 raft_consensus.cc:697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:57.739303  4211 consensus_queue.cc:237] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:57.712903  4172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497264cf15754f0e9029cd057a54a7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:57.723781  4069 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:57.767396 30376 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:57.775574 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 55684.1us
I20260709 13:11:57.758343  4069 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.789719  4069 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:57.793702  4142 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:57.773633  3898 consensus_queue.cc:1059] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:11:57.798462 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:57.776827  3985 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:57.799340 30411 raft_consensus.cc:2393] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 17: Already voted for candidate 0472fa7187444a91b443058ef89fceb9 in this term.
I20260709 13:11:57.799471  3985 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.799901  3985 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:57.807530 31147 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:57.800472  4019 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:57.816833  4028 raft_consensus.cc:3055] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:57.817322  4028 raft_consensus.cc:740] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:57.818207  4028 consensus_queue.cc:260] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.819684  4028 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:57.820575 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:57.821375 30403 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 19.
I20260709 13:11:57.822093 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:57.822821 30404 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:57.824209 30405 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:57.836177 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:57.842563  4216 raft_consensus.cc:3055] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:57.843163  4216 raft_consensus.cc:740] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:57.844076  4216 consensus_queue.cc:260] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:57.845647  4216 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:57.848133  4072 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.871418 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:57.872062 30411 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:57.863591  4146 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:11:57.862610  4184 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:57.882143  4184 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.882558  4184 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:57.886427 30404 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:57.895319  4072 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:57.895525  4146 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:57.902510  4184 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.907914 30411 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:57.905524  3985 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:57.910568  3985 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:57.913609  4184 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:11:57.927177 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 149122us
I20260709 13:11:57.929112 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:57.929301 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:57.929996 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:57.930500 30557 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:57.930586 30411 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:57.930018 30482 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:57.928253 30450 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:57.940755 30411 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:57.942250 30450 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:57.944236 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:57.944732 30302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 240) took 1660 ms. Trace:
I20260709 13:11:57.941224 30309 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.954264  4184 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:57.960119 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:57.965857 30482 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:57.967018 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:57.968992 30374 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:57.974082 30557 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 17.
I20260709 13:11:57.947480  4198 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:57.945391 30302 rpcz_store.cc:276] 0709 13:11:56.284593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.286199 (+  1606us) service_pool.cc:224] Handling call
0709 13:11:57.944621 (+1658422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:57.052827 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:57.202288 (+149461us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:57.202333 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:11:57.202353 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:57.273315 (+ 70962us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:57.304832 (+ 31517us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:57.306829 (+  1997us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:11:57.439279 (+132450us) tablet.cc:701] Row locks acquired
0709 13:11:57.444398 (+  5119us) write_op.cc:260] PREPARE: finished
0709 13:11:57.458335 (+ 13937us) write_op.cc:270] Start()
0709 13:11:57.472244 (+ 13909us) write_op.cc:276] Timestamp: P: 1783602717454449 usec, L: 0
0709 13:11:57.473056 (+   812us) op_driver.cc:348] REPLICATION: starting
0709 13:11:57.585274 (+112218us) log.cc:844] Serialized 2075 byte log entry
0709 13:11:57.707014 (+121740us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa041e44db1 00007fa041ee2c85 00007fa041ee36a2 00007fa044c551db 00007fa044c50aaf 00007fa044c4486e 00007fa044c43bb6 00007fa044c437d8 00007fa044c4d221 00007fa044c4d1d9 00007fa044c4d169
0709 13:11:57.757342 (+ 50328us) op_driver.cc:464] REPLICATION: finished
0709 13:11:57.780001 (+ 22659us) write_op.cc:301] APPLY: starting
0709 13:11:57.780069 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:57.782740 (+  2671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:57.782770 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:57.903009 (+120239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:57.903292 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:11:57.903361 (+    69us) write_op.cc:312] APPLY: finished
0709 13:11:57.903675 (+   314us) log.cc:844] Serialized 57 byte log entry
0709 13:11:57.903859 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:57.903965 (+   106us) write_op.cc:454] Released schema lock
0709 13:11:57.904004 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:57.915518 (+ 11514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:57.915563 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":22409,"apply.run_cpu_time_us":8039,"apply.run_wall_time_us":135479,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":489273,"prepare.run_cpu_time_us":19884,"prepare.run_wall_time_us":679091,"raft.queue_time_us":48618,"raft.run_cpu_time_us":9844,"raft.run_wall_time_us":22694,"replication_time_us":284111,"spinlock_wait_cycles":3539840,"thread_start_us":575632,"threads_started":4,"wal-append.queue_time_us":107359}]]}
I20260709 13:11:57.987468 30558 raft_consensus.cc:1275] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:57.981117 30479 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:57.989626 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:57.984180  4215 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:57.990799 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:57.964010  4222 raft_consensus.cc:2804] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:57.992394 30552 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:57.982861  4218 raft_consensus.cc:2764] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:57.978065  4184 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:58.019511  4184 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.013064 30411 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:58.024940 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:58.030001 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:57.995226  4222 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:11:58.029984  4146 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:11:58.034654  4142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53476 (request call id 13) took 6125 ms. Trace:
I20260709 13:11:58.035154  4142 rpcz_store.cc:276] 0709 13:11:51.909681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.909820 (+   139us) service_pool.cc:224] Handling call
0709 13:11:51.918000 (+  8180us) log.cc:844] Serialized 499 byte log entry
0709 13:11:52.080367 (+162367us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b180045cac0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa04ae84de1 00007fa04ae915b1 00007fa041f36c0a 00007fa04b676219 00007fa041fbea40 00007fa041fb94e4 00007fa041fb9455 00007fa045002b0b 00007fa045087b63 00007fa0450af752 00007fa04a06fd29
0709 13:11:52.096882 (+ 16515us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b54001ab1a0. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045012571 00007fa045029b26 00007fa04502349a 00007fa045022714 00007fa045002eaa 00007fa045009d53 00007fa045009cd9 00007fa045009c69 00007fa045009c31 00007fa045008dfd 000000000038f354
0709 13:11:58.034551 (+5937669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61561,"raft.queue_time_us":86736,"raft.run_cpu_time_us":3291,"raft.run_wall_time_us":31519,"spinlock_wait_cycles":18159616,"thread_start_us":87743,"threads_started":1,"wal-append.queue_time_us":106646,"wal-append.run_cpu_time_us":1833,"wal-append.run_wall_time_us":1001858}
I20260709 13:11:58.031158 30552 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:58.053494  4222 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:57.995265  4198 raft_consensus.cc:697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:58.008376  4215 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:58.062463 30552 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:11:58.073961  4222 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.095391 30558 raft_consensus.cc:3060] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.100872  4200 consensus_queue.cc:1048] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:58.114578 30558 raft_consensus.cc:2468] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:58.110123 30402 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:58.112139  4218 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.120434  4198 consensus_queue.cc:237] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.130395  4215 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.175735 30557 raft_consensus.cc:1275] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:58.179476  4222 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:58.180668  4235 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:58.136950  4218 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.184731  4218 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:11:58.175035 30376 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d909a45f39c448af875585d7299103f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.191056 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:58.191061 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:58.191461 30483 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:58.191763 30404 raft_consensus.cc:2368] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 19. Current term is 20.
I20260709 13:11:58.196022 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a59ccddffd4014bdeda9cac96154f7" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:58.198522 30524 leader_election.cc:400] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 19. Current term is 20.
I20260709 13:11:58.198887 30524 leader_election.cc:403] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.201330 30524 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.207568 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:58.209578 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.231420  4172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43936 (request call id 828) took 1964 ms. Trace:
I20260709 13:11:58.231889  4172 rpcz_store.cc:276] 0709 13:11:56.267057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.267949 (+   892us) service_pool.cc:224] Handling call
0709 13:11:56.841071 (+573122us) ts_tablet_manager.cc:934] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
0709 13:11:57.707424 (+866353us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:57.911962 (+204538us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:57.912101 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:58.198853 (+286752us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:58.230872 (+ 32019us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:58.231269 (+   397us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:58.231332 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14028,"tablet-copy.queue_time_us":495748,"thread_start_us":435131,"threads_started":2}
I20260709 13:11:58.200810  4198 consensus_queue.cc:1048] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:58.233376  4172 tablet_copy_client.cc:806] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:58.233958  4172 tablet_copy_client.cc:670] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:58.212970  4222 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:58.204236  4045 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:58.206979  4030 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099) with higher term. Message: Invalid argument: T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 19. Current term is 20.
I20260709 13:11:58.242354 30479 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:58.259627 30560 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:58.262566  4210 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:58.266621 30402 raft_consensus.cc:1275] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:58.268103  3996 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:58.269369  4121 consensus_queue.cc:1048] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:58.282372  4172 tablet_copy_client.cc:538] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:58.297087  4069 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:58.327924 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:58.328817 30411 raft_consensus.cc:606] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.356570 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:58.357479 30411 raft_consensus.cc:606] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.357909 30411 raft_consensus.cc:614] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.364645 30411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:58.365661 30411 raft_consensus.cc:606] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.366021 30411 raft_consensus.cc:614] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.366433 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 249) took 1898 ms. Trace:
I20260709 13:11:58.367367 30303 catalog_manager.cc:5697] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 19 to 21, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 21 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:58.369400 30303 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 17 to 18, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.370985 30303 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 17 to 18, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.372588 30303 catalog_manager.cc:5697] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 12 to 13, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.374153 30303 catalog_manager.cc:5697] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 12 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.377154 30303 catalog_manager.cc:5697] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:58.379776 30303 catalog_manager.cc:5697] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 16 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.383484 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:11:58.384117 31147 raft_consensus.cc:606] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:11:58.368221 30309 rpcz_store.cc:276] 0709 13:11:56.468201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.471987 (+  3786us) service_pool.cc:224] Handling call
0709 13:11:58.366368 (+1894381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:57.976901 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:58.045395 (+ 68494us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:58.045432 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:58.045450 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:58.045771 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:58.045837 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:58.045869 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:58.046062 (+   193us) tablet.cc:701] Row locks acquired
0709 13:11:58.046079 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:11:58.046209 (+   130us) write_op.cc:270] Start()
0709 13:11:58.046332 (+   123us) write_op.cc:276] Timestamp: P: 1783602718046170 usec, L: 0
0709 13:11:58.046353 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:58.047024 (+   671us) log.cc:844] Serialized 533 byte log entry
0709 13:11:58.048667 (+  1643us) op_driver.cc:464] REPLICATION: finished
0709 13:11:58.049101 (+   434us) write_op.cc:301] APPLY: starting
0709 13:11:58.049186 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:58.050052 (+   866us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:58.050140 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:58.050893 (+   753us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:58.051039 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:58.051083 (+    44us) write_op.cc:312] APPLY: finished
0709 13:11:58.051231 (+   148us) log.cc:844] Serialized 25 byte log entry
0709 13:11:58.051385 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.051459 (+    74us) write_op.cc:454] Released schema lock
0709 13:11:58.051496 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:58.051793 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.051818 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":646,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":2664,"apply.run_wall_time_us":2663,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2723,"prepare.run_wall_time_us":83249,"replication_time_us":2203}]]}
I20260709 13:11:58.399250 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b473589cd94be59022580022e2de00"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:58.399969 30402 raft_consensus.cc:606] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
W20260709 13:11:58.404992  4241 log.cc:927] Time spent T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 13:11:58.407713 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d909a45f39c448af875585d7299103f6"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:11:58.408557 30402 raft_consensus.cc:606] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS ce312b0d7a1747c8898a748f8d76df81
I20260709 13:11:58.410671 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:58.412482 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:58.429500  4028 raft_consensus.cc:993] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:58.430050  4028 raft_consensus.cc:1081] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:58.435038  4172 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:58.437057 30402 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:58.438347 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4b473589cd94be59022580022e2de00"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:58.438889 30482 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.439224 30482 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:58.440294  4215 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:58.444303  4121 raft_consensus.cc:993] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:58.444765  4121 raft_consensus.cc:1081] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:11:58.446556 30552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:11:58.447088 30552 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.447412 30552 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:58.444342  4198 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:11:58.452216 30560 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:58.453634  4198 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:58.454857 30482 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.464471 30558 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:58.465840 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:58.466400 31146 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:58.468497 30482 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:58.469657 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b473589cd94be59022580022e2de00" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:58.470237 30411 raft_consensus.cc:3055] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:58.470526 30411 raft_consensus.cc:740] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:58.471253 30411 consensus_queue.cc:260] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.474872 30411 raft_consensus.cc:3060] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:58.491534 30411 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:58.492935 30450 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:58.493842  4002 raft_consensus.cc:2804] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:58.494378  4002 raft_consensus.cc:697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:58.495532  4002 consensus_queue.cc:237] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.499498 31146 raft_consensus.cc:2468] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:11:58.502278 30303 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 246) took 1935 ms. Trace:
I20260709 13:11:58.482492 30552 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.505333 30304 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 16 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 17 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.513348 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:58.513960 30482 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:58.554384 30552 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:58.556202 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b1451644b74f359b2aae8ebfaf45d3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:58.557535 31147 raft_consensus.cc:3055] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:58.558090 31147 raft_consensus.cc:740] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:11:58.566990 30482 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:58.577185 31147 consensus_queue.cc:260] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.505930 30303 rpcz_store.cc:276] 0709 13:11:56.567056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.567199 (+   143us) service_pool.cc:224] Handling call
0709 13:11:58.502183 (+1934984us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:58.382743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:58.383342 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:58.383375 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:11:58.383390 (+    15us) tablet.cc:662] Decoding operations
0709 13:11:58.384238 (+   848us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:58.384294 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:58.384321 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:58.384917 (+   596us) tablet.cc:701] Row locks acquired
0709 13:11:58.384936 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:58.385076 (+   140us) write_op.cc:270] Start()
0709 13:11:58.385180 (+   104us) write_op.cc:276] Timestamp: P: 1783602718385029 usec, L: 0
0709 13:11:58.385199 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:58.392032 (+  6833us) log.cc:844] Serialized 2839 byte log entry
0709 13:11:58.420432 (+ 28400us) op_driver.cc:464] REPLICATION: finished
0709 13:11:58.422802 (+  2370us) write_op.cc:301] APPLY: starting
0709 13:11:58.422892 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:58.426645 (+  3753us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:58.431573 (+  4928us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:58.468135 (+ 36562us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:58.468334 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:11:58.468413 (+    79us) write_op.cc:312] APPLY: finished
0709 13:11:58.473661 (+  5248us) log.cc:844] Serialized 73 byte log entry
0709 13:11:58.474390 (+   729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.474506 (+   116us) write_op.cc:454] Released schema lock
0709 13:11:58.474553 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:58.474958 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.474985 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":308710,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":2131,"apply.run_cpu_time_us":9850,"apply.run_wall_time_us":52113,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29288,"num_ops":7,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":3625,"prepare.run_wall_time_us":44155,"replication_time_us":35100}]]}
I20260709 13:11:58.584336 31147 raft_consensus.cc:3060] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:58.587505 30523 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:58.603919  4142 raft_consensus.cc:2804] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:58.622201  3887 raft_consensus.cc:993] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:58.628156 31147 raft_consensus.cc:2468] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:11:58.628001 30552 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:58.630985  4168 raft_consensus.cc:1081] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
W20260709 13:11:58.677533 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50065.2us
I20260709 13:11:58.633013  4142 raft_consensus.cc:697] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:58.685590 30560 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:58.687366  4215 raft_consensus.cc:993] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:58.688071  4215 raft_consensus.cc:1081] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Signalling peer ce312b0d7a1747c8898a748f8d76df81 to start an election
I20260709 13:11:58.692351  4216 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:58.692898 30405 raft_consensus.cc:1275] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:58.693286  4079 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:58.697667  4198 consensus_queue.cc:1048] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:58.682318  4142 consensus_queue.cc:237] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:58.713696 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f911d757027485a941dce045769b0fe"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:58.714356 30482 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.714774 30482 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.715296 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d909a45f39c448af875585d7299103f6"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
 from {username='slave'} at 127.0.0.1:34032
I20260709 13:11:58.724093 30482 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.738749 30482 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:58.739244 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:58.713935 30483 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:58.739864 30558 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.752799 30558 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:58.750945 30484 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:58.760900 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f911d757027485a941dce045769b0fe" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:58.763238 30403 raft_consensus.cc:3055] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:58.763571 30403 raft_consensus.cc:740] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:58.767395 30451 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:58.768311  4072 raft_consensus.cc:2804] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:58.768805  4072 raft_consensus.cc:697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:58.770169  4072 consensus_queue.cc:237] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.764475 30403 consensus_queue.cc:260] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.778115 30403 raft_consensus.cc:3060] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.763829  4069 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.803823 30403 raft_consensus.cc:2468] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:11:58.804056  4069 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.859207  4069 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:58.860729 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:58.861416 30403 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:11:58.862635 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:58.865154  4030 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:58.865727  4030 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.866182  4030 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:58.887454  4254 log.cc:927] Time spent T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:58.922467 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:58.929591 30479 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.930172 30479 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:58.938369 30479 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:58.981371  4030 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:58.990216  4030 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:58.991518  4262 ts_tablet_manager.cc:933] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:11:58.996590  4262 tablet_copy_client.cc:323] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
W20260709 13:11:59.044895 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 124204us
W20260709 13:11:59.065819 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 103263us
I20260709 13:11:59.075798 30421 tablet_copy_service.cc:140] P 0472fa7187444a91b443058ef89fceb9: Received BeginTabletCopySession request for tablet d909a45f39c448af875585d7299103f6 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53876)
I20260709 13:11:59.076943 30421 tablet_copy_service.cc:161] P 0472fa7187444a91b443058ef89fceb9: Beginning new tablet copy session on tablet d909a45f39c448af875585d7299103f6 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53876: session id = 19556a24b91d452d98668a3709fbc29d-d909a45f39c448af875585d7299103f6
W20260709 13:11:59.119755 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47517.9us
W20260709 13:11:59.135962 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 68784.8us
I20260709 13:11:59.146373 30484 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:59.160454  4266 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:59.161788  4266 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:59.175196  3887 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:59.158192 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:59.182367 30411 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:59.189074 30479 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:59.189280 30421 tablet_copy_source_session.cc:215] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:59.203898 30402 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:59.216018  3970 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:59.216924  3970 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:59.217196 30304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 137) took 2521 ms. Trace:
I20260709 13:11:59.219573  3970 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:11:59.217298 30403 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:59.207794 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 208163us
I20260709 13:11:59.243252 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:59.217772 30304 rpcz_store.cc:276] 0709 13:11:56.695573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.695853 (+   280us) service_pool.cc:224] Handling call
0709 13:11:59.216925 (+2521072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:58.582612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:58.647645 (+ 65033us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:58.647682 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:58.647698 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:58.648024 (+   326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:58.648074 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:58.648099 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:58.648316 (+   217us) tablet.cc:701] Row locks acquired
0709 13:11:58.648334 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:58.648458 (+   124us) write_op.cc:270] Start()
0709 13:11:58.648563 (+   105us) write_op.cc:276] Timestamp: P: 1783602718648416 usec, L: 0
0709 13:11:58.648586 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:58.649132 (+   546us) log.cc:844] Serialized 533 byte log entry
0709 13:11:58.651351 (+  2219us) op_driver.cc:464] REPLICATION: finished
0709 13:11:58.652189 (+   838us) write_op.cc:301] APPLY: starting
0709 13:11:58.652266 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:58.653020 (+   754us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:58.653129 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:58.653806 (+   677us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:58.653963 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:58.654008 (+    45us) write_op.cc:312] APPLY: finished
0709 13:11:58.654174 (+   166us) log.cc:844] Serialized 25 byte log entry
0709 13:11:58.654323 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.654398 (+    75us) write_op.cc:454] Released schema lock
0709 13:11:58.654441 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:58.678028 (+ 23587us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.680160 (+  2132us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11567,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":630,"apply.run_cpu_time_us":2520,"apply.run_wall_time_us":2520,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2800,"prepare.run_wall_time_us":72322,"replication_time_us":2659}]]}
I20260709 13:11:59.230643  4172 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 13:11:59.236624 30303 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 15 to 17, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 17 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.251540 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:59.258107 30403 raft_consensus.cc:3055] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:59.252781 30411 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:11:59.258455 30403 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:11:59.262825  4172 tablet_bootstrap.cc:492] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:11:59.264209  4172 ts_tablet_manager.cc:1403] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.829s	user 0.048s	sys 0.015s
I20260709 13:11:59.270267 31146 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:11:59.272514  4262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a45f39c448af875585d7299103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:59.271623 30303 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 10, term changed from 13 to 15, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:59.276901  4218 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:59.277345 30303 catalog_manager.cc:5697] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 14 to 15, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:59.284778 30403 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:59.286386 30403 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:59.286511  4266 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:59.293437  3970 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:59.294540  4198 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:59.300011 31149 raft_consensus.cc:1275] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:59.282133  4172 raft_consensus.cc:359] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:59.306185  4172 raft_consensus.cc:740] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:11:59.307286 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
W20260709 13:11:59.314797 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.331889 31147 raft_consensus.cc:2393] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:11:59.305006 30524 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9; no voters: 
I20260709 13:11:59.321360 30556 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:59.323002 30485 raft_consensus.cc:1240] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Rejecting Update request from peer 0472fa7187444a91b443058ef89fceb9 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:59.324829 30451 consensus_peers.cc:597] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9005afb08e044cf08de618af26cfcf42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.334276  3914 consensus_queue.cc:1048] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:59.327759 30303 catalog_manager.cc:5697] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 12 to 13, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 13 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:11:59.329748 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:59.341758 30411 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:59.342326 30303 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.343703  4218 raft_consensus.cc:2804] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:59.344303  4218 raft_consensus.cc:697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:11:59.345396  4218 consensus_queue.cc:237] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:11:59.354661 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:59.355370 30483 raft_consensus.cc:3060] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:59.364750 30483 raft_consensus.cc:2468] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:11:59.345882  4172 consensus_queue.cc:260] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:59.377393 30484 raft_consensus.cc:1275] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:11:59.378257 30450 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:59.344316 30303 catalog_manager.cc:5697] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 16 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:11:59.401748  4253 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.402333  4253 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:59.405242  4253 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:59.395037  3914 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:59.407262  3914 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:11:59.407788  3914 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:59.412667 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a45f39c448af875585d7299103f6" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:11:59.413108 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:11:59.413411 30556 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:59.416659 30551 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.406473  4172 ts_tablet_manager.cc:1434] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.142s	user 0.010s	sys 0.000s
I20260709 13:11:59.409047 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9" is_pre_election: true
I20260709 13:11:59.423982 30407 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:59.426098  3970 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:59.429083 31117 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:11:59.429683 30403 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:59.432169 30451 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:11:59.433493  4260 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:59.435081  3970 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:59.436533  3996 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:59.436962  3996 raft_consensus.cc:493] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.437321  3996 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:59.442186 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:59.442377  4262 tablet_copy_client.cc:806] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:59.442992  4262 tablet_copy_client.cc:670] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:59.455159 30556 raft_consensus.cc:2468] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
I20260709 13:11:59.455775 30450 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:11:59.458911  3970 raft_consensus.cc:2804] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:59.459558  3970 raft_consensus.cc:697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:11:59.459645  4265 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:59.477555 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-497264cf15754f0e9029cd057a54a7fb received from {username='slave'} at 127.0.0.1:53492
I20260709 13:11:59.478261 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-497264cf15754f0e9029cd057a54a7fb on tablet 497264cf15754f0e9029cd057a54a7fb with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:11:59.491103 30483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:11:59.496534 30403 raft_consensus.cc:1275] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.504031  4262 tablet_copy_client.cc:538] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:59.560909  4172 ts_tablet_manager.cc:933] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:59.519114  3914 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:59.591594 30403 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:11:59.499528  3970 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:59.599321 30483 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 16.
I20260709 13:11:59.573675  4198 consensus_queue.cc:1048] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 13:11:59.599781 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70993.7us
I20260709 13:11:59.611074 30407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:59.624085  3996 raft_consensus.cc:515] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:11:59.626963 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:11:59.627709 31149 raft_consensus.cc:2368] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17.
I20260709 13:11:59.629954 30451 leader_election.cc:400] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17.
I20260709 13:11:59.630355 30451 leader_election.cc:403] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:59.631556  4259 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:59.632618  4142 consensus_queue.cc:1048] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:59.648809 30411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:11:59.607874  3914 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:11:59.721196  4262 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:11:59.646445  3996 leader_election.cc:290] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:11:59.732075 31148 raft_consensus.cc:1217] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Deduplicated request from leader. Original: 13.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:11:59.733000 31148 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:11:59.736826 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45560.8us
W20260709 13:11:59.701198 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 45943.8us
I20260709 13:11:59.699393 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632f38fdbf84c58a587a59a81f394ce" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:11:59.743049 30407 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:11:59.702868  4172 tablet_copy_client.cc:323] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
W20260709 13:11:59.704622  4279 log.cc:927] Time spent T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:11:59.772719  4275 log.cc:927] Time spent T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
W20260709 13:11:59.813565 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 50549.5us
I20260709 13:11:59.817551 30407 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.832001  4143 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:11:59.843938  4259 raft_consensus.cc:2749] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627) with higher term. Message: Invalid argument: T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 for earlier term 16. Current term is 17.
I20260709 13:11:59.863611 30484 raft_consensus.cc:2468] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:11:59.882840 30553 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:11:59.910822 30480 raft_consensus.cc:1275] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.989579  4291 consensus_queue.cc:1048] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:11:59.994784 30495 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 9005afb08e044cf08de618af26cfcf42 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:11:59.995574 30495 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 9005afb08e044cf08de618af26cfcf42 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-9005afb08e044cf08de618af26cfcf42
I20260709 13:12:00.047150 30555 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.055904 31116 leader_election.cc:304] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:00.071636  4196 raft_consensus.cc:2804] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:00.075263  4196 raft_consensus.cc:697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:00.100345  4196 consensus_queue.cc:237] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:00.111373 30480 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:00.114784 30407 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:00.117823 30495 tablet_copy_source_session.cc:215] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:12:00.121649 30451 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.113339  4291 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:12:00.129557 30403 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:00.130764  4142 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:00.140615  4172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9005afb08e044cf08de618af26cfcf42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:00.149490 30525 consensus_peers.cc:597] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc136e9e62d1428b88f928b6ccef8316. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.218562  4069 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.223793 30557 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:00.226945 30404 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.229707 30480 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.240391  4198 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.241577  4002 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.374418 30303 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35860 (request call id 250) took 1777 ms. Trace:
I20260709 13:12:00.383253 30303 rpcz_store.cc:276] 0709 13:11:58.597309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.597472 (+   163us) service_pool.cc:224] Handling call
0709 13:12:00.374325 (+1776853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:59.830742 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:59.831309 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:59.831369 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:11:59.831388 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:59.832288 (+   900us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:59.832372 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:59.832403 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:59.833013 (+   610us) tablet.cc:701] Row locks acquired
0709 13:11:59.833043 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:11:59.833223 (+   180us) write_op.cc:270] Start()
0709 13:11:59.833366 (+   143us) write_op.cc:276] Timestamp: P: 1783602719833158 usec, L: 0
0709 13:11:59.833414 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:11:59.859232 (+ 25818us) log.cc:844] Serialized 2512 byte log entry
0709 13:12:00.048258 (+189026us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.082340 (+ 34082us) write_op.cc:301] APPLY: starting
0709 13:12:00.082430 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.228591 (+146161us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.250105 (+ 21514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.339280 (+ 89175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.339628 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:12:00.339675 (+    47us) write_op.cc:312] APPLY: finished
0709 13:12:00.340014 (+   339us) log.cc:844] Serialized 65 byte log entry
0709 13:12:00.340214 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.340330 (+   116us) write_op.cc:454] Released schema lock
0709 13:12:00.340399 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.340889 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.340915 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":31460,"apply.run_cpu_time_us":11209,"apply.run_wall_time_us":258524,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29231,"num_ops":6,"prepare.queue_time_us":184760,"prepare.run_cpu_time_us":12762,"prepare.run_wall_time_us":118383,"raft.queue_time_us":120276,"raft.run_cpu_time_us":9008,"raft.run_wall_time_us":19237,"replication_time_us":214680,"thread_start_us":289313,"threads_started":4,"wal-append.queue_time_us":66137}]]}
I20260709 13:12:00.376291 30302 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 13 to 14, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 14 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.393275  4291 raft_consensus.cc:1064] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:00.397406  4291 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:00.412070 31148 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:00.416510 30411 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:00.417673  4302 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.418530 30481 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:00.421072  4299 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.430816  4172 tablet_copy_client.cc:806] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:00.430892  4299 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.433164  4172 tablet_copy_client.cc:670] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:00.448899  4293 log.cc:927] Time spent T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: Append to log took a long time: real 0.108s	user 0.004s	sys 0.007s
I20260709 13:12:00.453450  4172 tablet_copy_client.cc:538] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:00.458420  4310 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.012s
W20260709 13:12:00.469581  4312 log.cc:927] Time spent T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: Append to log took a long time: real 0.058s	user 0.000s	sys 0.005s
I20260709 13:12:00.481060  4262 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:00.482084  4262 tablet_bootstrap.cc:492] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:00.482831  4262 ts_tablet_manager.cc:1403] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.762s	user 0.058s	sys 0.007s
I20260709 13:12:00.484475  4302 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.474562 30302 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35874 (request call id 241) took 2271 ms. Trace:
I20260709 13:12:00.475565 30304 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.497192 30480 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.498880 30304 catalog_manager.cc:5697] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.504537 30304 catalog_manager.cc:5697] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 14 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.520597  4262 raft_consensus.cc:359] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:00.521539  4262 raft_consensus.cc:740] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:00.494128 30302 rpcz_store.cc:276] 0709 13:11:58.203465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.203632 (+   167us) service_pool.cc:224] Handling call
0709 13:12:00.474481 (+2270849us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:00.404165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:00.404710 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:00.404744 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:12:00.404760 (+    16us) tablet.cc:662] Decoding operations
0709 13:12:00.405090 (+   330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:00.405156 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:00.405184 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:00.405362 (+   178us) tablet.cc:701] Row locks acquired
0709 13:12:00.405378 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:12:00.405513 (+   135us) write_op.cc:270] Start()
0709 13:12:00.405615 (+   102us) write_op.cc:276] Timestamp: P: 1783602720405471 usec, L: 0
0709 13:12:00.405637 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:00.406197 (+   560us) log.cc:844] Serialized 533 byte log entry
0709 13:12:00.450927 (+ 44730us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.451409 (+   482us) write_op.cc:301] APPLY: starting
0709 13:12:00.451500 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.452450 (+   950us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.452565 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.453432 (+   867us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.453592 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:12:00.453643 (+    51us) write_op.cc:312] APPLY: finished
0709 13:12:00.453938 (+   295us) log.cc:844] Serialized 25 byte log entry
0709 13:12:00.454092 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.454188 (+    96us) write_op.cc:454] Released schema lock
0709 13:12:00.454227 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.489733 (+ 35506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.489763 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71738,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":3038,"apply.run_wall_time_us":38254,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":405,"prepare.run_cpu_time_us":2344,"prepare.run_wall_time_us":2344,"replication_time_us":45147,"spinlock_wait_cycles":46336}]]}
I20260709 13:12:00.515614 30304 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index -1 to 11, term changed from 16 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to <none>, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 17 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.515255 31149 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.522254  4262 consensus_queue.cc:260] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:00.579847 30304 catalog_manager.cc:5697] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 19 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 20 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.594003 30408 raft_consensus.cc:3060] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:00.611295 30408 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:00.621920  4212 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:12:00.650506 30309 catalog_manager.cc:5697] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 13 to 14, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 14 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.679991 30309 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49162 (request call id 138) took 1142 ms. Trace:
I20260709 13:12:00.683468  4172 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:12:00.684988 30304 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 247) took 1308 ms. Trace:
I20260709 13:12:00.694437 30404 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.697827  4262 ts_tablet_manager.cc:1434] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.201s	user 0.007s	sys 0.000s
I20260709 13:12:00.704723 30421 tablet_copy_service.cc:342] P 0472fa7187444a91b443058ef89fceb9: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-d909a45f39c448af875585d7299103f6 received from {username='slave'} at 127.0.0.1:53876
I20260709 13:12:00.705235 30421 tablet_copy_service.cc:434] P 0472fa7187444a91b443058ef89fceb9: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-d909a45f39c448af875585d7299103f6 on tablet d909a45f39c448af875585d7299103f6 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:00.732973 30477 raft_consensus.cc:1275] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:00.731102  4262 ts_tablet_manager.cc:933] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:00.685390 30304 rpcz_store.cc:276] 0709 13:11:59.377218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.394320 (+ 17102us) service_pool.cc:224] Handling call
0709 13:12:00.684933 (+1290613us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:00.602085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:00.602609 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:00.602643 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:12:00.602660 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:00.603337 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:00.603378 (+    41us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:00.603395 (+    17us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:00.603748 (+   353us) tablet.cc:701] Row locks acquired
0709 13:12:00.603759 (+    11us) write_op.cc:260] PREPARE: finished
0709 13:12:00.603952 (+   193us) write_op.cc:270] Start()
0709 13:12:00.604035 (+    83us) write_op.cc:276] Timestamp: P: 1783602720603916 usec, L: 0
0709 13:12:00.604050 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:12:00.604512 (+   462us) log.cc:844] Serialized 2097 byte log entry
0709 13:12:00.635297 (+ 30785us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.635685 (+   388us) write_op.cc:301] APPLY: starting
0709 13:12:00.635781 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.639089 (+  3308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.639180 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.642843 (+  3663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.643064 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:12:00.643125 (+    61us) write_op.cc:312] APPLY: finished
0709 13:12:00.643426 (+   301us) log.cc:844] Serialized 57 byte log entry
0709 13:12:00.643625 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.643744 (+   119us) write_op.cc:454] Released schema lock
0709 13:12:00.643803 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.645843 (+  2040us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.645879 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6302,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":8234,"apply.run_wall_time_us":10121,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20920,"num_ops":5,"prepare.queue_time_us":678,"prepare.run_cpu_time_us":2762,"prepare.run_wall_time_us":2762,"replication_time_us":31122,"spinlock_wait_cycles":32640}]]}
I20260709 13:12:00.680408 30309 rpcz_store.cc:276] 0709 13:11:59.537558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.538025 (+   467us) service_pool.cc:224] Handling call
0709 13:12:00.679924 (+1141899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:00.663448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:00.664193 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:00.664268 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:12:00.664283 (+    15us) tablet.cc:662] Decoding operations
0709 13:12:00.665020 (+   737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:00.665195 (+   175us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:00.665256 (+    61us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:00.665606 (+   350us) tablet.cc:701] Row locks acquired
0709 13:12:00.665654 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:12:00.665938 (+   284us) write_op.cc:270] Start()
0709 13:12:00.666159 (+   221us) write_op.cc:276] Timestamp: P: 1783602720665820 usec, L: 0
0709 13:12:00.666222 (+    63us) op_driver.cc:348] REPLICATION: starting
0709 13:12:00.667300 (+  1078us) log.cc:844] Serialized 533 byte log entry
0709 13:12:00.669183 (+  1883us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.669614 (+   431us) write_op.cc:301] APPLY: starting
0709 13:12:00.669693 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.670586 (+   893us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.670673 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.671405 (+   732us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.671566 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:12:00.671611 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:00.671783 (+   172us) log.cc:844] Serialized 25 byte log entry
0709 13:12:00.671931 (+   148us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.672006 (+    75us) write_op.cc:454] Released schema lock
0709 13:12:00.672041 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.672382 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.672414 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4666,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":2724,"apply.run_wall_time_us":2724,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":337,"prepare.run_cpu_time_us":3039,"prepare.run_wall_time_us":5507,"replication_time_us":2800}]]}
I20260709 13:12:00.737165 30302 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: leader changed from <none> to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.740944 30302 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 18 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.756904 30302 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:00.768450 30302 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 10 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.774298 30302 catalog_manager.cc:5697] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 18 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 20 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.751417  3996 consensus_queue.cc:1048] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:12:00.864297 30309 catalog_manager.cc:5697] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 15 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 17 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.868825 30560 consensus_queue.cc:237] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:00.876050 30555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:12:00.876773 30555 raft_consensus.cc:606] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:12:00.825563  4262 tablet_copy_client.cc:323] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:12:00.883745 31149 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:00.884428 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet cc136e9e62d1428b88f928b6ccef8316 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:12:00.885489 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:12:00.886894 30551 raft_consensus.cc:606] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:12:00.884970 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet cc136e9e62d1428b88f928b6ccef8316 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-cc136e9e62d1428b88f928b6ccef8316
W20260709 13:12:00.891369 30295 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for cc136e9e62d1428b88f928b6ccef8316 already in progress [suppressed 5 similar messages]
I20260709 13:12:00.889467  4291 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:12:00.895956 30411 raft_consensus.cc:1275] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:00.899812  4143 consensus_queue.cc:1048] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:00.904001 31149 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.902676  4143 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:00.938634 30570 tablet_copy_source_session.cc:215] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:00.942265 31148 raft_consensus.cc:3060] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 16 LEARNER]: Advancing to term 17
I20260709 13:12:00.948529  4262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc136e9e62d1428b88f928b6ccef8316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:00.913060 30411 raft_consensus.cc:2955] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:00.985492 30295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 94242.2us
I20260709 13:12:01.022722 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37434
I20260709 13:12:01.023765 30551 raft_consensus.cc:606] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:12:01.047922  4291 raft_consensus.cc:993] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:12:01.080403  4291 raft_consensus.cc:1081] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:12:01.101804 30404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53732
I20260709 13:12:01.102453 30404 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:01.102869 30404 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:01.109614 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 86044.8us
I20260709 13:12:01.130440 30404 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:01.132527 30357 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:12:01.132970 30357 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for cc136e9e62d1428b88f928b6ccef8316 already in progress
W20260709 13:12:01.133275 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for cc136e9e62d1428b88f928b6ccef8316 already in progress
I20260709 13:12:01.165484 30304 catalog_manager.cc:5697] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index 12 to 13, VOTER ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) evicted. New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:01.159312  4262 tablet_copy_client.cc:806] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
W20260709 13:12:01.179167 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 90599us
I20260709 13:12:01.180364 30295 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 497264cf15754f0e9029cd057a54a7fb with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:12:01.174072  4309 log.cc:927] Time spent T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:12:01.191845  4262 tablet_copy_client.cc:670] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:01.265250 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:01.267379 30479 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:01.295944 30404 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:01.303341  4262 tablet_copy_client.cc:538] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:01.306274 30479 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
I20260709 13:12:01.313068  4262 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:12:01.314025 30481 raft_consensus.cc:1240] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Rejecting Update request from peer 027e191e31da4af2bc83c5ddc0c15d05 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:01.317034 30475 tablet_service.cc:1558] Processing DeleteTablet for tablet 497264cf15754f0e9029cd057a54a7fb with delete_type TABLET_DATA_TOMBSTONED (TS ce312b0d7a1747c8898a748f8d76df81 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38756
W20260709 13:12:01.322332 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45080.9us
I20260709 13:12:01.324324 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:01.325100 30555 raft_consensus.cc:3055] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:01.325434 30555 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
W20260709 13:12:01.328984 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 151221us
W20260709 13:12:01.332381 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 139903us
I20260709 13:12:01.347158 30555 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:01.349257 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 142485us
I20260709 13:12:01.350091 30555 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:01.349938 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:01.406190 30555 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 19.
W20260709 13:12:01.439437 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 84219.6us
W20260709 13:12:01.453382 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 91406.5us
I20260709 13:12:01.453377 30374 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:01.465051  4329 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:01.465657  4329 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:12:01.466625  4329 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:01.536908 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 174319us
I20260709 13:12:01.546440  4172 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:01.571736  4335 tablet_replica.cc:333] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:01.572937  4335 raft_consensus.cc:2243] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:01.591557  4331 raft_consensus.cc:1064] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:01.595189  4335 raft_consensus.cc:2272] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:01.599673  4172 tablet_bootstrap.cc:492] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:01.600433  4172 ts_tablet_manager.cc:1403] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.917s	user 0.048s	sys 0.015s
I20260709 13:12:01.640300  4335 ts_tablet_manager.cc:1916] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:01.594367  4331 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:01.687127  4172 raft_consensus.cc:359] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:01.688140  4172 raft_consensus.cc:740] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:01.688819  4172 consensus_queue.cc:260] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:01.733306  4172 ts_tablet_manager.cc:1434] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.000s
I20260709 13:12:01.738037 31150 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:01.747726 30560 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:01.747936 30495 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-9005afb08e044cf08de618af26cfcf42 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:12:01.748453 30495 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-9005afb08e044cf08de618af26cfcf42 on tablet 9005afb08e044cf08de618af26cfcf42 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:01.751699  4335 ts_tablet_manager.cc:1929] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:12:01.767705  4335 log.cc:1199] T 497264cf15754f0e9029cd057a54a7fb P ce312b0d7a1747c8898a748f8d76df81: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/wals/497264cf15754f0e9029cd057a54a7fb
I20260709 13:12:01.768296  4079 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:12:01.770403  4331 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:01.776122 30293 catalog_manager.cc:5028] TS ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): tablet 497264cf15754f0e9029cd057a54a7fb (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:12:01.773921 30309 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 18 to 19, leader changed from 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.801178 30403 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:01.804580  4324 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:01.816267 31150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:12:01.842820 31150 raft_consensus.cc:606] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:12:01.854986 31150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:12:01.855784 31150 raft_consensus.cc:606] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:12:01.859263  4331 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:01.861174 30405 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:01.863040 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:12:01.868009 30403 raft_consensus.cc:606] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:12:01.866467 30560 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:01.871459 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868"
dest_uuid: "19556a24b91d452d98668a3709fbc29d"
mode: GRACEFUL
new_leader_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:38476
I20260709 13:12:01.872059 31146 raft_consensus.cc:606] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Received request to transfer leadership to TS 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:01.873493 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:01.875514 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:01.881417 30302 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.883348 31146 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:01.902272  4344 raft_consensus.cc:993] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:12:01.903559  4330 raft_consensus.cc:1081] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Signalling peer 0472fa7187444a91b443058ef89fceb9 to start an election
I20260709 13:12:01.910955 30560 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:12:01.917318  4081 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:01.920573  4262 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:12:01.942536 30405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
 from {username='slave'} at 127.0.0.1:53876
I20260709 13:12:01.943472 30405 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:01.945634 30405 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.966454  4262 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:01.969328  4262 tablet_bootstrap.cc:492] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:01.970161  4262 ts_tablet_manager.cc:1403] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.657s	user 0.069s	sys 0.023s
I20260709 13:12:01.991634 30405 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:01.994463  4329 raft_consensus.cc:993] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:01.996230  4329 raft_consensus.cc:1081] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:02.001399 30481 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:12:02.003491 30480 consensus_queue.cc:237] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.003491  4338 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:02.008913 31146 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:02.012573  4079 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:02.015782 30557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38014
I20260709 13:12:02.016611 30557 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.017066 30557 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:02.020694 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:02.021325 30479 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.024323 30405 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:02.028131 30376 consensus_peers.cc:597] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.033180  3999 raft_consensus.cc:993] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:02.033890  4330 raft_consensus.cc:1081] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:02.035458 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:02.036139 31150 raft_consensus.cc:3055] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:02.036423 31150 raft_consensus.cc:740] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:02.037222 31150 consensus_queue.cc:260] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.039628 30551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:12:02.040288 30551 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.040661 30551 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:02.038465 31150 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.046475 31147 raft_consensus.cc:1217] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:12:02.052294  4344 raft_consensus.cc:993] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:02.052857  4342 raft_consensus.cc:1081] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:02.055927 30555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:53492
I20260709 13:12:02.056654 30555 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.057062 30555 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:02.067864  4331 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:02.076486 31146 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:02.077809 30479 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:12:02.078873 30374 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:02.085865 30555 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.094448 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:02.095165 30480 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:02.095633  4262 raft_consensus.cc:359] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:02.096529  4262 raft_consensus.cc:740] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:02.091372 30555 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:02.097745 30403 raft_consensus.cc:1275] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:02.098820 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b91286dc8d477e8ebec973b266b7f0" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:02.099397 31147 raft_consensus.cc:3055] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:02.099658 31147 raft_consensus.cc:740] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:02.104811  4262 consensus_queue.cc:260] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:02.107430 31147 consensus_queue.cc:260] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.111346 31147 raft_consensus.cc:3060] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:02.121909 31150 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0472fa7187444a91b443058ef89fceb9 in term 11.
I20260709 13:12:02.126489 31147 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:12:02.127830  4210 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:02.131223  4209 consensus_queue.cc:1048] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:02.132359 30525 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:02.134325  4210 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Becoming Leader. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:12:02.135897  4210 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.148041 30557 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.149039 30303 catalog_manager.cc:5697] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 17 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:02.153344  4302 raft_consensus.cc:2804] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:02.156708  4302 raft_consensus.cc:697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:02.157569  4302 consensus_queue.cc:237] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.173983 30551 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.195883  4262 ts_tablet_manager.cc:1434] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.223s	user 0.004s	sys 0.003s
I20260709 13:12:02.198449 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-cc136e9e62d1428b88f928b6ccef8316 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:12:02.198534 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:02.198961 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-cc136e9e62d1428b88f928b6ccef8316 on tablet cc136e9e62d1428b88f928b6ccef8316 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:02.199263 30479 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:02.204927 30480 raft_consensus.cc:2468] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:12:02.214879 30551 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:02.219666 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1640dd5756f749fd8546ca110299cc59" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:02.220518 31150 raft_consensus.cc:3055] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:02.220883 31150 raft_consensus.cc:740] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:02.227126 30479 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:12:02.230862 31150 consensus_queue.cc:260] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.232473 30557 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:02.234620 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:02.235253 31147 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:02.247617 30523 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:02.254914 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3320ad6cc8ec4755a5fcf40ada291b5a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:12:02.255548 30402 raft_consensus.cc:3055] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:02.255879 30402 raft_consensus.cc:740] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:12:02.261883 31150 raft_consensus.cc:3060] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:02.248835  4291 raft_consensus.cc:2804] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:02.264148 31147 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:12:02.265739 30525 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:02.267681 30402 consensus_queue.cc:260] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.271409  4291 raft_consensus.cc:697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:02.272580  4228 raft_consensus.cc:2804] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:02.287585 30402 raft_consensus.cc:3060] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:02.296890 31150 raft_consensus.cc:2468] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:12:02.292012  4228 raft_consensus.cc:697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:02.302280 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d909a45f39c448af875585d7299103f6 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:02.301612 30403 raft_consensus.cc:2955] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:02.319566  4291 consensus_queue.cc:237] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.321920  4228 consensus_queue.cc:237] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:02.370939 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 47010.9us
W20260709 13:12:02.400956  4351 log.cc:927] Time spent T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:02.453644 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet d909a45f39c448af875585d7299103f6 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:37434
I20260709 13:12:02.460680 30402 raft_consensus.cc:2468] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:12:02.457595 30304 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: term changed from 10 to 11, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 0472fa7187444a91b443058ef89fceb9 (127.28.152.1). New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.468137 30303 catalog_manager.cc:5697] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 17 to 18, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 18 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.517036  4371 tablet_replica.cc:333] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:02.518334  4371 raft_consensus.cc:2243] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:02.526803  4371 raft_consensus.cc:2272] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:02.547251 31150 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Advancing to term 19
I20260709 13:12:02.567018 30303 catalog_manager.cc:5697] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 19 to 20, leader changed from 19556a24b91d452d98668a3709fbc29d (127.28.152.4) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 20 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.567751 30479 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:02.569109 30303 catalog_manager.cc:5697] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 16 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.577253  4371 ts_tablet_manager.cc:1916] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:02.579878  4332 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:02.632529  4371 ts_tablet_manager.cc:1929] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:12:02.633175  4371 log.cc:1199] T d909a45f39c448af875585d7299103f6 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/d909a45f39c448af875585d7299103f6
I20260709 13:12:02.634907 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet d909a45f39c448af875585d7299103f6 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:12:02.645952  4259 raft_consensus.cc:1064] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:02.648841  4259 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:02.724186 31147 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:02.725593  4332 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:02.740895 31146 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:02.743121  4364 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:02.761350 30481 raft_consensus.cc:1275] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:12:02.767902  4373 log.cc:927] Time spent T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:12:02.783120 31149 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:02.775193  4364 consensus_queue.cc:1048] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 13:12:02.834780 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 50779.6us
W20260709 13:12:02.838356  4374 log.cc:927] Time spent T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: Append to log took a long time: real 0.075s	user 0.004s	sys 0.001s
I20260709 13:12:02.856572  4361 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:02.874897 30411 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:02.875533 31146 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:02.876518 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.881224 30557 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:02.891757  4266 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:02.904390  4360 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:02.910353 31147 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:12:02.915292 30404 raft_consensus.cc:1275] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:02.927410  4365 consensus_queue.cc:1048] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:02.968788  4360 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:12:02.961369  4333 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
W20260709 13:12:03.055784 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 65794us
W20260709 13:12:03.222532 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 235820us
I20260709 13:12:03.277971 30480 raft_consensus.cc:1275] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:12:03.302314 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 144544us
I20260709 13:12:03.346355  4396 consensus_queue.cc:1048] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:12:03.400048 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 83605us
W20260709 13:12:03.425686 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 439460us
W20260709 13:12:03.484798 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 103226us
W20260709 13:12:03.524899 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 116612us
W20260709 13:12:03.543677 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 135880us
I20260709 13:12:03.566885  4331 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.591657 30555 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.630314  4081 raft_consensus.cc:1064] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:03.668258  4081 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:03.691377 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 72059.1us
I20260709 13:12:03.695397 30309 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.704610 31146 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.741961 30402 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.811022 30481 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:03.815418  4338 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:03.836313 31146 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 LEARNER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:03.847193 30555 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:03.858814  4081 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:12:03.867594  4338 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:03.873900 30481 consensus_queue.cc:237] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:03.885962 31146 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:03.886261 30555 raft_consensus.cc:1275] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:03.889875  4079 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:03.890951  4403 consensus_queue.cc:1048] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:03.919247  4331 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.921213 30557 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.924834 31146 raft_consensus.cc:2955] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.948575 30304 catalog_manager.cc:5697] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 12 to 13, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.957664 31147 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.955121  4338 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:03.998061 30401 tablet_service.cc:1558] Processing DeleteTablet for tablet 9005afb08e044cf08de618af26cfcf42 with delete_type TABLET_DATA_TOMBSTONED (TS 0472fa7187444a91b443058ef89fceb9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:50714
I20260709 13:12:04.020120 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9005afb08e044cf08de618af26cfcf42 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:04.038779 30303 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.049052  4424 tablet_replica.cc:333] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:04.050812  4424 raft_consensus.cc:2243] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:04.052341  4424 raft_consensus.cc:2272] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.057264 30555 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.080267 30479 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.114351  4424 ts_tablet_manager.cc:1916] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:04.150629 30402 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:04.163707 31146 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:04.172576  4081 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:12:04.189401 30481 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:04.188937  4081 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.191013  4414 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:04.193091  4424 ts_tablet_manager.cc:1929] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:12:04.200237  4424 log.cc:1199] T 9005afb08e044cf08de618af26cfcf42 P 0472fa7187444a91b443058ef89fceb9: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/wals/9005afb08e044cf08de618af26cfcf42
I20260709 13:12:04.202068 30294 catalog_manager.cc:5028] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): tablet 9005afb08e044cf08de618af26cfcf42 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:12:04.204900 30481 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.211448 31146 raft_consensus.cc:2955] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.261291 30303 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 13 to 14, VOTER 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3) evicted. New cstate: current_term: 19 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:04.286597 30294 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc136e9e62d1428b88f928b6ccef8316 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:04.298008 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet cc136e9e62d1428b88f928b6ccef8316 with delete_type TABLET_DATA_TOMBSTONED (TS 027e191e31da4af2bc83c5ddc0c15d05 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:37434
I20260709 13:12:04.376323  4425 tablet_replica.cc:333] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:04.382009  4425 raft_consensus.cc:2243] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:04.388499  4425 raft_consensus.cc:2272] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.416656 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:04.407663  4425 ts_tablet_manager.cc:1916] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:04.488348  4425 ts_tablet_manager.cc:1929] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:12:04.488950  4425 log.cc:1199] T cc136e9e62d1428b88f928b6ccef8316 P 027e191e31da4af2bc83c5ddc0c15d05: Deleting WAL directory at /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/wals/cc136e9e62d1428b88f928b6ccef8316
I20260709 13:12:04.490845 30295 catalog_manager.cc:5028] TS 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): tablet cc136e9e62d1428b88f928b6ccef8316 (table test-workload [id=9873667297e3409ebf7b87a04f44298c]) successfully deleted
I20260709 13:12:04.520306 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:12:04.520983 30402 raft_consensus.cc:606] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:12:04.523856 30402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3"
dest_uuid: "0472fa7187444a91b443058ef89fceb9"
mode: GRACEFUL
new_leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:42728
I20260709 13:12:04.524525 30402 raft_consensus.cc:606] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Received request to transfer leadership to TS 027e191e31da4af2bc83c5ddc0c15d05
I20260709 13:12:04.546994 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:04.548763 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:04.585099  4329 raft_consensus.cc:993] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:04.585750  4329 raft_consensus.cc:1081] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:04.588732 30555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38014
I20260709 13:12:04.589380 30555 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.589799 30555 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.602258 30555 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:04.639549 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:12:04.640175 30402 raft_consensus.cc:3055] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:04.640503 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:04.641120 31146 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.640506 30402 raft_consensus.cc:740] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:12:04.645227 30402 consensus_queue.cc:260] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:04.646359 30402 raft_consensus.cc:3060] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:04.665670 31146 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:12:04.668141 30525 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:04.669114  4389 raft_consensus.cc:2804] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:04.669652  4389 raft_consensus.cc:697] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:04.670568  4389 consensus_queue.cc:237] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:04.695518 30302 catalog_manager.cc:5697] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 12 to 13, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.666764 30555 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:04.706277 30402 raft_consensus.cc:2468] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:12:04.824044  4426 raft_consensus.cc:993] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:04.824674  4427 raft_consensus.cc:1081] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:04.826545 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38014
I20260709 13:12:04.827150 30558 raft_consensus.cc:493] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:04.827484 30558 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:04.836256 30558 raft_consensus.cc:515] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:04.839023 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0472fa7187444a91b443058ef89fceb9"
I20260709 13:12:04.839751 30402 raft_consensus.cc:3055] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:04.840066 30402 raft_consensus.cc:740] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0472fa7187444a91b443058ef89fceb9, State: Running, Role: LEADER
I20260709 13:12:04.840829 30402 consensus_queue.cc:260] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:04.841936 30402 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:04.843226 30558 leader_election.cc:290] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:04.844157 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b47e3764d6643f0a7629098b7f19d34" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:04.844753 30481 raft_consensus.cc:3060] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:04.856057 30481 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:12:04.865368 30402 raft_consensus.cc:2468] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 18.
I20260709 13:12:04.866858 30523 leader_election.cc:304] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:04.867656  4389 raft_consensus.cc:2804] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:04.868211  4389 raft_consensus.cc:697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:04.869083  4389 consensus_queue.cc:237] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:04.897681 30302 catalog_manager.cc:5697] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 17 to 18, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 18 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.101359 30402 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:05.103807  4429 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:05.282285 31146 raft_consensus.cc:1275] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:05.284298  4408 consensus_queue.cc:1048] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:05.425040 30402 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:05.428516  4408 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:05.435938 30477 raft_consensus.cc:1275] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:05.437409  4429 consensus_queue.cc:1048] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:12:05.453171  4434 log.cc:927] Time spent T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:05.457923 30406 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:05.551038 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:05.559883 30558 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:12:05.563292 30481 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:12:05.563690 30376 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed91464a4fda479c9d2d6dfa8ca92193. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.563702  4426 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:05.565078  4427 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:05.619396  4427 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:05.628154 30558 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:05.644815 30302 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 reported cstate change: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 20 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.647636 30402 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:05.647351 30477 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:05.670629 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
W20260709 13:12:05.744859 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49129.6us
W20260709 13:12:05.746910 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 59234us
I20260709 13:12:05.764457 30555 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:05.770408 30479 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Refusing update from remote peer 0472fa7187444a91b443058ef89fceb9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:12:05.779956 30376 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d72c167bcb8445c86bea233eccc0132. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.781900  4427 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:05.766127 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 78875.3us
W20260709 13:12:05.795984 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.797254  4427 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:05.799841 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.832674 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.843199 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.859720 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.870975 30450 consensus_peers.cc:597] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.871608 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.870710 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.872189 30450 consensus_peers.cc:597] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.872664  4426 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:12:05.879478 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.881313 30555 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:12:05.872747 30450 consensus_peers.cc:597] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.885221 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.887045 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 57151.9us
W20260709 13:12:05.889772 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.892225 30450 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:05.904546 31117 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:12:05.972015 30303 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 8, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 11 leader_uuid: "0472fa7187444a91b443058ef89fceb9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.028492 30477 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:06.038394 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 107845us
W20260709 13:12:06.042845 30374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 92538.2us
I20260709 13:12:06.048022 30485 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:12:06.066803 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 116158us
W20260709 13:12:06.096755 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.113365 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.116405 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.119354 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.126082 30451 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 290c8f7e148a4bd4b296c97e9c6552c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.127331 30558 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:12:06.131295  4462 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:12:06.134424 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.151000 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.151779 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.175442 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.177299 30450 consensus_peers.cc:597] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.182296 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.192925  4462 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.196195 30558 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.211063  4467 ts_tablet_manager.cc:933] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
W20260709 13:12:06.219997 30450 consensus_peers.cc:597] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.220710 30450 consensus_peers.cc:597] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.221449 30450 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.224850 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.235488  4467 tablet_copy_client.cc:323] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:12:06.237234 30477 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:06.241762 30303 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 12, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
W20260709 13:12:06.257205 30450 consensus_peers.cc:597] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.259893 30450 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.260833 30450 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.267171 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.268787 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.300824 30558 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:06.303296  4079 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:06.304177 30451 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb1e5995c7614e97bf058caeaa374e54. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:06.327145 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.333711 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.360646  4266 raft_consensus.cc:2955] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.367771 29280 tablet_replica.cc:333] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.369217 29280 raft_consensus.cc:2243] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.369959 29280 raft_consensus.cc:2272] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.370235 30558 raft_consensus.cc:2955] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.392138 29280 tablet_replica.cc:333] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.399837 29280 raft_consensus.cc:2243] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.401021 29280 raft_consensus.cc:2272] T b145c49726dc4998aea9471d4b0ca159 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.403640 29280 tablet_replica.cc:333] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.404430 29280 raft_consensus.cc:2243] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.404994 29280 raft_consensus.cc:2272] T c4b473589cd94be59022580022e2de00 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.433414 29280 tablet_replica.cc:333] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.434316 29280 raft_consensus.cc:2243] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.438464 30303 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index -1 to 11, NON_VOTER 19556a24b91d452d98668a3709fbc29d (127.28.152.4) added. New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } } }
I20260709 13:12:06.440457 29280 raft_consensus.cc:2272] T 2066b43938d64be7be50295fb7cf724a P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.453858 29280 tablet_replica.cc:333] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.449988  4472 ts_tablet_manager.cc:933] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
I20260709 13:12:06.457742 29280 raft_consensus.cc:2243] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.483541 29280 raft_consensus.cc:2272] T 8972e85ae0a345ccbcc03a1799a386c5 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.486027  4472 tablet_copy_client.cc:323] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.1:33099
I20260709 13:12:06.506321 29280 tablet_replica.cc:333] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.507284 29280 raft_consensus.cc:2243] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.509181 29280 raft_consensus.cc:2272] T 6b385b950a414bce8902269df58e5bf4 P 0472fa7187444a91b443058ef89fceb9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.518644 29280 tablet_replica.cc:333] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.519665 29280 raft_consensus.cc:2243] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.520336 29280 raft_consensus.cc:2272] T 8a7575b0e686483ca3a32ff9be16a338 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.523154 29280 tablet_replica.cc:333] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.523942 29280 raft_consensus.cc:2243] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.525300 29280 raft_consensus.cc:2272] T e16021f7db32485f8ce7b81d2cd291b8 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.536993 29280 tablet_replica.cc:333] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.537832 29280 raft_consensus.cc:2243] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.538479 29280 raft_consensus.cc:2272] T f2c4e8b43b5248a6b8811c7335522edb P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.547896  4427 raft_consensus.cc:493] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:06.548465  4427 raft_consensus.cc:515] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.551745 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.554365 29280 tablet_replica.cc:333] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.555369 29280 raft_consensus.cc:2243] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.555917 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32c699f55944c90a3ffe996af3951b7" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.556468 29280 raft_consensus.cc:2272] T 3d97aadeef4e4fb9b4f6d566a7908278 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.557633 30376 leader_election.cc:304] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.558545  4461 raft_consensus.cc:2749] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:06.559491 29280 tablet_replica.cc:333] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.572172 29280 raft_consensus.cc:2243] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.559517  4427 leader_election.cc:290] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.574944 29280 raft_consensus.cc:2272] T d0a59ccddffd4014bdeda9cac96154f7 P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.583449 29280 tablet_replica.cc:333] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.584206 29280 raft_consensus.cc:2243] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.584731 29280 raft_consensus.cc:2272] T ca06fa0758d044ec9b556e21520124e6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.590462  4465 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.591091  4465 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.594616 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.596886 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550a9c0ab10040efb87b80fce405535d" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.594525  4465 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.601162 29280 tablet_replica.cc:333] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.601085 30376 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.601974  4465 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.602146 29280 raft_consensus.cc:2243] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.603070 29280 raft_consensus.cc:2272] T d909a45f39c448af875585d7299103f6 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.641014 29280 tablet_replica.cc:333] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.645637 29280 raft_consensus.cc:2243] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.646610 29280 raft_consensus.cc:2272] T 0efe22046955442f80d17ac45b08253b P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.656965 29280 tablet_replica.cc:333] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.657753 29280 raft_consensus.cc:2243] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.658285 29280 raft_consensus.cc:2272] T 9632f38fdbf84c58a587a59a81f394ce P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.661048 29280 tablet_replica.cc:333] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.661732 29280 raft_consensus.cc:2243] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.663689 29280 raft_consensus.cc:2272] T 913c2d18b15848cd98ab0ff37874cc23 P 0472fa7187444a91b443058ef89fceb9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.676029 29280 tablet_replica.cc:333] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.685806 29280 raft_consensus.cc:2243] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.687013 29280 raft_consensus.cc:2272] T 93b081f573884221a895fd5d1acd47d4 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.689774 29280 tablet_replica.cc:333] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.690637 29280 raft_consensus.cc:2243] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.691782 29280 raft_consensus.cc:2272] T 0500eacf70c44cb5bb9527f23aea9b1d P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.704092  4465 raft_consensus.cc:493] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:12:06.704646  4465 raft_consensus.cc:515] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:06.706751  4465 leader_election.cc:290] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:06.708545 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.709146 29280 tablet_replica.cc:333] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.710088 29280 raft_consensus.cc:2243] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.711191 29280 raft_consensus.cc:2272] T 7244cfd402714902be2b9ef1ac7af65a P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.713974 29280 tablet_replica.cc:333] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.714931 29280 raft_consensus.cc:2243] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.715267 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f6773aa18b4ca9a0d9829e2021b82e" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:06.715580 29280 raft_consensus.cc:2272] T e6ff8d501cb144d0ba1527bbf7c10597 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.716912 30376 leader_election.cc:304] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.718336  4465 raft_consensus.cc:2749] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:06.722275  4465 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:06.723047 29280 tablet_replica.cc:333] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.722815  4465 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:06.724017 29280 raft_consensus.cc:2243] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.724723 29280 raft_consensus.cc:2272] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.727034 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.735148  4465 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:06.738047 29280 tablet_replica.cc:333] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.738869 29280 raft_consensus.cc:2243] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.739432 29280 raft_consensus.cc:2272] T b9205df4217c4ceca542cc35ed79d43e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.739327 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82023e2c5e484095a622dab241c66cd3" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:06.740913 30376 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:12:06.741535 30376 raft_consensus.cc:2686] T 82023e2c5e484095a622dab241c66cd3 P 0472fa7187444a91b443058ef89fceb9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:06.742403 29280 tablet_replica.cc:333] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.743400 29280 raft_consensus.cc:2243] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.744020 29280 raft_consensus.cc:2272] T 6b47e3764d6643f0a7629098b7f19d34 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.747642  4474 ts_tablet_manager.cc:933] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:06.750254 29280 tablet_replica.cc:333] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.755790 29280 raft_consensus.cc:2243] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.756938 29280 raft_consensus.cc:2272] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 0472fa7187444a91b443058ef89fceb9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.759168  4465 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.759712  4465 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.761919  4465 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.764875  4427 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.765380  4427 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.767102 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.768421 29280 tablet_replica.cc:333] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.772377 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1e11d913434fda8959a45d48772c1f" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.773757  4474 tablet_copy_client.cc:323] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:12:06.775278 29280 raft_consensus.cc:2243] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.775925 29280 raft_consensus.cc:2272] T 1f911d757027485a941dce045769b0fe P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.777410 30374 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.778736  4461 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:06.779413  4461 raft_consensus.cc:493] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:06.779902  4461 raft_consensus.cc:515] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.780970 29280 tablet_replica.cc:333] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.790663  4427 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.791510 29280 raft_consensus.cc:2243] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.793694 29280 raft_consensus.cc:2272] T ed91464a4fda479c9d2d6dfa8ca92193 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.793810 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.795377 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.789530 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb15b3fc088e4285aec0576f22ecb481" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.792150 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.796624 29280 tablet_replica.cc:333] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.797608 29280 raft_consensus.cc:2243] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.798629 29280 raft_consensus.cc:2272] T 370c7d03a9fc4d11a8594e49e0b79a64 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.799145 30376 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.800328 30376 leader_election.cc:304] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.801033  4465 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.805438  4465 raft_consensus.cc:2749] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:06.801348 29280 tablet_replica.cc:333] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.801447  4427 raft_consensus.cc:493] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 19556a24b91d452d98668a3709fbc29d)
I20260709 13:12:06.806223  4427 raft_consensus.cc:515] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:06.802546 30495 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 290c8f7e148a4bd4b296c97e9c6552c4 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:12:06.807224 30495 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 290c8f7e148a4bd4b296c97e9c6552c4 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-290c8f7e148a4bd4b296c97e9c6552c4
I20260709 13:12:06.782158  4461 leader_election.cc:290] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.820430  4427 leader_election.cc:290] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:06.827250 30495 tablet_copy_source_session.cc:215] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.832368  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290c8f7e148a4bd4b296c97e9c6552c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.828635 29280 raft_consensus.cc:2243] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.856081 29280 raft_consensus.cc:2272] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.861039 29280 tablet_replica.cc:333] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.862005 29280 raft_consensus.cc:2243] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:06.862289 30376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 57222us
I20260709 13:12:06.862612 29280 raft_consensus.cc:2272] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.863745 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.866328  4465 raft_consensus.cc:493] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:06.866855  4465 raft_consensus.cc:515] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.868870  4465 leader_election.cc:290] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.869091 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df93ef89d784f0bab73ca5a5d399cc0" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:06.869925  4427 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.870460  4427 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.870743 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.871716  4477 ts_tablet_manager.cc:933] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:06.872592  4427 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.874794 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcc5b6fd8a4ea992fa104050ad1a12" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.875911 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.880937 30376 leader_election.cc:304] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.883725  4461 raft_consensus.cc:2749] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:06.886562  4477 tablet_copy_client.cc:323] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:12:06.887274 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.888057 30376 leader_election.cc:304] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d
W20260709 13:12:06.888732 30376 raft_consensus.cc:2686] T 7df93ef89d784f0bab73ca5a5d399cc0 P 0472fa7187444a91b443058ef89fceb9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:06.889319 29280 tablet_replica.cc:333] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.889915 30495 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet eb1e5995c7614e97bf058caeaa374e54 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:12:06.898619 30495 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet eb1e5995c7614e97bf058caeaa374e54 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-eb1e5995c7614e97bf058caeaa374e54
I20260709 13:12:06.910161 30376 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.911002  4465 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:06.912284  4465 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.912771  4465 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.914005 29280 raft_consensus.cc:2243] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.917107 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:06.915401  4465 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:06.919214 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3cb6475718492e846dc8fdd3f4e538" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:06.923009 29280 raft_consensus.cc:2272] T cc136e9e62d1428b88f928b6ccef8316 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.923781 30376 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:06.926252  4465 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:06.927368 30495 tablet_copy_source_session.cc:215] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:06.932015  4474 tablet_copy_client.cc:806] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:06.932698  4474 tablet_copy_client.cc:670] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:06.930472 29280 tablet_replica.cc:333] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.935060 29280 raft_consensus.cc:2243] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.935127  4477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1e5995c7614e97bf058caeaa374e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.939314  4474 tablet_copy_client.cc:538] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:06.944017 29280 raft_consensus.cc:2272] T d34313dd02b6470d81b73b13d5cf157f P 0472fa7187444a91b443058ef89fceb9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.950079 29280 tablet_replica.cc:333] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:06.952334  4465 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:06.952924  4465 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:06.992000 29280 raft_consensus.cc:2243] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.992823 29280 raft_consensus.cc:2272] T 290c8f7e148a4bd4b296c97e9c6552c4 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.003401 29280 tablet_replica.cc:333] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.004307 29280 raft_consensus.cc:2243] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.004832 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:07.005344 29280 raft_consensus.cc:2272] T 406b169640e341629c55637d07dd3d47 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.007416  4465 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.008397 29280 tablet_replica.cc:333] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.009364 29280 raft_consensus.cc:2243] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.010358 29280 raft_consensus.cc:2272] T 5f0025bdb2b44775bcdb4ec9702926aa P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.014426  4477 tablet_copy_client.cc:806] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:07.017779 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788d95f5ce114732b7f934005a3580e2" candidate_uuid: "0472fa7187444a91b443058ef89fceb9" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.020455 29280 tablet_replica.cc:333] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.029798 29280 raft_consensus.cc:2243] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.030541 29280 raft_consensus.cc:2272] T 3320ad6cc8ec4755a5fcf40ada291b5a P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.031235 30374 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0472fa7187444a91b443058ef89fceb9; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:07.034942  4465 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:07.032104  4474 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:12:07.038278 29280 tablet_replica.cc:333] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.039235 29280 raft_consensus.cc:2243] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.034219  4477 tablet_copy_client.cc:670] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:07.040158 29280 raft_consensus.cc:2272] T eb1e5995c7614e97bf058caeaa374e54 P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.043155  4477 tablet_copy_client.cc:538] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:07.046476 29280 tablet_replica.cc:333] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.047783 29280 raft_consensus.cc:2243] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.048508 29280 raft_consensus.cc:2272] T cb15b3fc088e4285aec0576f22ecb481 P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.051810 29280 tablet_replica.cc:333] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.053606 29280 raft_consensus.cc:2243] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.056882 29280 raft_consensus.cc:2272] T e809575d6fe84ef3afe48c9cf7532868 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.059749 29280 tablet_replica.cc:333] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.060525 29280 raft_consensus.cc:2243] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.061209 29280 raft_consensus.cc:2272] T 0d1e11d913434fda8959a45d48772c1f P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.064481  4477 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:12:07.071738 29280 tablet_replica.cc:333] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.072705 29280 raft_consensus.cc:2243] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.074013 29280 raft_consensus.cc:2272] T 3d72c167bcb8445c86bea233eccc0132 P 0472fa7187444a91b443058ef89fceb9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.076857 29280 tablet_replica.cc:333] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.078052 29280 raft_consensus.cc:2243] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.085103 29280 raft_consensus.cc:2272] T e4f6773aa18b4ca9a0d9829e2021b82e P 0472fa7187444a91b443058ef89fceb9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.088625 29280 tablet_replica.cc:333] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.089439 29280 raft_consensus.cc:2243] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.090065 29280 raft_consensus.cc:2272] T fadcc5b6fd8a4ea992fa104050ad1a12 P 0472fa7187444a91b443058ef89fceb9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.092710 29280 tablet_replica.cc:333] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.093523 29280 raft_consensus.cc:2243] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.094225 29280 raft_consensus.cc:2272] T 2c7503235ec641f7b8929ebbf8124038 P 0472fa7187444a91b443058ef89fceb9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.106807 29280 tablet_replica.cc:333] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.107582 29280 raft_consensus.cc:2243] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.108289 29280 raft_consensus.cc:2272] T 3e3cb6475718492e846dc8fdd3f4e538 P 0472fa7187444a91b443058ef89fceb9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.111557 29280 tablet_replica.cc:333] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.112349 29280 raft_consensus.cc:2243] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.112990 29280 raft_consensus.cc:2272] T 550a9c0ab10040efb87b80fce405535d P 0472fa7187444a91b443058ef89fceb9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.115856 29280 tablet_replica.cc:333] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.116585 29280 raft_consensus.cc:2243] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.120927 29280 raft_consensus.cc:2272] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.123741 30375 raft_consensus.cc:687] T 497264cf15754f0e9029cd057a54a7fb P 0472fa7187444a91b443058ef89fceb9: failed to submit failure detected task: Service unavailable: Thread pool token was shut down
I20260709 13:12:07.159142 29280 tablet_replica.cc:333] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.164849 29280 raft_consensus.cc:2243] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.171135 29280 raft_consensus.cc:2272] T b32c699f55944c90a3ffe996af3951b7 P 0472fa7187444a91b443058ef89fceb9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.197417 29280 tablet_replica.cc:333] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9: stopping tablet replica
I20260709 13:12:07.198160 29280 raft_consensus.cc:2243] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.198729 29280 raft_consensus.cc:2272] T 788d95f5ce114732b7f934005a3580e2 P 0472fa7187444a91b443058ef89fceb9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.224759  4474 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:07.225885  4474 tablet_bootstrap.cc:492] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:07.227787  4474 ts_tablet_manager.cc:1403] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.196s	user 0.042s	sys 0.014s
W20260709 13:12:07.246241 30376 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.248700  4474 raft_consensus.cc:359] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:07.249660  4474 raft_consensus.cc:740] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:07.250329  4474 consensus_queue.cc:260] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:07.261078  4474 ts_tablet_manager.cc:1434] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:12:07.270239  4477 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:07.271931 30495 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-290c8f7e148a4bd4b296c97e9c6552c4 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:12:07.272464 30495 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-290c8f7e148a4bd4b296c97e9c6552c4 on tablet 290c8f7e148a4bd4b296c97e9c6552c4 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:07.274343  4477 tablet_bootstrap.cc:492] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:07.275197  4477 ts_tablet_manager.cc:1403] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.211s	user 0.044s	sys 0.024s
I20260709 13:12:07.287765  4477 raft_consensus.cc:359] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:07.288678  4477 raft_consensus.cc:740] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:07.289351  4477 consensus_queue.cc:260] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:07.300465  4477 ts_tablet_manager.cc:1434] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:12:07.324523 30495 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-eb1e5995c7614e97bf058caeaa374e54 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:12:07.325063 30495 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-eb1e5995c7614e97bf058caeaa374e54 on tablet eb1e5995c7614e97bf058caeaa374e54 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:07.340447 31146 raft_consensus.cc:1217] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
W20260709 13:12:07.370540 30375 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.552238 31146 raft_consensus.cc:1217] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:12:07.624018  4455 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.624645  4455 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.627936 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
W20260709 13:12:07.635704 30450 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:07.636185 30450 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.637086  4266 raft_consensus.cc:2749] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:07.637915  4455 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.660670  4455 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.661339  4455 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.665138 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:07.670835  4408 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.671432  4408 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.685024 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.685905 30484 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:12:07.673813  4408 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.689141 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:07.687155  4463 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.689994  4408 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:07.690431  4408 raft_consensus.cc:493] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.690284  4463 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.690879  4408 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:07.692634  4463 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.682911  4455 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.694593 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.695493 30484 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:12:07.695866  4266 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.696352  4266 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.696677 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:07.699014  4266 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.700304  4463 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:07.700691  4463 raft_consensus.cc:493] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.701061  4463 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:07.701227 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:07.705721  4451 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.706280  4451 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.710846  4451 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.711023 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:12:07.707242 30524 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:07.723284 30524 leader_election.cc:336] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.727437  4458 raft_consensus.cc:1064] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:07.730046  4408 raft_consensus.cc:515] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.730242  4458 consensus_queue.cc:237] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.733343 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b145c49726dc4998aea9471d4b0ca159" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:07.733976 30484 raft_consensus.cc:3060] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:07.734084 30450 connection.cc:573] client connection to 127.28.152.1:33099 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:12:07.734999  4463 raft_consensus.cc:515] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.738571  4455 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.738744 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2066b43938d64be7be50295fb7cf724a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:07.739396 30485 raft_consensus.cc:3060] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:07.739326  4455 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:07.741740  4455 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.742781  4408 leader_election.cc:290] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.742921 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:07.744032 30484 raft_consensus.cc:2468] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
I20260709 13:12:07.745558 30485 raft_consensus.cc:2468] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
W20260709 13:12:07.747987 30524 leader_election.cc:336] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.749229  4463 leader_election.cc:290] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:07.755553 30524 leader_election.cc:336] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.756191 30523 leader_election.cc:304] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.773872  4408 raft_consensus.cc:2804] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:07.785238 31146 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:07.786978  4463 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.787563  4463 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.790520 30523 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.806770  4463 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.807382  4463 raft_consensus.cc:2804] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:07.807839  4463 raft_consensus.cc:697] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:07.808634  4463 consensus_queue.cc:237] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:07.810051 30450 leader_election.cc:336] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.810556 30450 leader_election.cc:304] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.807395  4470 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:12:07.813189 30450 leader_election.cc:336] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.814023 30450 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.814495  4451 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.803823  4462 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:12:07.815229  4455 raft_consensus.cc:2749] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:07.831517  4491 raft_consensus.cc:2749] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:07.813937  4470 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.839995  4266 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.840615  4266 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.831729  4487 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:12:07.849715 31117 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.852176  4266 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:07.829258  4451 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.850227 31117 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:07.873720  4458 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.874529  4458 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:07.878896  4408 raft_consensus.cc:697] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:07.889839  4408 consensus_queue.cc:237] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.855123  4487 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.900874  4266 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.903069 30551 raft_consensus.cc:1275] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:07.901386  4266 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:07.906951 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.907557 30485 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 16.
I20260709 13:12:07.919378  4458 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:07.921268 30450 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.921748 30450 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:07.924239  4266 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.924846  4266 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:07.897627  4490 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:07.934274  4487 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.937386  4451 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:07.939023 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.939666 30485 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 22.
I20260709 13:12:07.940816 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:07.945713 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:07.947177 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:07.947789 30558 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:12:07.952479 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:07.953714 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:07.954355 31146 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:12:07.957617  4470 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:07.944487  4467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43920 (request call id 1020) took 1769 ms. Trace:
I20260709 13:12:07.955091 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:07.951619  4490 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:07.967061 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:07.946542  4462 consensus_queue.cc:1048] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:12:07.966539  4458 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:07.959051  4489 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:07.981855 30524 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:07.974349 31117 leader_election.cc:336] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:07.991416 31117 leader_election.cc:336] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:07.966013  4490 raft_consensus.cc:493] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.996198  4490 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:07.960631  4467 rpcz_store.cc:276] 0709 13:12:06.169970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.170141 (+   171us) service_pool.cc:224] Handling call
0709 13:12:06.214248 (+ 44107us) ts_tablet_manager.cc:934] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
0709 13:12:07.938995 (+1724747us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":535,"tablet-copy.queue_time_us":40325,"thread_start_us":63365,"threads_started":2}
I20260709 13:12:07.991614  4458 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:07.999161  4458 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:07.991308  4489 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.000658  4489 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:08.008351 31116 connection.cc:466] server connection from 127.0.0.1:43920 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43920 (request call id 1020) could send its response
I20260709 13:12:08.027314  4472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43920 (request call id 1026) took 1612 ms. Trace:
I20260709 13:12:08.027788  4472 rpcz_store.cc:276] 0709 13:12:06.414911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.415064 (+   153us) service_pool.cc:224] Handling call
0709 13:12:06.456837 (+ 41773us) ts_tablet_manager.cc:934] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099)
0709 13:12:08.027247 (+1570410us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":256,"tablet-copy.queue_time_us":34308,"thread_start_us":44476,"threads_started":2}
I20260709 13:12:08.035006  4458 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.037322  4458 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:08.040781 31116 connection.cc:466] server connection from 127.0.0.1:43920 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43920 (request call id 1026) could send its response
I20260709 13:12:08.050472  4493 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.051122  4493 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.051262 30303 catalog_manager.cc:5697] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.053371  4493 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:08.059602 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.060259 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 112240us
W20260709 13:12:08.060983 30450 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.061561 30450 leader_election.cc:336] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.065061  4494 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.065698  4494 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.068226  4494 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:08.072114 30524 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.072587  4497 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.072614 30524 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:08.073226  4497 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:08.074117 30450 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.072139  4455 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.076854  4455 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:08.079218 30524 leader_election.cc:336] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.079386 30450 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.079936 30450 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.080499  4455 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:08.080541  4463 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:08.088357  4492 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.088948  4492 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:08.091250  4492 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:08.098269 31118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 130210us
I20260709 13:12:08.098173  4458 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.107683  4497 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:08.121290 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.106137  4458 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.123443  4489 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.125680  4489 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.126632  4458 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:08.127553 30524 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.102497  4490 raft_consensus.cc:515] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.143513 31146 raft_consensus.cc:2393] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 23: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:12:08.145848 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:08.145973 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:12:08.146979 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 49137.9us
I20260709 13:12:08.149276  4490 leader_election.cc:290] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.150350 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b385b950a414bce8902269df58e5bf4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:08.150935 30479 raft_consensus.cc:3060] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:08.152884  4458 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:08.153311  4458 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.153669  4458 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:08.156334  4451 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.156873  4451 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.157418 30479 raft_consensus.cc:2468] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 23.
I20260709 13:12:08.146610 30551 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 17.
I20260709 13:12:08.158784 31116 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:08.158963  4451 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.160013  4490 raft_consensus.cc:2804] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:12:08.160236 31117 leader_election.cc:336] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.160549  4490 raft_consensus.cc:697] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:08.161527  4490 consensus_queue.cc:237] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.147190  4489 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.163185  4489 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.165374  4489 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.165664 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
W20260709 13:12:08.167984 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.168555 31117 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.168955 31117 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:08.170109  4451 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:08.171717 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:08.172446 30558 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 17: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:12:08.172673  4458 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.175118 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:08.175715 30558 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 19.
I20260709 13:12:08.178231 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:08.178828 30551 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
W20260709 13:12:08.178984 30524 leader_election.cc:336] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.183858 30450 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.194334 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0500eacf70c44cb5bb9527f23aea9b1d" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:08.194953 31149 raft_consensus.cc:3060] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:08.197111 30451 leader_election.cc:304] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:08.195796 31118 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.176290  4458 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:08.208999 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.209667 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 19.
I20260709 13:12:08.211597 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.212220 30484 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:12:08.214773 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:08.215497 30479 raft_consensus.cc:2393] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 17: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
I20260709 13:12:08.215374 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.217327 31149 raft_consensus.cc:2468] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 21.
I20260709 13:12:08.217396 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:08.218119 30551 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 14.
I20260709 13:12:08.219528 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.220151 30484 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 17.
I20260709 13:12:08.219641 30304 catalog_manager.cc:5697] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 22 to 23, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 23 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:08.221123 30450 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.221354  4266 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:12:08.221647 30450 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.222723  4500 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:08.223155  4500 raft_consensus.cc:493] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.223515  4500 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:08.226202 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.228456  4507 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:08.228837  4507 raft_consensus.cc:493] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.229194  4507 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:08.232121 30524 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.232185  4494 raft_consensus.cc:1064] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:08.237041  4494 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.202664  4455 raft_consensus.cc:2749] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:08.249078 30524 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.249478 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.250465  4495 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:08.250917  4495 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.251329  4495 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:08.254987 30450 consensus_peers.cc:597] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.256959 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.255685 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.258203  4489 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:08.258630  4489 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.259059  4489 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:08.266600 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.266664 30523 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:08.267726 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.269480 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.270759  4493 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:08.274598  4508 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:08.275195  4508 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.275640  4508 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:08.276417  4462 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:08.276919  4462 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.277377  4462 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:08.307942  4488 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.308579  4488 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.310848  4506 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.311614 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.311393  4506 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.314203  4488 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.314253  4266 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:08.315451  4266 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.315783  4266 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:08.315934 30524 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.317845 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.319973 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.320120  4458 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.320668  4458 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.321395  4506 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.324129  4507 raft_consensus.cc:515] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.326206  4507 leader_election.cc:290] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:08.326629 31117 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.328773  4266 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.329089 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:08.329054 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:08.330406 31117 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.330875  4506 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:08.331403 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e16021f7db32485f8ce7b81d2cd291b8" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:08.331589 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:08.331967 30479 raft_consensus.cc:3060] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:08.332237  4506 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:08.333144 30450 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.333614  4489 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:08.337023  4489 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.326540  4458 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:08.339453 30479 raft_consensus.cc:2468] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 20.
I20260709 13:12:08.342914  4500 raft_consensus.cc:515] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:08.343348 30450 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.349627  4462 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:08.351888 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.339612 30524 leader_election.cc:336] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.359359 30450 consensus_peers.cc:597] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.365480 30450 consensus_peers.cc:597] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.368256  4266 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:08.371901 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed91464a4fda479c9d2d6dfa8ca92193" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:08.372711 30479 raft_consensus.cc:3060] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:08.372808 30524 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.373708 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.374514 30450 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.380168  4495 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.383854 30451 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.386430 30523 leader_election.cc:304] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.387497 30484 raft_consensus.cc:1275] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:08.388475  4266 raft_consensus.cc:2804] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:08.389143  4266 raft_consensus.cc:697] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 21 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:08.389889  4497 raft_consensus.cc:2804] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:08.389761 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:08.390465 31146 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 19.
I20260709 13:12:08.390390  4497 raft_consensus.cc:697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:08.392870  4497 consensus_queue.cc:237] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.393106  4493 consensus_queue.cc:1048] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:08.395334 30450 consensus_peers.cc:597] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.397102 31149 raft_consensus.cc:2393] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 18: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:12:08.398067 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b081f573884221a895fd5d1acd47d4" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:08.398591 30558 raft_consensus.cc:3060] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:08.401461 30525 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:08.402595  4493 raft_consensus.cc:3060] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:08.395531  4266 consensus_queue.cc:237] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:08.407100 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.406571 30558 raft_consensus.cc:2468] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:12:08.420725 30479 raft_consensus.cc:2468] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 21.
I20260709 13:12:08.429347 30523 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.387457  4508 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:08.427984  4507 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.430284  4455 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.445065 30484 raft_consensus.cc:1275] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:08.433146  4492 raft_consensus.cc:2804] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:08.451690  4500 leader_election.cc:290] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:08.457767 31117 leader_election.cc:336] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.436113  4507 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:08.461053  4455 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.462651  4507 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.463716  4492 raft_consensus.cc:697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:08.463472  4462 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:08.464795  4492 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:08.463277  4455 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:08.469138  4455 raft_consensus.cc:2955] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:08.471571 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.472265 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.476642 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81" is_pre_election: true
I20260709 13:12:08.477126  4489 consensus_queue.cc:1048] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:08.477962 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d97aadeef4e4fb9b4f6d566a7908278" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:08.478600  4508 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:08.479928  4495 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:08.481408 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
W20260709 13:12:08.485977 30524 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.495344 30484 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 18: Already voted for candidate ce312b0d7a1747c8898a748f8d76df81 in this term.
W20260709 13:12:08.501680 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 73441.5us
I20260709 13:12:08.505215 30451 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.509747 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:08.510637 30555 raft_consensus.cc:2393] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ce312b0d7a1747c8898a748f8d76df81 in current term 18: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:12:08.511140 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:08.511842 31147 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
I20260709 13:12:08.512609 31146 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 LEARNER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:08.515309 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7244cfd402714902be2b9ef1ac7af65a" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:08.516018 30551 raft_consensus.cc:3060] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:08.517804 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:12:08.520053 30524 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.518472  4516 raft_consensus.cc:2804] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:08.523732 30524 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:08.511355  4493 raft_consensus.cc:2749] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:08.544687 30551 raft_consensus.cc:2468] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
I20260709 13:12:08.559283  4497 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:08.539235  4462 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:08.574010  4462 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.574558  4462 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:08.535530  4516 raft_consensus.cc:697] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:08.563704 30558 raft_consensus.cc:2468] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
I20260709 13:12:08.583647  4516 consensus_queue.cc:237] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:08.588138 30450 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.593163 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.594352 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.597308 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.545964  4495 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
W20260709 13:12:08.600247 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.600793 30450 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.601333 30450 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:08.601794 30450 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.602196 30450 consensus_peers.cc:597] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.602563 30450 consensus_peers.cc:597] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.598973  4495 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:08.614548 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 79234.9us
I20260709 13:12:08.612208 31118 leader_election.cc:304] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.620121  4501 raft_consensus.cc:2804] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:08.620808  4501 raft_consensus.cc:697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:08.627753 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.621912  4501 consensus_queue.cc:237] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.675851 31146 raft_consensus.cc:2955] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:08.660300  4522 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:08.673484 30551 raft_consensus.cc:2955] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:08.715050  4266 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:08.687789  4522 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.717556 30302 catalog_manager.cc:5697] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 20 to 21, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 21 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.726341  4522 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.731541 30481 raft_consensus.cc:1275] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 23 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:12:08.739848  4451 consensus_queue.cc:1048] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:08.786345 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce312b0d7a1747c8898a748f8d76df81; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.731304  4520 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:08.833751  4495 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:08.843657  4522 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.803967  4520 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.879621  4520 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:08.854548 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 334516us
W20260709 13:12:08.886992 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.887545 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.880347 30303 catalog_manager.cc:5697] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 17 to 18, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 18 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.842058  4462 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:08.890059  4462 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:08.888145 30524 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.890869 30524 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:08.891983 30303 catalog_manager.cc:5697] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 11 to 12, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:08.898147 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.898607 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 68012.8us
I20260709 13:12:08.902619  4408 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:12:08.905658 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:08.906181 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.907934  4522 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:08.910390  4495 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:12:08.910526 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 124273us
I20260709 13:12:08.911532 30451 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:08.912348  4519 raft_consensus.cc:2804] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:08.912876  4519 raft_consensus.cc:697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:08.913722  4519 consensus_queue.cc:237] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:08.918054 30450 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.920506 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:08.921149 31146 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 15.
I20260709 13:12:08.923945 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc136e9e62d1428b88f928b6ccef8316" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:08.924461 31146 raft_consensus.cc:3060] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:08.925664 30450 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.935348 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e809575d6fe84ef3afe48c9cf7532868" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:08.936108 31147 raft_consensus.cc:3060] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.939442 31146 raft_consensus.cc:2468] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 20.
W20260709 13:12:08.951886 30450 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:08.958462 30557 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:08.953181 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:08.960039 30551 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 11.
W20260709 13:12:08.957443 30450 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.969070 31147 raft_consensus.cc:2468] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:12:08.978178 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:09.000839 30451 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:09.001814  4532 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:09.002317  4532 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:09.002753  4532 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:09.004431  4522 raft_consensus.cc:2804] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:09.004951  4522 raft_consensus.cc:697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:09.005734  4522 consensus_queue.cc:237] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:09.008442 30450 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:09.009318 30450 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:09.013393 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.015905 29280 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30432)
I20260709 13:12:09.019299 30451 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:09.020567  4530 raft_consensus.cc:2804] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:09.021113  4530 raft_consensus.cc:697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:09.021880  4530 consensus_queue.cc:237] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:09.035198 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.037535 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.038627 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.045578 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:09.057600 31149 raft_consensus.cc:1275] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:12:09.054780  4516 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:09.062630  4528 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:12:09.074900 30303 catalog_manager.cc:5697] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 19 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 20 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.076884 30303 catalog_manager.cc:5697] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 16 to 17, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 17 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.078567 30303 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 20 to 21, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 21 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.066166  4516 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0472fa7187444a91b443058ef89fceb9)
I20260709 13:12:09.084086  4516 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:09.090024 30524 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.093519  4518 consensus_queue.cc:1048] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:12:09.145088 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 51764.7us
I20260709 13:12:09.151696  4516 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
W20260709 13:12:09.156356 30524 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:09.164302 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 75254.6us
W20260709 13:12:09.165952 30450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 66972.7us
W20260709 13:12:09.166611 30450 consensus_peers.cc:597] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.167101 30450 consensus_peers.cc:597] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.203874  4516 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:09.204819 30482 raft_consensus.cc:1275] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:09.205582 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:09.206200 30557 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.217623  4532 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:09.220681 30557 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 12.
I20260709 13:12:09.227149 30451 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:09.246842  4458 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:09.247408  4458 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:09.248380  4458 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:09.251159  4463 consensus_queue.cc:1048] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:09.265223 30450 consensus_peers.cc:597] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:09.265724 30450 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:09.267495 30551 raft_consensus.cc:1275] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer 19556a24b91d452d98668a3709fbc29d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:12:09.267522 30557 raft_consensus.cc:1275] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:09.278914  4550 consensus_queue.cc:1048] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:09.277412  4518 consensus_queue.cc:1048] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:12:09.287819 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 111712us
I20260709 13:12:09.290125  4532 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:09.307572 30525 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed91464a4fda479c9d2d6dfa8ca92193. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.320107 30482 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:12:09.324076 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 46352.2us
W20260709 13:12:09.338568 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:09.395011 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 73303.1us
I20260709 13:12:09.395246  4489 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:09.403936  4462 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:09.409994 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0025bdb2b44775bcdb4ec9702926aa" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:09.410581 31149 raft_consensus.cc:3060] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:09.416651 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47318.5us
I20260709 13:12:09.431731 31146 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:09.433336 31149 raft_consensus.cc:2468] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 16.
I20260709 13:12:09.446524 30557 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:09.461156 30451 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81; no voters: 
I20260709 13:12:09.463083  4458 raft_consensus.cc:2804] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:09.466650  4458 raft_consensus.cc:697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
W20260709 13:12:09.466795 30450 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:09.467679  4458 consensus_queue.cc:237] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:09.503021 30558 raft_consensus.cc:1275] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:12:09.555527 30451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:43783, user_credentials={real_user=slave}} blocked reactor thread for 65289.9us
I20260709 13:12:09.569587 30303 catalog_manager.cc:5697] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 15 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } }
I20260709 13:12:09.644794  4518 consensus_queue.cc:1048] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:09.656904 30450 consensus_peers.cc:597] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.662988 31149 raft_consensus.cc:1275] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:09.681330 31146 raft_consensus.cc:1275] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:12:09.684315 30450 consensus_peers.cc:597] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.665570 30302 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 11 to 12, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.692618 30302 catalog_manager.cc:5697] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 11 to 12, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 12 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.707088  4530 consensus_queue.cc:1048] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:09.694711 30450 consensus_peers.cc:597] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:09.765873 30450 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.776392  4527 consensus_queue.cc:1048] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:09.778254 30302 catalog_manager.cc:5697] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 19 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 20 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.780802  4562 ts_tablet_manager.cc:933] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:09.784015 30451 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d72c167bcb8445c86bea233eccc0132. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.792611 30558 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:09.813781  4530 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:09.801501 30302 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: config changed from index 12 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.816823 30302 catalog_manager.cc:5697] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 19 to 20, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 20 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.842800  4562 tablet_copy_client.cc:323] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.3:43783
I20260709 13:12:09.859273 30570 tablet_copy_service.cc:140] P 027e191e31da4af2bc83c5ddc0c15d05: Received BeginTabletCopySession request for tablet ed91464a4fda479c9d2d6dfa8ca92193 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:53492)
I20260709 13:12:09.860028 30570 tablet_copy_service.cc:161] P 027e191e31da4af2bc83c5ddc0c15d05: Beginning new tablet copy session on tablet ed91464a4fda479c9d2d6dfa8ca92193 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:53492: session id = 19556a24b91d452d98668a3709fbc29d-ed91464a4fda479c9d2d6dfa8ca92193
I20260709 13:12:09.919845 30570 tablet_copy_source_session.cc:215] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:09.931404  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed91464a4fda479c9d2d6dfa8ca92193. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:09.990569 30450 consensus_peers.cc:597] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.989035 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38756
I20260709 13:12:09.995771 30479 raft_consensus.cc:606] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:12:09.995421 30482 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:10.004760 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38756
I20260709 13:12:10.005337 30479 raft_consensus.cc:606] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:12:10.015934  4562 tablet_copy_client.cc:806] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
W20260709 13:12:10.016669 29280 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30432)
I20260709 13:12:10.035007  4562 tablet_copy_client.cc:670] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:10.039256 30481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132"
dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38756
I20260709 13:12:10.039896 30481 raft_consensus.cc:606] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:12:10.039420  4562 tablet_copy_client.cc:538] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.048280 31146 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:10.051375  4562 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
I20260709 13:12:10.062139 31146 raft_consensus.cc:1275] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:10.067034  4522 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:10.067334  4495 consensus_queue.cc:1048] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:10.076404 30357 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:12:10.076910 30357 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3d72c167bcb8445c86bea233eccc0132 already in progress
W20260709 13:12:10.077216 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3d72c167bcb8445c86bea233eccc0132 already in progress
I20260709 13:12:10.095818 30558 raft_consensus.cc:1275] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:10.097764 30302 catalog_manager.cc:5697] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 15 to 16, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 16 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.124518  4529 consensus_queue.cc:1048] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:10.192570  4529 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:10.215466 31148 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:10.284535 30293 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 290c8f7e148a4bd4b296c97e9c6552c4 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:10.296636 30551 raft_consensus.cc:2955] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:10.328374  4530 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.328976  4530 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:10.331167  4530 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:10.340706 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:10.341539 30555 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 17.
W20260709 13:12:10.341585 30450 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:10.343688 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:10.343910  4530 raft_consensus.cc:993] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: : Instructing follower 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:10.344457  4530 raft_consensus.cc:1081] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Signalling peer 027e191e31da4af2bc83c5ddc0c15d05 to start an election
I20260709 13:12:10.345913  4527 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:10.346346  4527 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.346673  4527 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:10.349566 30302 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 13 to 14, VOTER 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) evicted. New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:10.377003 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132"
dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
 from {username='slave'} at 127.0.0.1:38000
I20260709 13:12:10.377636 30558 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.378000 30558 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:10.393507 30558 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:10.402431 30558 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:10.404304 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d72c167bcb8445c86bea233eccc0132" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ce312b0d7a1747c8898a748f8d76df81"
I20260709 13:12:10.404911 30481 raft_consensus.cc:3055] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:10.405248 30481 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:10.406121 30481 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:10.416855 30481 raft_consensus.cc:3060] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:10.425906 30524 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:10.458946  4562 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.460114  4562 tablet_bootstrap.cc:492] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:10.460968  4562 ts_tablet_manager.cc:1403] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.410s	user 0.066s	sys 0.035s
I20260709 13:12:10.470114  4571 ts_tablet_manager.cc:933] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Initiating tablet copy from peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:10.481433 30481 raft_consensus.cc:2468] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:12:10.483213  4527 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:10.502486  4527 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:10.511113 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8972e85ae0a345ccbcc03a1799a386c5" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:10.512194 30558 raft_consensus.cc:3060] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:10.514503 30450 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:10.515491 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:10.525120  4522 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.525983  4522 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:10.528126  4522 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:10.534266 30450 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:10.535943  4562 raft_consensus.cc:359] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:10.536875  4562 raft_consensus.cc:740] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:10.542867  4562 consensus_queue.cc:260] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:10.555387  4562 ts_tablet_manager.cc:1434] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.002s
I20260709 13:12:10.577723 30523 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:10.579592  4489 raft_consensus.cc:2804] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:10.580089  4489 raft_consensus.cc:697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:10.581007  4489 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:10.582732 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:10.585990 31146 raft_consensus.cc:1217] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 LEARNER]: Deduplicated request from leader. Original: 20.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:12:10.588572 30558 raft_consensus.cc:2468] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:12:10.592469 30555 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 18.
I20260709 13:12:10.601262 30570 tablet_copy_service.cc:342] P 027e191e31da4af2bc83c5ddc0c15d05: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-ed91464a4fda479c9d2d6dfa8ca92193 received from {username='slave'} at 127.0.0.1:53492
I20260709 13:12:10.601791 30570 tablet_copy_service.cc:434] P 027e191e31da4af2bc83c5ddc0c15d05: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-ed91464a4fda479c9d2d6dfa8ca92193 on tablet ed91464a4fda479c9d2d6dfa8ca92193 with peer 19556a24b91d452d98668a3709fbc29d
W20260709 13:12:10.605083 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:10.616623  4571 tablet_copy_client.cc:323] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Beginning tablet copy session from remote peer at address 127.28.152.2:33247
I20260709 13:12:10.655161 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
W20260709 13:12:10.655318 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.660801 30451 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:10.666733  4266 raft_consensus.cc:2804] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:10.665493  4530 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:10.667905  4530 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.668272  4530 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:10.677016  4266 raft_consensus.cc:697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:10.678498  4266 consensus_queue.cc:237] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:10.685012 30303 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 12 to 13, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.701345 30495 tablet_copy_service.cc:140] P ce312b0d7a1747c8898a748f8d76df81: Received BeginTabletCopySession request for tablet 3d72c167bcb8445c86bea233eccc0132 from peer 19556a24b91d452d98668a3709fbc29d ({username='slave'} at 127.0.0.1:43256)
I20260709 13:12:10.701961 30495 tablet_copy_service.cc:161] P ce312b0d7a1747c8898a748f8d76df81: Beginning new tablet copy session on tablet 3d72c167bcb8445c86bea233eccc0132 from peer 19556a24b91d452d98668a3709fbc29d at {username='slave'} at 127.0.0.1:43256: session id = 19556a24b91d452d98668a3709fbc29d-3d72c167bcb8445c86bea233eccc0132
I20260709 13:12:10.724368  4530 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:10.730283 30452 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.731158 30450 consensus_peers.cc:597] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.721992 30495 tablet_copy_source_session.cc:215] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:10.747764  4571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d72c167bcb8445c86bea233eccc0132. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:10.759137 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 121069us
W20260709 13:12:10.762151 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.762586 30303 catalog_manager.cc:5697] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 16 to 18, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 18 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:10.772205 30450 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.770532  4530 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 election: Requested vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:10.772723 30450 consensus_peers.cc:597] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.777451 30450 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:10.779809 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.783473 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370c7d03a9fc4d11a8594e49e0b79a64" candidate_uuid: "ce312b0d7a1747c8898a748f8d76df81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:10.796051 30551 raft_consensus.cc:3060] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:10.806502 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.807381 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.813067 30551 raft_consensus.cc:2468] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce312b0d7a1747c8898a748f8d76df81 in term 19.
I20260709 13:12:10.814159 30451 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81; no voters: 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:10.816823  4530 raft_consensus.cc:2804] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:10.818718  4530 raft_consensus.cc:697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 19 LEADER]: Becoming Leader. State: Replica: ce312b0d7a1747c8898a748f8d76df81, State: Running, Role: LEADER
I20260709 13:12:10.819871  4530 consensus_queue.cc:237] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:10.821772 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.829437 30524 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:10.856858  4571 tablet_copy_client.cc:806] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.862533  4571 tablet_copy_client.cc:670] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:10.873780  4571 tablet_copy_client.cc:538] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:10.893342 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.895766 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.905867 30450 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111) [suppressed 428 similar messages]
I20260709 13:12:10.908205  4571 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Bootstrap starting.
W20260709 13:12:10.909909 30450 consensus_peers.cc:597] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:10.909368 30303 catalog_manager.cc:5697] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 reported cstate change: term changed from 17 to 19, leader changed from 0472fa7187444a91b443058ef89fceb9 (127.28.152.1) to ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2). New cstate: current_term: 19 leader_uuid: "ce312b0d7a1747c8898a748f8d76df81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:10.926091 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.938441 30524 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.955168 30450 consensus_peers.cc:597] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.977771 30525 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627): Couldn't send request to peer 19556a24b91d452d98668a3709fbc29d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:10.989607 30450 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.997246 30524 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.009418 30450 consensus_peers.cc:597] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.016629 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.023831 29280 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30432)
W20260709 13:12:11.032712 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.036413 30481 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:12:11.036787 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.038187  4489 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:11.048353 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.057878 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.059368  4571 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:11.060307  4571 tablet_bootstrap.cc:492] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Bootstrap complete.
I20260709 13:12:11.061028  4571 ts_tablet_manager.cc:1403] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Time spent bootstrapping tablet: real 0.153s	user 0.039s	sys 0.004s
W20260709 13:12:11.061441 30450 consensus_peers.cc:597] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.063925  4571 raft_consensus.cc:359] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:11.064810  4571 raft_consensus.cc:740] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Initialized, Role: LEARNER
I20260709 13:12:11.065478  4571 consensus_queue.cc:260] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: NON_VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: true } }
I20260709 13:12:11.078760  4571 ts_tablet_manager.cc:1434] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:12:11.080436 30495 tablet_copy_service.cc:342] P ce312b0d7a1747c8898a748f8d76df81: Request end of tablet copy session 19556a24b91d452d98668a3709fbc29d-3d72c167bcb8445c86bea233eccc0132 received from {username='slave'} at 127.0.0.1:43256
I20260709 13:12:11.080845 30495 tablet_copy_service.cc:434] P ce312b0d7a1747c8898a748f8d76df81: ending tablet copy session 19556a24b91d452d98668a3709fbc29d-3d72c167bcb8445c86bea233eccc0132 on tablet 3d72c167bcb8445c86bea233eccc0132 with peer 19556a24b91d452d98668a3709fbc29d
I20260709 13:12:11.084360  4496 raft_consensus.cc:1064] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:11.087369  4496 consensus_queue.cc:237] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:11.097844 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.151425 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.156817 31146 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:11.159116  4575 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:11.204061 30551 raft_consensus.cc:1275] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:12:11.212934  4530 consensus_queue.cc:1048] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:12:11.222962 30450 consensus_peers.cc:597] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.250460 30481 raft_consensus.cc:1275] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:12:11.257333 30524 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.258072  4535 consensus_queue.cc:1048] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:11.286254 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.288555 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:11.290654 30557 raft_consensus.cc:1275] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Refusing update from remote peer ce312b0d7a1747c8898a748f8d76df81: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:12:11.293694  4532 consensus_queue.cc:1048] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:11.334067 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.353401 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.366875 30450 consensus_peers.cc:597] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.381366  4535 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:11.393056 31148 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:11.435866 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:11.454330 30481 raft_consensus.cc:2955] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:11.459350 30302 catalog_manager.cc:5697] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d reported cstate change: config changed from index 11 to 13, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:11.547873 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.550915 30450 consensus_peers.cc:597] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.553707 30524 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.604425 30450 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.730305 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.759997 30450 consensus_peers.cc:597] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.812835 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:11.947855  4496 raft_consensus.cc:1064] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: attempting to promote NON_VOTER 19556a24b91d452d98668a3709fbc29d to VOTER
I20260709 13:12:11.951017  4496 consensus_queue.cc:237] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:11.961508 30481 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:11.963891 31146 raft_consensus.cc:1275] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 LEARNER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:12:11.964476 30524 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.966251  4535 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:11.982025  4496 consensus_queue.cc:1048] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:12:12.000600  4535 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:12.016927 31146 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
I20260709 13:12:12.020134 30481 raft_consensus.cc:2955] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 8 to 11, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } } }
W20260709 13:12:12.026801 29280 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30432)
I20260709 13:12:12.028338 30304 catalog_manager.cc:5697] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: config changed from index 8 to 11, 19556a24b91d452d98668a3709fbc29d (127.28.152.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:12.054709 30450 consensus_peers.cc:597] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:12.211294 30450 consensus_peers.cc:597] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:12.230877 30450 consensus_peers.cc:597] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:12.356078 30450 consensus_peers.cc:597] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:12.533778 30450 consensus_peers.cc:597] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:12.913076 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:12.968106 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.027253 29280 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30432)
W20260709 13:12:13.031550 30450 consensus_peers.cc:597] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.074669 30450 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.081377 30450 consensus_peers.cc:597] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.084705 30450 consensus_peers.cc:597] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.089639 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.190066 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.191255 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.279254 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.279769 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.295099 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.363549 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.364295 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.391909 30450 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.428746 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.434662 30524 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.442813 30524 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.456739 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.469820 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.473320 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.545658 30450 consensus_peers.cc:597] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.552786 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.556789 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.579154 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.579154 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.587235 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.684139 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.688745 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.717141 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.724990 30450 consensus_peers.cc:597] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.764416 30450 consensus_peers.cc:597] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.770620 30524 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.984630 30450 consensus_peers.cc:597] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.027738 29280 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30432)
W20260709 13:12:14.037949 30450 consensus_peers.cc:597] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.070660 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.115042 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.160353 30450 consensus_peers.cc:597] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.229943 30524 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.310591 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.436523 30450 consensus_peers.cc:597] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.469355 30524 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.475504 30450 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.594127 30450 consensus_peers.cc:597] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.806033 30450 consensus_peers.cc:597] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.849182 30450 consensus_peers.cc:597] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:14.910769 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800176100 after lost signal to thread 29283
W20260709 13:12:14.912031 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed400 after lost signal to thread 30343
W20260709 13:12:14.913574 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08001415e0 after lost signal to thread 30510
W20260709 13:12:14.915876 30340 debug-util.cc:398] Leaking SignalData structure 0x7b0800289160 after lost signal to thread 30584
W20260709 13:12:14.920387 30340 debug-util.cc:398] Leaking SignalData structure 0x7b08003076a0 after lost signal to thread 31180
W20260709 13:12:15.028410 29280 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30432)
W20260709 13:12:15.031190 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:15.084434 30450 consensus_peers.cc:597] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:15.098107 30450 consensus_peers.cc:597] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:15.456149 30450 consensus_peers.cc:597] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.545101 30450 consensus_peers.cc:597] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.549237 30450 consensus_peers.cc:597] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.550032 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.594719 30450 consensus_peers.cc:597] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.629778 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.649410 30450 consensus_peers.cc:597] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.673197 30450 consensus_peers.cc:597] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.709528 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.731902 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.743144 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.816210 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.885106 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.907816 30524 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.908926 30450 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111) [suppressed 472 similar messages]
W20260709 13:12:15.945640 30524 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.980849 30450 consensus_peers.cc:597] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.984181 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.991067 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.994796 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.029058 29280 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30432)
W20260709 13:12:16.065239 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.107822 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.129470 30524 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.152690 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.146479 30450 consensus_peers.cc:597] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.154567 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.212844 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.213701 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.229549 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.214666 30450 consensus_peers.cc:597] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.289266 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.295192 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.338932 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.358207 30450 consensus_peers.cc:597] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.401445 30450 consensus_peers.cc:597] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.404597 30450 consensus_peers.cc:597] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.571564 30524 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.682147 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:16.902235 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
W20260709 13:12:16.903409 30450 consensus_peers.cc:597] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.906672 30450 consensus_peers.cc:597] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.971762 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.982738 30524 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:17.110739 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
W20260709 13:12:17.145884 30450 consensus_peers.cc:597] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:17.171378 31116 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.172303 31116 consensus_peers.cc:597] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.173064 31116 consensus_peers.cc:597] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.173820 31116 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.174566 31116 consensus_peers.cc:597] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.179538 30523 consensus_peers.cc:597] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.180301 30523 consensus_peers.cc:597] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.180924 30523 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.181557 30523 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.182188 30523 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.185544 30523 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.191747 30450 consensus_peers.cc:597] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:17.220968 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:17.222146 29280 tablet_replica.cc:333] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.223060 29280 raft_consensus.cc:2243] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.223656 29280 raft_consensus.cc:2272] T 2066b43938d64be7be50295fb7cf724a P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.226325 29280 tablet_replica.cc:333] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.227104 29280 raft_consensus.cc:2243] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.227960 29280 raft_consensus.cc:2272] T f9ed30c25a2940f2b0a16f63a49eb1a6 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.230962 29280 tablet_replica.cc:333] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.232000 29280 raft_consensus.cc:2243] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.232920 29280 raft_consensus.cc:2272] T b145c49726dc4998aea9471d4b0ca159 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.235558 29280 tablet_replica.cc:333] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.236438 29280 raft_consensus.cc:2243] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.237465 29280 raft_consensus.cc:2272] T c4b473589cd94be59022580022e2de00 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.240243 29280 tablet_replica.cc:333] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.241046 29280 raft_consensus.cc:2243] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.242180 29280 raft_consensus.cc:2272] T b5b1451644b74f359b2aae8ebfaf45d3 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.245011 29280 tablet_replica.cc:333] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.245883 29280 raft_consensus.cc:2243] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.247038 29280 raft_consensus.cc:2272] T d0a59ccddffd4014bdeda9cac96154f7 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.249630 29280 tablet_replica.cc:333] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.250296 29280 raft_consensus.cc:2243] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.251259 29280 raft_consensus.cc:2272] T 1f911d757027485a941dce045769b0fe P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.253545 29280 tablet_replica.cc:333] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.254137 29280 raft_consensus.cc:2243] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.254962 29280 raft_consensus.cc:2272] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P ce312b0d7a1747c8898a748f8d76df81 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.257004 29280 tablet_replica.cc:333] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.257625 29280 raft_consensus.cc:2243] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.258718 29280 raft_consensus.cc:2272] T 8972e85ae0a345ccbcc03a1799a386c5 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.260828 29280 tablet_replica.cc:333] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.261528 29280 raft_consensus.cc:2243] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.261974 29280 raft_consensus.cc:2272] T 7846efa5da12423cb3343cd5f3483869 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.264119 29280 tablet_replica.cc:333] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.264680 29280 raft_consensus.cc:2243] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.265327 29280 raft_consensus.cc:2272] T 9632f38fdbf84c58a587a59a81f394ce P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.267751 29280 tablet_replica.cc:333] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.268532 29280 raft_consensus.cc:2243] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.269639 29280 raft_consensus.cc:2272] T ca06fa0758d044ec9b556e21520124e6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.273412 29280 tablet_replica.cc:333] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.274219 29280 raft_consensus.cc:2243] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.275691 29280 raft_consensus.cc:2272] T 550a9c0ab10040efb87b80fce405535d P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.278614 29280 tablet_replica.cc:333] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.279498 29280 raft_consensus.cc:2243] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.280094 29280 raft_consensus.cc:2272] T fadcc5b6fd8a4ea992fa104050ad1a12 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.282677 29280 tablet_replica.cc:333] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.283560 29280 raft_consensus.cc:2243] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.284222 29280 raft_consensus.cc:2272] T e4f6773aa18b4ca9a0d9829e2021b82e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.286942 29280 tablet_replica.cc:333] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.287815 29280 raft_consensus.cc:2243] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.288488 29280 raft_consensus.cc:2272] T e16021f7db32485f8ce7b81d2cd291b8 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.290985 29280 tablet_replica.cc:333] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.291841 29280 raft_consensus.cc:2243] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.292434 29280 raft_consensus.cc:2272] T 8a7575b0e686483ca3a32ff9be16a338 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.296169 29280 tablet_replica.cc:333] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.296998 29280 raft_consensus.cc:2243] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.297574 29280 raft_consensus.cc:2272] T 0efe22046955442f80d17ac45b08253b P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.297691 31116 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.300415 29280 tablet_replica.cc:333] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.302430 29280 raft_consensus.cc:2243] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.303534 29280 raft_consensus.cc:2272] T d909a45f39c448af875585d7299103f6 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.306210 29280 tablet_replica.cc:333] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.307022 29280 raft_consensus.cc:2243] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.307822 29280 raft_consensus.cc:2272] T 02b91286dc8d477e8ebec973b266b7f0 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.311401 29280 tablet_replica.cc:333] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.312170 29280 raft_consensus.cc:2243] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.313274 29280 raft_consensus.cc:2272] T 93b081f573884221a895fd5d1acd47d4 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.315986 29280 tablet_replica.cc:333] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.316707 29280 raft_consensus.cc:2243] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.317889 29280 raft_consensus.cc:2272] T 0500eacf70c44cb5bb9527f23aea9b1d P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.321444 29280 tablet_replica.cc:333] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.322239 29280 raft_consensus.cc:2243] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.323302 29280 raft_consensus.cc:2272] T 7244cfd402714902be2b9ef1ac7af65a P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.326958 29280 tablet_replica.cc:333] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.327775 29280 raft_consensus.cc:2243] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.328650 29280 raft_consensus.cc:2272] T e6ff8d501cb144d0ba1527bbf7c10597 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.330929 29280 tablet_replica.cc:333] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.331732 29280 raft_consensus.cc:2243] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.333815 29280 raft_consensus.cc:2272] T b9205df4217c4ceca542cc35ed79d43e P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.337455 29280 tablet_replica.cc:333] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.338222 29280 raft_consensus.cc:2243] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.339387 29280 raft_consensus.cc:2272] T 5f0025bdb2b44775bcdb4ec9702926aa P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.341768 29280 tablet_replica.cc:333] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.342530 29280 raft_consensus.cc:2243] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.343606 29280 raft_consensus.cc:2272] T 788d95f5ce114732b7f934005a3580e2 P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.346354 29280 tablet_replica.cc:333] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.347121 29280 raft_consensus.cc:2243] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.347683 29280 raft_consensus.cc:2272] T 567508f2962f473b8fac20c97a240f35 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.350386 30523 consensus_peers.cc:597] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.351223 29280 tablet_replica.cc:333] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.352074 29280 raft_consensus.cc:2243] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.353598 29280 raft_consensus.cc:2272] T 2e1b5d40df944767ab310e2bd822d5b0 P ce312b0d7a1747c8898a748f8d76df81 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.356227 29280 tablet_replica.cc:333] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.356945 29280 raft_consensus.cc:2243] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.357910 29280 raft_consensus.cc:2272] T 290c8f7e148a4bd4b296c97e9c6552c4 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.360353 29280 tablet_replica.cc:333] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.361114 29280 raft_consensus.cc:2243] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.362074 29280 raft_consensus.cc:2272] T 9005afb08e044cf08de618af26cfcf42 P ce312b0d7a1747c8898a748f8d76df81 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.362005 31116 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.366506 30523 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.364856 29280 tablet_replica.cc:333] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.369436 29280 raft_consensus.cc:2243] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.370513 29280 raft_consensus.cc:2272] T 9677253d313a48abb6e352b42a3fae88 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.373282 29280 tablet_replica.cc:333] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
W20260709 13:12:17.373504 30523 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.374070 29280 raft_consensus.cc:2243] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.375257 29280 raft_consensus.cc:2272] T cc136e9e62d1428b88f928b6ccef8316 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.377626 29280 tablet_replica.cc:333] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.378410 29280 raft_consensus.cc:2243] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.379129 29280 raft_consensus.cc:2272] T 1640dd5756f749fd8546ca110299cc59 P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.381652 29280 tablet_replica.cc:333] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.382200 29280 raft_consensus.cc:2243] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.382647 29280 raft_consensus.cc:2272] T 88cc3e301acf441dab14eb0be7a54db1 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.385303 29280 tablet_replica.cc:333] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.386044 29280 raft_consensus.cc:2243] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.387560 29280 raft_consensus.cc:2272] T eb1e5995c7614e97bf058caeaa374e54 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.390888 29280 tablet_replica.cc:333] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.391413 29280 raft_consensus.cc:2243] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.392150 29280 raft_consensus.cc:2272] T ba4c05796efa42489d11c8a49ba476ad P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.394119 29280 tablet_replica.cc:333] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.394824 29280 raft_consensus.cc:2243] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.395364 29280 raft_consensus.cc:2272] T b32c699f55944c90a3ffe996af3951b7 P ce312b0d7a1747c8898a748f8d76df81 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.397665 29280 tablet_replica.cc:333] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.398214 29280 raft_consensus.cc:2243] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.400336 29280 raft_consensus.cc:2272] T 370c7d03a9fc4d11a8594e49e0b79a64 P ce312b0d7a1747c8898a748f8d76df81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.403071 29280 tablet_replica.cc:333] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.403775 29280 raft_consensus.cc:2243] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.404335 29280 raft_consensus.cc:2272] T 2ba0b89a2fc4499a917166e3b4b88cf9 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.406147 29280 tablet_replica.cc:333] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.406891 29280 raft_consensus.cc:2243] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.407924 29280 raft_consensus.cc:2272] T e809575d6fe84ef3afe48c9cf7532868 P ce312b0d7a1747c8898a748f8d76df81 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.408264 30523 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.410657 29280 tablet_replica.cc:333] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.417832 29280 raft_consensus.cc:2243] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.419080 29280 raft_consensus.cc:2272] T 3e3cb6475718492e846dc8fdd3f4e538 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.422180 29280 tablet_replica.cc:333] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.422969 29280 raft_consensus.cc:2243] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:17.426801 30523 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.435485 29280 raft_consensus.cc:2272] T 6b385b950a414bce8902269df58e5bf4 P ce312b0d7a1747c8898a748f8d76df81 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.435580 31116 consensus_peers.cc:597] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.439651 29280 tablet_replica.cc:333] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.440483 29280 raft_consensus.cc:2243] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.441548 29280 raft_consensus.cc:2272] T 61d4ac70a018496ba2020b90313c013e P ce312b0d7a1747c8898a748f8d76df81 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.441828 31116 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.444473 29280 tablet_replica.cc:333] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.445326 29280 raft_consensus.cc:2243] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.446158 29280 raft_consensus.cc:2272] T ed91464a4fda479c9d2d6dfa8ca92193 P ce312b0d7a1747c8898a748f8d76df81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.449120 29280 tablet_replica.cc:333] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.449872 29280 raft_consensus.cc:2243] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.452381 29280 raft_consensus.cc:2272] T 3d72c167bcb8445c86bea233eccc0132 P ce312b0d7a1747c8898a748f8d76df81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.455430 29280 tablet_replica.cc:333] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.456141 29280 raft_consensus.cc:2243] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.456676 29280 raft_consensus.cc:2272] T cb15b3fc088e4285aec0576f22ecb481 P ce312b0d7a1747c8898a748f8d76df81 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.459630 29280 tablet_replica.cc:333] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.460271 29280 raft_consensus.cc:2243] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.460843 29280 raft_consensus.cc:2272] T 6b47e3764d6643f0a7629098b7f19d34 P ce312b0d7a1747c8898a748f8d76df81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.463763 29280 tablet_replica.cc:333] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81: stopping tablet replica
I20260709 13:12:17.464358 29280 raft_consensus.cc:2243] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.465590 29280 raft_consensus.cc:2272] T 0d1e11d913434fda8959a45d48772c1f P ce312b0d7a1747c8898a748f8d76df81 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.466941 30523 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.504082 30523 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.529222 30523 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.532827 30523 consensus_peers.cc:597] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.541118 30523 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.602674 31116 consensus_peers.cc:597] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.635927 30523 connection.cc:573] client connection to 127.28.152.2:33247 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:12:17.688942 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08003aec40 after lost signal to thread 29283
W20260709 13:12:17.690140 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08003db940 after lost signal to thread 30343
W20260709 13:12:17.691527 30507 debug-util.cc:398] Leaking SignalData structure 0x7b080029a5e0 after lost signal to thread 30510
W20260709 13:12:17.692742 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2da0 after lost signal to thread 30584
W20260709 13:12:17.694052 30507 debug-util.cc:398] Leaking SignalData structure 0x7b08003307c0 after lost signal to thread 31180
W20260709 13:12:18.087656 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.105330 30524 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.185232 30524 consensus_peers.cc:597] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.331634 30524 consensus_peers.cc:597] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.367015 30524 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.397090  4618 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.397830  4618 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:18.410928 31116 leader_election.cc:336] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.422446  4612 raft_consensus.cc:493] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.423476  4612 raft_consensus.cc:515] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:18.433164 30524 leader_election.cc:336] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.434587  4610 raft_consensus.cc:493] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.435221  4610 raft_consensus.cc:515] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.440410  4610 leader_election.cc:290] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.454130  4625 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.454715  4625 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.456919  4625 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:18.467185 30524 leader_election.cc:336] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.474812 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:18.479966  4625 raft_consensus.cc:493] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.480674  4625 raft_consensus.cc:515] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.482877  4625 leader_election.cc:290] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.468321  4612 leader_election.cc:290] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.501322 30524 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.502028 30524 leader_election.cc:336] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:18.502542 30524 consensus_peers.cc:597] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.503312 31117 leader_election.cc:336] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.503749 31117 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.504036  4618 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.516949  4619 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:18.537742 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.550829  4618 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.551492  4618 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.556746  4618 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.539520 30523 leader_election.cc:336] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.566359 30523 leader_election.cc:304] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:18.567443 30523 leader_election.cc:336] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.570730 30523 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:18.570209 31116 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:18.564810 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.572129 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.568053  4623 raft_consensus.cc:2749] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:18.576409  4612 raft_consensus.cc:2749] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:18.586143 30523 leader_election.cc:336] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:18.607290 30524 consensus_peers.cc:597] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.586634 30523 leader_election.cc:304] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.617532  4625 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.618206  4625 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.620647  4625 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:18.621105  4625 raft_consensus.cc:493] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.623338  4506 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.623888  4506 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.625849  4506 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.626519  4610 raft_consensus.cc:493] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.627086  4610 raft_consensus.cc:515] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.629274  4610 leader_election.cc:290] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.629736  4610 raft_consensus.cc:493] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.621568  4625 raft_consensus.cc:515] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.634455  4625 leader_election.cc:290] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.635794  4612 raft_consensus.cc:493] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.637545  4612 raft_consensus.cc:515] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.640021  4612 leader_election.cc:290] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.630183  4610 raft_consensus.cc:515] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.642901  4610 leader_election.cc:290] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.637105  4625 raft_consensus.cc:493] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.648051  4625 raft_consensus.cc:515] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.646075  4623 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.651091  4623 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:18.654373 29280 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30507)
W20260709 13:12:18.656862 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 70753.1us
W20260709 13:12:18.667241 30523 leader_election.cc:336] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.672653 30523 leader_election.cc:304] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:18.611620 31117 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.657459  4610 raft_consensus.cc:2749] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:18.675079 31117 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.675909  4618 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:18.676959 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 65371.8us
I20260709 13:12:18.661198  4625 leader_election.cc:290] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.671828  4623 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:18.680518 31116 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.682679  4612 raft_consensus.cc:2749] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:18.686795  4619 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.699610  4619 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.701772  4619 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.695577 30524 leader_election.cc:336] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:18.704001 30524 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:18.705473 30524 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.696326  4628 raft_consensus.cc:493] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.704560  4618 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.725361  4618 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.727941  4618 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:18.698220  4623 raft_consensus.cc:493] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.710242  4506 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.728765  4506 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.730723  4506 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:18.731318  4623 raft_consensus.cc:515] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.733773  4623 leader_election.cc:290] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.734280  4628 raft_consensus.cc:515] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.738634 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:18.752689 31146 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
W20260709 13:12:18.741393 30524 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.746160 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:18.747648 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05" is_pre_election: true
I20260709 13:12:18.754987 30551 raft_consensus.cc:2468] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 15.
I20260709 13:12:18.754531 30557 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 18.
I20260709 13:12:18.757819 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1e5995c7614e97bf058caeaa374e54" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:18.758477 31148 raft_consensus.cc:2468] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 13.
I20260709 13:12:18.761330  4628 leader_election.cc:290] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.769793  4612 raft_consensus.cc:493] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.778684  4610 raft_consensus.cc:493] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.764881  4506 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
W20260709 13:12:18.773280 31116 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.773197 30525 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:18.783237  4506 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.783576  4630 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:18.784031  4630 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.784382  4630 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:18.786144  4506 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.789805 31116 leader_election.cc:336] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.791611  4630 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.794627  4625 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.795218  4625 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:18.797910 30523 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.779011  4612 raft_consensus.cc:515] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:18.804754 30523 leader_election.cc:336] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.805218 30523 leader_election.cc:304] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.805891  4612 leader_election.cc:290] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.806465  4612 raft_consensus.cc:2749] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:18.801502  4625 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:18.766620 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.807435  4630 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
I20260709 13:12:18.797206  4610 raft_consensus.cc:515] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
I20260709 13:12:18.809700  4610 leader_election.cc:290] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.807504 31117 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.780012 31118 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:18.810984 31118 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:18.812163 31116 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.815451  4618 raft_consensus.cc:2804] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:18.815919  4618 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.816339  4618 raft_consensus.cc:3060] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:18.821276 30523 leader_election.cc:336] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.821588  4506 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:18.821823 30523 leader_election.cc:304] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.821985  4506 raft_consensus.cc:493] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.822710  4506 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:18.826149 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d" is_pre_election: true
I20260709 13:12:18.826784 31148 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 14.
I20260709 13:12:18.827978 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
W20260709 13:12:18.828733 31116 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.829383  4506 raft_consensus.cc:515] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.833938 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:18.834467  4623 raft_consensus.cc:2749] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:18.847169  4623 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:18.847527  4623 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.847875  4623 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:18.834821  4628 raft_consensus.cc:493] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.851270  4628 raft_consensus.cc:515] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } }
W20260709 13:12:18.835135 30523 leader_election.cc:336] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.853143 30523 leader_election.cc:304] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.853374  4628 leader_election.cc:290] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:18.839975  4629 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:18.857033  4629 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.857193  4623 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.835237 31117 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.860272  4619 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:18.861212  4623 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 19556a24b91d452d98668a3709fbc29d (127.28.152.4:39627)
W20260709 13:12:18.862785 31117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 55313.3us
W20260709 13:12:18.854259 30523 leader_election.cc:336] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.866950 30523 leader_election.cc:304] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.867751  4623 raft_consensus.cc:2749] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:18.868039 30523 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.855005  4610 raft_consensus.cc:2749] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:18.869306 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290c8f7e148a4bd4b296c97e9c6552c4" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:18.869942 30557 raft_consensus.cc:3060] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:18.877539 30557 raft_consensus.cc:2468] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19556a24b91d452d98668a3709fbc29d in term 19.
I20260709 13:12:18.878795 31118 leader_election.cc:304] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:18.879801  4619 raft_consensus.cc:2804] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:18.887714  4629 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:18.841379 30524 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.859134  4506 leader_election.cc:290] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:18.888502 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 47158.6us
W20260709 13:12:18.890517 30524 leader_election.cc:336] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.891011 30524 leader_election.cc:304] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:18.891486 30523 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:18.900581 30523 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.902005  4610 raft_consensus.cc:2749] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:18.902858  4610 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:18.856076  4618 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.904248 31148 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 027e191e31da4af2bc83c5ddc0c15d05 in current term 16: Already voted for candidate 19556a24b91d452d98668a3709fbc29d in this term.
I20260709 13:12:18.912067 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9005afb08e044cf08de618af26cfcf42" candidate_uuid: "19556a24b91d452d98668a3709fbc29d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "027e191e31da4af2bc83c5ddc0c15d05"
I20260709 13:12:18.912901 30557 raft_consensus.cc:2393] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 19556a24b91d452d98668a3709fbc29d in current term 16: Already voted for candidate 027e191e31da4af2bc83c5ddc0c15d05 in this term.
I20260709 13:12:18.914306 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9677253d313a48abb6e352b42a3fae88" candidate_uuid: "027e191e31da4af2bc83c5ddc0c15d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "19556a24b91d452d98668a3709fbc29d"
I20260709 13:12:18.915846 31148 raft_consensus.cc:3060] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:18.935307  4618 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Requested vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:18.936542  4619 raft_consensus.cc:697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Becoming Leader. State: Replica: 19556a24b91d452d98668a3709fbc29d, State: Running, Role: LEADER
I20260709 13:12:18.938113  4619 consensus_queue.cc:237] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.941603 31148 raft_consensus.cc:2468] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 027e191e31da4af2bc83c5ddc0c15d05 in term 15.
W20260709 13:12:18.947045 31116 leader_election.cc:336] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:18.958526 31116 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:18.950393 30524 consensus_peers.cc:597] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.961536 30524 consensus_peers.cc:597] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.947580 31117 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:18.962458 30525 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05, 19556a24b91d452d98668a3709fbc29d; no voters: 
I20260709 13:12:18.966172  4628 raft_consensus.cc:2804] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:18.966747  4628 raft_consensus.cc:697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Becoming Leader. State: Replica: 027e191e31da4af2bc83c5ddc0c15d05, State: Running, Role: LEADER
I20260709 13:12:18.967890  4628 consensus_queue.cc:237] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:18.969236 31117 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:18.973328  4618 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:18.972954 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.980566 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.981118 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.983395 30303 catalog_manager.cc:5697] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d reported cstate change: term changed from 18 to 19, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 19556a24b91d452d98668a3709fbc29d (127.28.152.4). New cstate: current_term: 19 leader_uuid: "19556a24b91d452d98668a3709fbc29d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.992280 30304 catalog_manager.cc:5697] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 reported cstate change: term changed from 14 to 15, leader changed from ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2) to 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3). New cstate: current_term: 15 leader_uuid: "027e191e31da4af2bc83c5ddc0c15d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:18.964844 30523 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:19.010397 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 45588.6us
W20260709 13:12:19.010475 30524 leader_election.cc:336] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.028003 30524 leader_election.cc:304] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:19.028874 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33099, user_credentials={real_user=slave}} blocked reactor thread for 63482.1us
W20260709 13:12:19.029598 30524 consensus_peers.cc:597] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:19.029990 30524 leader_election.cc:336] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.030920  4628 raft_consensus.cc:2749] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:12:19.032689 30524 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:19.044059 30524 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.045183 30524 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:19.045893 31116 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:19.046960 31116 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:19.044559 30523 leader_election.cc:336] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:19.052194 30523 leader_election.cc:304] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:19.052316  4618 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:19.053566  4628 raft_consensus.cc:2749] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:19.055724 30523 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:19.058394 30523 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 19556a24b91d452d98668a3709fbc29d, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:19.046422 30524 leader_election.cc:336] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:19.065783 30524 leader_election.cc:336] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.067540  4628 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:19.063397 31117 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.094269 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:19.103976 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:19.110554 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:19.114123 31117 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.104713  4619 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:19.114606 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:19.124424  4618 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:19.125859 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:19.120925 30523 leader_election.cc:336] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:19.150753 30523 leader_election.cc:336] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:19.156234 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:19.167790 30523 leader_election.cc:304] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:19.168900 30523 leader_election.cc:336] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:19.176136 30523 leader_election.cc:304] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:19.169263  4628 raft_consensus.cc:2749] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:19.179563  4610 raft_consensus.cc:2749] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:19.183602 30523 leader_election.cc:336] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:19.190588 30523 leader_election.cc:304] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 027e191e31da4af2bc83c5ddc0c15d05; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:19.192061  4628 raft_consensus.cc:2749] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:19.194197 30523 leader_election.cc:336] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:19.254292 30524 consensus_peers.cc:597] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:19.326155 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
W20260709 13:12:19.331055 30523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:33247, user_credentials={real_user=slave}} blocked reactor thread for 54786.5us
W20260709 13:12:19.343521 30523 consensus_peers.cc:597] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.365769 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:19.485342 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
I20260709 13:12:19.488862 31148 raft_consensus.cc:1275] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Refusing update from remote peer 027e191e31da4af2bc83c5ddc0c15d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:19.492609  4628 consensus_queue.cc:1048] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:19.499732 31118 consensus_peers.cc:597] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.508543 30524 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.511201 31116 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.520541 31118 consensus_peers.cc:597] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.545881 30524 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:19.560037 31118 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.591521 31116 consensus_peers.cc:597] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.620052 31116 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.622957 30525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:39627, user_credentials={real_user=slave}} blocked reactor thread for 61931us
W20260709 13:12:19.646651 31118 consensus_peers.cc:597] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.675244 31118 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.711571 31118 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.712255 31118 consensus_peers.cc:597] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.717960 31118 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.735935 30523 consensus_peers.cc:597] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:19.736354 31116 consensus_peers.cc:597] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.736657 30523 consensus_peers.cc:597] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.737263 30523 consensus_peers.cc:597] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.737695 30523 consensus_peers.cc:597] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.738133 30523 consensus_peers.cc:597] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.738564 30523 consensus_peers.cc:597] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.739003 30523 consensus_peers.cc:597] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.739867 31118 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.779695 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:19.784078 29280 tablet_replica.cc:333] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.786757 29280 raft_consensus.cc:2243] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.799994 29280 raft_consensus.cc:2272] T d0a59ccddffd4014bdeda9cac96154f7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.803962 29280 tablet_replica.cc:333] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.805658 29280 raft_consensus.cc:2243] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:12:19.807169 31118 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.808457 29280 raft_consensus.cc:2272] T b145c49726dc4998aea9471d4b0ca159 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.812909 29280 tablet_replica.cc:333] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.814659 29280 raft_consensus.cc:2243] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.816572 29280 raft_consensus.cc:2272] T ca06fa0758d044ec9b556e21520124e6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.822408 29280 tablet_replica.cc:333] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
W20260709 13:12:19.818387 30523 consensus_peers.cc:597] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.824642 29280 raft_consensus.cc:2243] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:12:19.826418 31118 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.827855 29280 raft_consensus.cc:2272] T 2066b43938d64be7be50295fb7cf724a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.832046 29280 tablet_replica.cc:333] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.834067 29280 raft_consensus.cc:2243] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:19.834810 31116 consensus_peers.cc:597] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.835552 29280 raft_consensus.cc:2272] T 8972e85ae0a345ccbcc03a1799a386c5 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.841702 29280 tablet_replica.cc:333] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.843279 29280 raft_consensus.cc:2243] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.844347 29280 raft_consensus.cc:2272] T 7846efa5da12423cb3343cd5f3483869 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.848058 29280 tablet_replica.cc:333] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
W20260709 13:12:19.848343 31118 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.849407 29280 raft_consensus.cc:2243] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.850517 29280 raft_consensus.cc:2272] T f2c4e8b43b5248a6b8811c7335522edb P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.854736 29280 tablet_replica.cc:333] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.856109 29280 raft_consensus.cc:2243] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.859166 29280 raft_consensus.cc:2272] T 0efe22046955442f80d17ac45b08253b P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.859781 30523 consensus_peers.cc:597] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.863385 31118 consensus_peers.cc:597] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d -> Peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Couldn't send request to peer 027e191e31da4af2bc83c5ddc0c15d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.863520 29280 tablet_replica.cc:333] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.867465 29280 raft_consensus.cc:2243] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.869639 29280 raft_consensus.cc:2272] T 02b91286dc8d477e8ebec973b266b7f0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.872498 31116 consensus_peers.cc:597] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.875026 31116 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.879235 29280 tablet_replica.cc:333] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.881102 29280 raft_consensus.cc:2243] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.882843 29280 raft_consensus.cc:2272] T 497264cf15754f0e9029cd057a54a7fb P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.895895 29280 tablet_replica.cc:333] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.897019 29280 raft_consensus.cc:2243] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.898203 29280 raft_consensus.cc:2272] T 550a9c0ab10040efb87b80fce405535d P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.901440 29280 tablet_replica.cc:333] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.902609 29280 raft_consensus.cc:2243] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.903880 29280 raft_consensus.cc:2272] T 913c2d18b15848cd98ab0ff37874cc23 P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.907301 29280 tablet_replica.cc:333] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.908209 29280 raft_consensus.cc:2243] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.911435 29280 raft_consensus.cc:2272] T 3d97aadeef4e4fb9b4f6d566a7908278 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.915109 29280 tablet_replica.cc:333] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.916168 29280 raft_consensus.cc:2243] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.917786 29280 raft_consensus.cc:2272] T b9205df4217c4ceca542cc35ed79d43e P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.921545 29280 tablet_replica.cc:333] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.922472 29280 raft_consensus.cc:2243] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.925029 29280 raft_consensus.cc:2272] T b5b1451644b74f359b2aae8ebfaf45d3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.926381 31116 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.928582 29280 tablet_replica.cc:333] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.929574 29280 raft_consensus.cc:2243] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.930599 29280 raft_consensus.cc:2272] T 93b081f573884221a895fd5d1acd47d4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.934245 29280 tablet_replica.cc:333] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.935326 29280 raft_consensus.cc:2243] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.936304 29280 raft_consensus.cc:2272] T 7244cfd402714902be2b9ef1ac7af65a P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.940016 29280 tablet_replica.cc:333] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.941103 29280 raft_consensus.cc:2243] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.941985 29280 raft_consensus.cc:2272] T e6ff8d501cb144d0ba1527bbf7c10597 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.945474 29280 tablet_replica.cc:333] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.946442 29280 raft_consensus.cc:2243] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.949059 29280 raft_consensus.cc:2272] T e16021f7db32485f8ce7b81d2cd291b8 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.952473 29280 tablet_replica.cc:333] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.953501 29280 raft_consensus.cc:2243] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.955538 29280 raft_consensus.cc:2272] T 8a7575b0e686483ca3a32ff9be16a338 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.958410 30523 consensus_peers.cc:597] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.958932 29280 tablet_replica.cc:333] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.960050 29280 raft_consensus.cc:2243] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.962487 29280 raft_consensus.cc:2272] T 82023e2c5e484095a622dab241c66cd3 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.966007 29280 tablet_replica.cc:333] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.967057 29280 raft_consensus.cc:2243] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.968030 29280 raft_consensus.cc:2272] T 406b169640e341629c55637d07dd3d47 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.971968 29280 tablet_replica.cc:333] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.972864 29280 raft_consensus.cc:2243] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.974210 29280 raft_consensus.cc:2272] T 1f911d757027485a941dce045769b0fe P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.977756 29280 tablet_replica.cc:333] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.978823 29280 raft_consensus.cc:2243] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.979943 29280 raft_consensus.cc:2272] T 61d4ac70a018496ba2020b90313c013e P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.983623 29280 tablet_replica.cc:333] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.984627 29280 raft_consensus.cc:2243] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:19.987911 29280 raft_consensus.cc:2272] T ed91464a4fda479c9d2d6dfa8ca92193 P 027e191e31da4af2bc83c5ddc0c15d05 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:19.991513 29280 tablet_replica.cc:333] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.992791 29280 raft_consensus.cc:2243] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:19.993984 29280 raft_consensus.cc:2272] T 370c7d03a9fc4d11a8594e49e0b79a64 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:19.995347 31116 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.998360 29280 tablet_replica.cc:333] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:19.999295 29280 raft_consensus.cc:2243] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.000473 29280 raft_consensus.cc:2272] T 7df93ef89d784f0bab73ca5a5d399cc0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.003499 29280 tablet_replica.cc:333] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.004315 29280 raft_consensus.cc:2243] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.005249 29280 raft_consensus.cc:2272] T 788d95f5ce114732b7f934005a3580e2 P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.008617 29280 tablet_replica.cc:333] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.009380 29280 raft_consensus.cc:2243] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.010838 29280 raft_consensus.cc:2272] T 567508f2962f473b8fac20c97a240f35 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.013754 29280 tablet_replica.cc:333] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.014555 29280 raft_consensus.cc:2243] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.015786 29280 raft_consensus.cc:2272] T 88cc3e301acf441dab14eb0be7a54db1 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.019003 29280 tablet_replica.cc:333] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.019735 29280 raft_consensus.cc:2243] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.021219 29280 raft_consensus.cc:2272] T eb1e5995c7614e97bf058caeaa374e54 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.024035 29280 tablet_replica.cc:333] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.024788 29280 raft_consensus.cc:2243] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.025693 29280 raft_consensus.cc:2272] T d34313dd02b6470d81b73b13d5cf157f P 027e191e31da4af2bc83c5ddc0c15d05 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.028745 29280 tablet_replica.cc:333] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.029783 29280 raft_consensus.cc:2243] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.031487 29280 raft_consensus.cc:2272] T 2e1b5d40df944767ab310e2bd822d5b0 P 027e191e31da4af2bc83c5ddc0c15d05 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.034900 29280 tablet_replica.cc:333] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.036630 29280 raft_consensus.cc:2243] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.038293 29280 raft_consensus.cc:2272] T 1640dd5756f749fd8546ca110299cc59 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.042297 29280 tablet_replica.cc:333] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.043233 29280 raft_consensus.cc:2243] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.045806 29280 raft_consensus.cc:2272] T 290c8f7e148a4bd4b296c97e9c6552c4 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.048910 29280 tablet_replica.cc:333] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.049721 29280 raft_consensus.cc:2243] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.052376 29280 raft_consensus.cc:2272] T 9005afb08e044cf08de618af26cfcf42 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.055495 29280 tablet_replica.cc:333] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.056259 29280 raft_consensus.cc:2243] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.058604 29280 raft_consensus.cc:2272] T 9677253d313a48abb6e352b42a3fae88 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.062633 29280 tablet_replica.cc:333] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.063515 29280 raft_consensus.cc:2243] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.065595 29280 raft_consensus.cc:2272] T 3320ad6cc8ec4755a5fcf40ada291b5a P 027e191e31da4af2bc83c5ddc0c15d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.069069 29280 tablet_replica.cc:333] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.069859 29280 raft_consensus.cc:2243] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:12:20.073385 31116 consensus_peers.cc:597] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.072758 29280 raft_consensus.cc:2272] T 3d72c167bcb8445c86bea233eccc0132 P 027e191e31da4af2bc83c5ddc0c15d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.078480 29280 tablet_replica.cc:333] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.079316 29280 raft_consensus.cc:2243] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.081110 29280 raft_consensus.cc:2272] T ba4c05796efa42489d11c8a49ba476ad P 027e191e31da4af2bc83c5ddc0c15d05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.084141 29280 tablet_replica.cc:333] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.084931 29280 raft_consensus.cc:2243] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.087096 29280 raft_consensus.cc:2272] T b32c699f55944c90a3ffe996af3951b7 P 027e191e31da4af2bc83c5ddc0c15d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.090999 29280 tablet_replica.cc:333] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.092002 29280 raft_consensus.cc:2243] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.093204 29280 raft_consensus.cc:2272] T 3e3cb6475718492e846dc8fdd3f4e538 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.096626 29280 tablet_replica.cc:333] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.097499 29280 raft_consensus.cc:2243] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.099606 29280 raft_consensus.cc:2272] T 2c7503235ec641f7b8929ebbf8124038 P 027e191e31da4af2bc83c5ddc0c15d05 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.102996 29280 tablet_replica.cc:333] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.103770 29280 raft_consensus.cc:2243] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.105463 29280 raft_consensus.cc:2272] T fadcc5b6fd8a4ea992fa104050ad1a12 P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.108475 29280 tablet_replica.cc:333] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.109746 29280 raft_consensus.cc:2243] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.111163 29280 raft_consensus.cc:2272] T 6b47e3764d6643f0a7629098b7f19d34 P 027e191e31da4af2bc83c5ddc0c15d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.114142 29280 tablet_replica.cc:333] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.114966 29280 raft_consensus.cc:2243] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:20.115777 29280 raft_consensus.cc:2272] T 0d1e11d913434fda8959a45d48772c1f P 027e191e31da4af2bc83c5ddc0c15d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.118981 29280 tablet_replica.cc:333] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.119982 29280 raft_consensus.cc:2243] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.120054  4618 raft_consensus.cc:493] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.121490 29280 raft_consensus.cc:2272] T f9ed30c25a2940f2b0a16f63a49eb1a6 P 027e191e31da4af2bc83c5ddc0c15d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:20.120826  4618 raft_consensus.cc:515] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.125167  4618 leader_election.cc:290] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:20.125314 29280 tablet_replica.cc:333] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05: stopping tablet replica
I20260709 13:12:20.126255 29280 raft_consensus.cc:2243] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:20.127890 29280 raft_consensus.cc:2272] T cb15b3fc088e4285aec0576f22ecb481 P 027e191e31da4af2bc83c5ddc0c15d05 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:20.130187 31117 leader_election.cc:336] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:20.133288 31116 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:20.160321 31116 leader_election.cc:336] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:20.165540 31116 leader_election.cc:304] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.166653  4634 raft_consensus.cc:2749] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:20.256424 30526 connection.cc:466] server connection from 127.0.0.1:53492 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53492 (request call id 1979) could send its response
I20260709 13:12:20.485253  4634 raft_consensus.cc:493] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.485962  4634 raft_consensus.cc:515] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.489246  4634 leader_election.cc:290] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:20.492542 31117 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:20.494443 31116 leader_election.cc:336] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:20.494897 31116 leader_election.cc:304] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.496045  4634 raft_consensus.cc:2749] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:20.566368  4634 raft_consensus.cc:493] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.568535  4634 raft_consensus.cc:515] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.573493  4634 leader_election.cc:290] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:20.577720 31116 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:20.579361 31118 leader_election.cc:336] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:20.579766 31118 leader_election.cc:304] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.580983  4634 raft_consensus.cc:2749] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:20.634788  4634 raft_consensus.cc:493] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.635385  4634 raft_consensus.cc:515] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.639199  4634 leader_election.cc:290] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:20.643153 31116 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:20.646802 31117 leader_election.cc:336] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:20.647305 31117 leader_election.cc:304] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.648135  4634 raft_consensus.cc:2749] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:20.680653  4618 raft_consensus.cc:493] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.681275  4618 raft_consensus.cc:515] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.683462  4618 leader_election.cc:290] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
I20260709 13:12:20.689458  4634 raft_consensus.cc:493] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.690057  4634 raft_consensus.cc:515] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.692896  4634 leader_election.cc:290] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:20.694099 31116 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:20.704807 31117 leader_election.cc:336] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:20.705602 31117 leader_election.cc:304] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.706496  4634 raft_consensus.cc:2749] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:20.707297 31116 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:20.708765 31117 leader_election.cc:336] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:20.709156 31117 leader_election.cc:304] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.709828  4634 raft_consensus.cc:2749] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.712145 31117 consensus_peers.cc:597] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:20.896324  4634 raft_consensus.cc:493] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.897053  4634 raft_consensus.cc:515] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.899472  4634 leader_election.cc:290] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247)
W20260709 13:12:20.904395 31117 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:20.904929 31116 leader_election.cc:336] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:20.905313 31116 leader_election.cc:304] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:20.906124  4634 raft_consensus.cc:2749] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:20.934918 31116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111) [suppressed 563 similar messages]
I20260709 13:12:20.941620  4634 raft_consensus.cc:493] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ce312b0d7a1747c8898a748f8d76df81)
I20260709 13:12:20.942339  4634 raft_consensus.cc:515] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } attrs { replace: true } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.946113  4634 leader_election.cc:290] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:20.953879 31118 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
W20260709 13:12:20.955827 31116 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:20.957620 31116 leader_election.cc:304] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:20.958492 31117 leader_election.cc:336] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:20.958962  4634 raft_consensus.cc:2749] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.990638  4634 raft_consensus.cc:493] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:20.991344  4634 raft_consensus.cc:515] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:20.994450  4634 leader_election.cc:290] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:20.999799 31118 leader_election.cc:336] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
W20260709 13:12:21.003089 31117 leader_election.cc:336] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:21.003451 31117 leader_election.cc:304] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:21.004038  4634 raft_consensus.cc:2749] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:21.038213 31117 consensus_peers.cc:597] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.044275 31117 consensus_peers.cc:597] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:21.060711  4634 raft_consensus.cc:493] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.061515  4634 raft_consensus.cc:515] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.064594  4634 leader_election.cc:290] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.068295 31116 leader_election.cc:336] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:21.069281 31118 leader_election.cc:336] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.069628 31118 leader_election.cc:304] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.070222  4634 raft_consensus.cc:2749] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:21.126163  4634 raft_consensus.cc:493] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.126924  4634 raft_consensus.cc:515] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.128702  4618 raft_consensus.cc:493] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.129298  4618 raft_consensus.cc:515] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.130868  4634 leader_election.cc:290] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:21.131330  4618 leader_election.cc:290] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
I20260709 13:12:21.134393  4618 raft_consensus.cc:493] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.135047  4618 raft_consensus.cc:515] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.137991  4618 leader_election.cc:290] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.135825 31116 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:21.140595  4634 raft_consensus.cc:493] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.143246  4634 raft_consensus.cc:515] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } attrs { replace: true } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
W20260709 13:12:21.141660 31117 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:21.144680 31117 leader_election.cc:304] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
W20260709 13:12:21.145463 31117 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:21.146425  4618 raft_consensus.cc:2749] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:21.151664  4634 leader_election.cc:290] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.152824 31118 leader_election.cc:336] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
W20260709 13:12:21.153515 31117 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
W20260709 13:12:21.154799 31118 leader_election.cc:336] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.155267 31118 leader_election.cc:304] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
W20260709 13:12:21.153664 31116 leader_election.cc:336] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:21.156253 31118 leader_election.cc:336] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.156643 31118 leader_election.cc:304] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.158564  4618 raft_consensus.cc:2749] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:21.159257  4618 raft_consensus.cc:2749] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:21.164075 31116 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
I20260709 13:12:21.164628 31116 leader_election.cc:304] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 0472fa7187444a91b443058ef89fceb9, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.165755  4634 raft_consensus.cc:2749] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:21.166749 31118 leader_election.cc:336] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
W20260709 13:12:21.170228 31117 consensus_peers.cc:597] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.172451 31117 consensus_peers.cc:597] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:21.179021  4634 raft_consensus.cc:493] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.179710  4634 raft_consensus.cc:515] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.182060  4634 leader_election.cc:290] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.187394 31116 leader_election.cc:336] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:21.188555 31118 leader_election.cc:336] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.189007 31118 leader_election.cc:304] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.190129  4634 raft_consensus.cc:2749] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:21.193797 31117 consensus_peers.cc:597] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.226020 31117 consensus_peers.cc:597] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:21.259735 31117 consensus_peers.cc:597] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.273422 31117 consensus_peers.cc:597] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.273772 29280 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30581)
W20260709 13:12:21.283378 31117 consensus_peers.cc:597] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:21.338860  4618 raft_consensus.cc:493] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.339488  4618 raft_consensus.cc:515] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0472fa7187444a91b443058ef89fceb9" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33099 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.341707  4618 leader_election.cc:290] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.346441 31118 leader_election.cc:336] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
W20260709 13:12:21.346943 31117 leader_election.cc:336] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:21.347375 31117 leader_election.cc:304] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, 0472fa7187444a91b443058ef89fceb9
I20260709 13:12:21.348034  4618 raft_consensus.cc:2749] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:21.388159  4618 raft_consensus.cc:493] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.388742  4618 raft_consensus.cc:515] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.390890  4618 leader_election.cc:290] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.395118 31116 leader_election.cc:336] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:21.395967 31118 leader_election.cc:336] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.396368 31118 leader_election.cc:304] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.397027  4618 raft_consensus.cc:2749] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:21.496831  4618 raft_consensus.cc:493] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 027e191e31da4af2bc83c5ddc0c15d05)
I20260709 13:12:21.497403  4618 raft_consensus.cc:515] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ce312b0d7a1747c8898a748f8d76df81" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 33247 } } peers { permanent_uuid: "027e191e31da4af2bc83c5ddc0c15d05" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 43783 } } peers { permanent_uuid: "19556a24b91d452d98668a3709fbc29d" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 39627 } attrs { promote: false } }
I20260709 13:12:21.499800  4618 leader_election.cc:290] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247), 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783)
W20260709 13:12:21.504629 31117 consensus_peers.cc:597] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.505507 31116 leader_election.cc:336] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111)
W20260709 13:12:21.506978 31118 leader_election.cc:336] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 027e191e31da4af2bc83c5ddc0c15d05 (127.28.152.3:43783): Network error: Client connection negotiation failed: client connection to 127.28.152.3:43783: connect: Connection refused (error 111)
I20260709 13:12:21.507382 31118 leader_election.cc:304] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19556a24b91d452d98668a3709fbc29d; no voters: 027e191e31da4af2bc83c5ddc0c15d05, ce312b0d7a1747c8898a748f8d76df81
I20260709 13:12:21.508070  4618 raft_consensus.cc:2749] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:21.643889 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
W20260709 13:12:21.681119 31117 consensus_peers.cc:597] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d -> Peer 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): Couldn't send request to peer 0472fa7187444a91b443058ef89fceb9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:21.797309 29280 tablet_server.cc:179] TabletServer@127.28.152.4:0 shutting down...
W20260709 13:12:21.838088 31116 consensus_peers.cc:597] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d -> Peer ce312b0d7a1747c8898a748f8d76df81 (127.28.152.2:33247): Couldn't send request to peer ce312b0d7a1747c8898a748f8d76df81. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:33247: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:21.857388 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:21.858453 29280 tablet_replica.cc:333] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.859869 29280 raft_consensus.cc:2243] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.860951 29280 raft_consensus.cc:2272] T 3d72c167bcb8445c86bea233eccc0132 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.864600 29280 tablet_replica.cc:333] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.865631 29280 raft_consensus.cc:2243] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.866480 29280 raft_consensus.cc:2272] T eb1e5995c7614e97bf058caeaa374e54 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.869047 29280 tablet_replica.cc:333] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.869742 29280 raft_consensus.cc:2243] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.871147 29280 pending_rounds.cc:70] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Trying to abort 1 pending ops.
I20260709 13:12:21.871403 29280 pending_rounds.cc:77] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305636818749894656 op_type: NO_OP noop_request { }
I20260709 13:12:21.871887 29280 raft_consensus.cc:2889] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:21.872335 29280 raft_consensus.cc:2272] T 290c8f7e148a4bd4b296c97e9c6552c4 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.875190 29280 tablet_replica.cc:333] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.875968 29280 raft_consensus.cc:2243] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.876781 29280 raft_consensus.cc:2272] T 497264cf15754f0e9029cd057a54a7fb P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.879480 29280 tablet_replica.cc:333] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.880159 29280 raft_consensus.cc:2243] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.881052 29280 raft_consensus.cc:2272] T 88cc3e301acf441dab14eb0be7a54db1 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.883723 29280 tablet_replica.cc:333] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.884344 29280 raft_consensus.cc:2243] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.885463 29280 raft_consensus.cc:2272] T 3d97aadeef4e4fb9b4f6d566a7908278 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.888064 29280 tablet_replica.cc:333] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.888767 29280 raft_consensus.cc:2243] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.889596 29280 raft_consensus.cc:2272] T cc136e9e62d1428b88f928b6ccef8316 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.892218 29280 tablet_replica.cc:333] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.892788 29280 raft_consensus.cc:2243] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.893298 29280 raft_consensus.cc:2272] T 1640dd5756f749fd8546ca110299cc59 P 19556a24b91d452d98668a3709fbc29d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.896021 29280 tablet_replica.cc:333] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.896596 29280 raft_consensus.cc:2243] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.897198 29280 raft_consensus.cc:2272] T 0500eacf70c44cb5bb9527f23aea9b1d P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.899595 29280 tablet_replica.cc:333] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.900200 29280 raft_consensus.cc:2243] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.901074 29280 raft_consensus.cc:2272] T 406b169640e341629c55637d07dd3d47 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.903764 29280 tablet_replica.cc:333] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.904400 29280 raft_consensus.cc:2243] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.905260 29280 raft_consensus.cc:2272] T ba4c05796efa42489d11c8a49ba476ad P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.907608 29280 tablet_replica.cc:333] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.908142 29280 raft_consensus.cc:2243] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.908978 29280 raft_consensus.cc:2272] T d34313dd02b6470d81b73b13d5cf157f P 19556a24b91d452d98668a3709fbc29d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.911019 29280 tablet_replica.cc:333] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.911595 29280 raft_consensus.cc:2243] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.912417 29280 raft_consensus.cc:2272] T 2e1b5d40df944767ab310e2bd822d5b0 P 19556a24b91d452d98668a3709fbc29d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.914474 29280 tablet_replica.cc:333] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.915107 29280 raft_consensus.cc:2243] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.915580 29280 raft_consensus.cc:2272] T 82023e2c5e484095a622dab241c66cd3 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.917748 29280 tablet_replica.cc:333] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.918263 29280 raft_consensus.cc:2243] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.918813 29280 raft_consensus.cc:2272] T 3320ad6cc8ec4755a5fcf40ada291b5a P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.920581 29280 tablet_replica.cc:333] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.921149 29280 raft_consensus.cc:2243] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.921648 29280 raft_consensus.cc:2272] T 5f0025bdb2b44775bcdb4ec9702926aa P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.923820 29280 tablet_replica.cc:333] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.924458 29280 raft_consensus.cc:2243] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.925096 29280 raft_consensus.cc:2272] T ed91464a4fda479c9d2d6dfa8ca92193 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.927497 29280 tablet_replica.cc:333] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.928057 29280 raft_consensus.cc:2243] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.928839 29280 raft_consensus.cc:2272] T d909a45f39c448af875585d7299103f6 P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.931126 29280 tablet_replica.cc:333] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.931643 29280 raft_consensus.cc:2243] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.932542 29280 raft_consensus.cc:2272] T 6b385b950a414bce8902269df58e5bf4 P 19556a24b91d452d98668a3709fbc29d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.934654 29280 tablet_replica.cc:333] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.935185 29280 raft_consensus.cc:2243] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.936084 29280 raft_consensus.cc:2272] T 61d4ac70a018496ba2020b90313c013e P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.938196 29280 tablet_replica.cc:333] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.938735 29280 raft_consensus.cc:2243] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.939538 29280 raft_consensus.cc:2272] T 7df93ef89d784f0bab73ca5a5d399cc0 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.941545 29280 tablet_replica.cc:333] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.942062 29280 raft_consensus.cc:2243] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.942991 29280 raft_consensus.cc:2272] T e4f6773aa18b4ca9a0d9829e2021b82e P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.945315 29280 tablet_replica.cc:333] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.945854 29280 raft_consensus.cc:2243] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.946332 29280 raft_consensus.cc:2272] T b5b1451644b74f359b2aae8ebfaf45d3 P 19556a24b91d452d98668a3709fbc29d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.948402 29280 tablet_replica.cc:333] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.948945 29280 raft_consensus.cc:2243] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.949841 29280 raft_consensus.cc:2272] T 9632f38fdbf84c58a587a59a81f394ce P 19556a24b91d452d98668a3709fbc29d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.951895 29280 tablet_replica.cc:333] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.952415 29280 raft_consensus.cc:2243] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.953243 29280 raft_consensus.cc:2272] T 913c2d18b15848cd98ab0ff37874cc23 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.955268 29280 tablet_replica.cc:333] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.955770 29280 raft_consensus.cc:2243] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.956305 29280 raft_consensus.cc:2272] T 567508f2962f473b8fac20c97a240f35 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.958230 29280 tablet_replica.cc:333] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.958783 29280 raft_consensus.cc:2243] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.959677 29280 raft_consensus.cc:2272] T f2c4e8b43b5248a6b8811c7335522edb P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.961561 29280 tablet_replica.cc:333] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.962200 29280 raft_consensus.cc:2243] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.963179 29280 raft_consensus.cc:2272] T 3d180da17ba548e0ab1ebdfa7dfc1f0a P 19556a24b91d452d98668a3709fbc29d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.965231 29280 tablet_replica.cc:333] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.965725 29280 raft_consensus.cc:2243] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.966221 29280 raft_consensus.cc:2272] T e809575d6fe84ef3afe48c9cf7532868 P 19556a24b91d452d98668a3709fbc29d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.968075 29280 tablet_replica.cc:333] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.968551 29280 raft_consensus.cc:2243] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.969489 29280 raft_consensus.cc:2272] T 2ba0b89a2fc4499a917166e3b4b88cf9 P 19556a24b91d452d98668a3709fbc29d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.971568 29280 tablet_replica.cc:333] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.972194 29280 raft_consensus.cc:2243] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.972728 29280 raft_consensus.cc:2272] T 9005afb08e044cf08de618af26cfcf42 P 19556a24b91d452d98668a3709fbc29d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.975013 29280 tablet_replica.cc:333] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.975633 29280 raft_consensus.cc:2243] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.976102 29280 raft_consensus.cc:2272] T 9677253d313a48abb6e352b42a3fae88 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.977944 29280 tablet_replica.cc:333] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.978470 29280 raft_consensus.cc:2243] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.979382 29280 raft_consensus.cc:2272] T 7846efa5da12423cb3343cd5f3483869 P 19556a24b91d452d98668a3709fbc29d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.981402 29280 tablet_replica.cc:333] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.981906 29280 raft_consensus.cc:2243] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.982324 29280 raft_consensus.cc:2272] T 02b91286dc8d477e8ebec973b266b7f0 P 19556a24b91d452d98668a3709fbc29d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.984383 29280 tablet_replica.cc:333] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.984887 29280 raft_consensus.cc:2243] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.985363 29280 raft_consensus.cc:2272] T c4b473589cd94be59022580022e2de00 P 19556a24b91d452d98668a3709fbc29d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.988906 29280 tablet_replica.cc:333] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d: stopping tablet replica
I20260709 13:12:21.989373 29280 raft_consensus.cc:2243] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.990222 29280 raft_consensus.cc:2272] T 2c7503235ec641f7b8929ebbf8124038 P 19556a24b91d452d98668a3709fbc29d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:22.249737 29280 tablet_server.cc:196] TabletServer@127.28.152.4:0 shutdown complete.
I20260709 13:12:22.318075 29280 master.cc:562] Master@127.28.152.62:45705 shutting down...
W20260709 13:12:22.364674 30357 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:22.364949 30357 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:22.365199 30357 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:27.364670 30294 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111) [suppressed 94 similar messages]
W20260709 13:12:27.367726 30294 catalog_manager.cc:4755] TS 0472fa7187444a91b443058ef89fceb9 (127.28.152.1:33099): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 290c8f7e148a4bd4b296c97e9c6552c4: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33099: connect: Connection refused (error 111)
I20260709 13:12:27.965678 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.966513 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.966926 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 47740a6b78644dffa37c97c591d3d3e7: stopping tablet replica
I20260709 13:12:28.186393 29280 master.cc:584] Master@127.28.152.62:45705 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (205554 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:28.289427 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:37459
I20260709 13:12:28.290611 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:28.296484  4660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.296581  4659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.297173  4662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.298475 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:28.301427 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:28.301620 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:28.301823 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602748301792 us; error 0 us; skew 500 ppm
I20260709 13:12:28.302346 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:28.304785 29280 webserver.cc:533] Webserver started at http://127.28.152.62:34613/ using document root <none> and password file <none>
I20260709 13:12:28.305274 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:28.305460 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:28.305754 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:28.307385 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "8c8223cba6214387b9330012dfde071d"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.311619 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:28.314805  4667 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.315522 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:28.315810 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "8c8223cba6214387b9330012dfde071d"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.316102 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:28.332180 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:28.333423 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:28.371157 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:37459
I20260709 13:12:28.371239  4718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:37459 every 8 connection(s)
I20260709 13:12:28.375110  4719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:28.385591  4719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d: Bootstrap starting.
I20260709 13:12:28.390472  4719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:28.394632  4719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d: No bootstrap required, opened a new log
I20260709 13:12:28.397222  4719 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER }
I20260709 13:12:28.397707  4719 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:28.397977  4719 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8223cba6214387b9330012dfde071d, State: Initialized, Role: FOLLOWER
I20260709 13:12:28.398581  4719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER }
I20260709 13:12:28.399048  4719 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:28.399267  4719 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:28.399528  4719 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.404063  4719 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER }
I20260709 13:12:28.404572  4719 leader_election.cc:304] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c8223cba6214387b9330012dfde071d; no voters: 
I20260709 13:12:28.405730  4719 leader_election.cc:290] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:28.406072  4722 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:28.407500  4722 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 1 LEADER]: Becoming Leader. State: Replica: 8c8223cba6214387b9330012dfde071d, State: Running, Role: LEADER
I20260709 13:12:28.408237  4722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER }
I20260709 13:12:28.408782  4719 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:28.414637  4724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c8223cba6214387b9330012dfde071d. Latest consensus state: current_term: 1 leader_uuid: "8c8223cba6214387b9330012dfde071d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER } }
I20260709 13:12:28.415024  4723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c8223cba6214387b9330012dfde071d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c8223cba6214387b9330012dfde071d" member_type: VOTER } }
I20260709 13:12:28.416117  4724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:28.416185  4723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:28.421753  4731 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:28.429647  4731 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:28.430616 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:28.438616  4731 catalog_manager.cc:1383] Generated new cluster ID: cf74e6cc1a4841aabb57685e26ba1ff2
I20260709 13:12:28.438956  4731 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:28.455466  4731 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:28.456736  4731 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:28.468663  4731 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d: Generated new TSK 0
I20260709 13:12:28.469318  4731 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:28.497102 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:28.503391  4740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.504904  4741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.506014  4743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.507853 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:28.509641 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:28.509855 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:28.510031 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602748510013 us; error 0 us; skew 500 ppm
I20260709 13:12:28.510614 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:28.512989 29280 webserver.cc:533] Webserver started at http://127.28.152.1:37825/ using document root <none> and password file <none>
I20260709 13:12:28.513532 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:28.513753 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:28.514022 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:28.515538 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "f6c95e5d9485488f9de4ffe24035c81d"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.520274 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:28.523635  4748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.524432 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:28.524735 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "f6c95e5d9485488f9de4ffe24035c81d"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.525065 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:28.537619 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:28.538795 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:28.540194 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:28.542387 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:28.542595 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.542856 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:28.543049 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.582831 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:33395
I20260709 13:12:28.582947  4810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:33395 every 8 connection(s)
I20260709 13:12:28.587841 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:28.595516  4815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.597608  4816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.598565  4818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.599830 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:28.602108 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:28.602373 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:28.602588 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602748602565 us; error 0 us; skew 500 ppm
I20260709 13:12:28.603318 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:28.605253  4811 heartbeater.cc:344] Connected to a master server at 127.28.152.62:37459
I20260709 13:12:28.605647  4811 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:28.606082 29280 webserver.cc:533] Webserver started at http://127.28.152.2:34123/ using document root <none> and password file <none>
I20260709 13:12:28.606614 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:28.606546  4811 heartbeater.cc:507] Master 127.28.152.62:37459 requested a full tablet report, sending...
I20260709 13:12:28.607070 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:28.607383 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:28.608701 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "7d069c6c6db44e9882ec432292c00563"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.609180  4684 ts_manager.cc:194] Registered new tserver with Master: f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:28.611866  4684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52322
I20260709 13:12:28.614945 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:28.618547  4823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.619434 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:28.619776 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "7d069c6c6db44e9882ec432292c00563"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.620080 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:28.665998 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:28.667342 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:28.668809 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:28.671025 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:28.671263 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.671502 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:28.671679 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.711649 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:43901
I20260709 13:12:28.711771  4885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:43901 every 8 connection(s)
I20260709 13:12:28.716612 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:28.724128  4889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.725294  4890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.728396 29280 server_base.cc:1061] running on GCE node
W20260709 13:12:28.729205  4892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.729882  4886 heartbeater.cc:344] Connected to a master server at 127.28.152.62:37459
I20260709 13:12:28.730275  4886 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:28.731145  4886 heartbeater.cc:507] Master 127.28.152.62:37459 requested a full tablet report, sending...
I20260709 13:12:28.731405 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:28.731707 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:28.731920 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602748731900 us; error 0 us; skew 500 ppm
I20260709 13:12:28.732609 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:28.733505  4684 ts_manager.cc:194] Registered new tserver with Master: 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:28.735427 29280 webserver.cc:533] Webserver started at http://127.28.152.3:36671/ using document root <none> and password file <none>
I20260709 13:12:28.735567  4684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52334
I20260709 13:12:28.736099 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:28.736384 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:28.736719 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:28.738294 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.742614 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:12:28.746008  4897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.746853 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:28.747171 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.747424 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:28.764679 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:28.765908 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:28.767447 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:28.769610 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:28.769850 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.770095 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:28.770283 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.811941 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:41787
I20260709 13:12:28.812047  4959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:41787 every 8 connection(s)
I20260709 13:12:28.816659 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:28.824095  4963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:28.825174  4964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.827804 29280 server_base.cc:1061] running on GCE node
W20260709 13:12:28.828562  4967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:28.829550  4960 heartbeater.cc:344] Connected to a master server at 127.28.152.62:37459
I20260709 13:12:28.829731 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:28.830009  4960 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:28.830010 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:28.830565 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602748830543 us; error 0 us; skew 500 ppm
I20260709 13:12:28.831193  4960 heartbeater.cc:507] Master 127.28.152.62:37459 requested a full tablet report, sending...
I20260709 13:12:28.831385 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:28.833582  4684 ts_manager.cc:194] Registered new tserver with Master: f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:28.834174 29280 webserver.cc:533] Webserver started at http://127.28.152.4:41759/ using document root <none> and password file <none>
I20260709 13:12:28.834789 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:28.835000 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:28.835274 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:28.835229  4684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52338
I20260709 13:12:28.836886 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-3-root/instance:
uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.841439 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:28.844769  4971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.845549 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:28.845875 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:28.846176 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:28.878338 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:28.879731 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:28.881198 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:28.883447 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:28.883671 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.883924 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:28.884101 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:28.926422 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.4:34929
I20260709 13:12:28.926524  5033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.4:34929 every 8 connection(s)
I20260709 13:12:28.940225  5034 heartbeater.cc:344] Connected to a master server at 127.28.152.62:37459
I20260709 13:12:28.940570  5034 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:28.941334  5034 heartbeater.cc:507] Master 127.28.152.62:37459 requested a full tablet report, sending...
I20260709 13:12:28.943146  4684 ts_manager.cc:194] Registered new tserver with Master: e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:28.943403 29280 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013477785s
I20260709 13:12:28.944520  4684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52352
I20260709 13:12:28.970516  4684 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52354:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:29.210286  4925 tablet_service.cc:1511] Processing CreateTablet for tablet af9dc48f4b54413583c9249d86ec89af (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:29.210915  4851 tablet_service.cc:1511] Processing CreateTablet for tablet af9dc48f4b54413583c9249d86ec89af (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:29.212054  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dc48f4b54413583c9249d86ec89af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.212462  4851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dc48f4b54413583c9249d86ec89af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.213235  4924 tablet_service.cc:1511] Processing CreateTablet for tablet e325c8dae3b241c0b43a7b965cac7191 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:29.214627  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e325c8dae3b241c0b43a7b965cac7191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.216199  4850 tablet_service.cc:1511] Processing CreateTablet for tablet 7281a21402c24e61b74acfc1564a4c8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:29.217890  4850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7281a21402c24e61b74acfc1564a4c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.223775  4776 tablet_service.cc:1511] Processing CreateTablet for tablet af9dc48f4b54413583c9249d86ec89af (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:29.225272  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dc48f4b54413583c9249d86ec89af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.236990  4775 tablet_service.cc:1511] Processing CreateTablet for tablet 7281a21402c24e61b74acfc1564a4c8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:29.238979  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7281a21402c24e61b74acfc1564a4c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.248134  5054 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:29.248879  4774 tablet_service.cc:1511] Processing CreateTablet for tablet e325c8dae3b241c0b43a7b965cac7191 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:29.250517  4774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e325c8dae3b241c0b43a7b965cac7191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.254302  4849 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d8d1af32d4333bfb27a527def8b9c (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:29.256403  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d8d1af32d4333bfb27a527def8b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.259462  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d8d1af32d4333bfb27a527def8b9c (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:29.261193  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d8d1af32d4333bfb27a527def8b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.261278  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce5374ea4094a1da56f0705db711237 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:29.262668  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce5374ea4094a1da56f0705db711237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.268841  4848 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce5374ea4094a1da56f0705db711237 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:29.270334  4848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce5374ea4094a1da56f0705db711237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.271742  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce5374ea4094a1da56f0705db711237 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:29.273180  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce5374ea4094a1da56f0705db711237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.273272  4772 tablet_service.cc:1511] Processing CreateTablet for tablet 3481089e907345869da25ad79e97a113 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:29.274653  4772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3481089e907345869da25ad79e97a113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.276508  4922 tablet_service.cc:1511] Processing CreateTablet for tablet dd270a9c7b814d829f34285ded0099eb (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:29.277932  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd270a9c7b814d829f34285ded0099eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.280440  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 3481089e907345869da25ad79e97a113 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:29.281829  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3481089e907345869da25ad79e97a113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.284039  4771 tablet_service.cc:1511] Processing CreateTablet for tablet dd270a9c7b814d829f34285ded0099eb (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:29.285466  4771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd270a9c7b814d829f34285ded0099eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.285740  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 6936f88d50994becb09fad0cbb8de81a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:29.287194  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6936f88d50994becb09fad0cbb8de81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.288337  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 6936f88d50994becb09fad0cbb8de81a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:29.291095  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6936f88d50994becb09fad0cbb8de81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.303778  4770 tablet_service.cc:1511] Processing CreateTablet for tablet dfd7218c035c4f08a2f3c9ae35ee1279 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:29.305287  4770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd7218c035c4f08a2f3c9ae35ee1279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.321698  4850 tablet_service.cc:1511] Processing CreateTablet for tablet dfd7218c035c4f08a2f3c9ae35ee1279 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:29.323220  4850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd7218c035c4f08a2f3c9ae35ee1279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.328706  5054 tablet_bootstrap.cc:654] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.333089  4920 tablet_service.cc:1511] Processing CreateTablet for tablet dfd7218c035c4f08a2f3c9ae35ee1279 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:29.334558  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd7218c035c4f08a2f3c9ae35ee1279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.351145  5055 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:29.355940  4999 tablet_service.cc:1511] Processing CreateTablet for tablet 7281a21402c24e61b74acfc1564a4c8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:29.357404  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7281a21402c24e61b74acfc1564a4c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.358516  5055 tablet_bootstrap.cc:654] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.359640  5056 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:29.360030  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d8d1af32d4333bfb27a527def8b9c (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:29.361445  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d8d1af32d4333bfb27a527def8b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.366317  4995 tablet_service.cc:1511] Processing CreateTablet for tablet dd270a9c7b814d829f34285ded0099eb (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:29.367738  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd270a9c7b814d829f34285ded0099eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.368472  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 95c66086fcb84985afe1bf786ed3726e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:29.370285  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c66086fcb84985afe1bf786ed3726e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.370991  4996 tablet_service.cc:1511] Processing CreateTablet for tablet 3481089e907345869da25ad79e97a113 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:29.372298  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3481089e907345869da25ad79e97a113. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.372192  4850 tablet_service.cc:1511] Processing CreateTablet for tablet 95057452fb6c47048344f8f068d7c0d1 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:29.373531  4850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95057452fb6c47048344f8f068d7c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.365156  4998 tablet_service.cc:1511] Processing CreateTablet for tablet e325c8dae3b241c0b43a7b965cac7191 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:29.375494  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e325c8dae3b241c0b43a7b965cac7191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.374518  4772 tablet_service.cc:1511] Processing CreateTablet for tablet 95c66086fcb84985afe1bf786ed3726e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:29.377022  4772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c66086fcb84985afe1bf786ed3726e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.364899  4770 tablet_service.cc:1511] Processing CreateTablet for tablet 52544a98965242fcad8616ff2cc4dc8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:29.365854  4851 tablet_service.cc:1511] Processing CreateTablet for tablet 52544a98965242fcad8616ff2cc4dc8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:29.380623  4851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52544a98965242fcad8616ff2cc4dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.381616  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 6936f88d50994becb09fad0cbb8de81a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:29.383541  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6936f88d50994becb09fad0cbb8de81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.388034  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 52544a98965242fcad8616ff2cc4dc8a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:29.389935  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52544a98965242fcad8616ff2cc4dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.393067  4992 tablet_service.cc:1511] Processing CreateTablet for tablet 95c66086fcb84985afe1bf786ed3726e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:29.395081  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c66086fcb84985afe1bf786ed3726e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.416572  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 95057452fb6c47048344f8f068d7c0d1 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:29.417972  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95057452fb6c47048344f8f068d7c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.422679  4770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52544a98965242fcad8616ff2cc4dc8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:29.425251  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:29.427620  5056 tablet_bootstrap.cc:654] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.427425  4991 tablet_service.cc:1511] Processing CreateTablet for tablet 95057452fb6c47048344f8f068d7c0d1 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:29.428886  4991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95057452fb6c47048344f8f068d7c0d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.449189  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 102e1754129b4dea9a2dab06dbab54c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:29.453280  5054 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:29.453843  5054 ts_tablet_manager.cc:1403] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.004s
I20260709 13:12:29.456902  5054 raft_consensus.cc:359] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.457625  5054 raft_consensus.cc:385] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.457899  5054 raft_consensus.cc:740] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.458611  5054 consensus_queue.cc:260] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.460284  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 102e1754129b4dea9a2dab06dbab54c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:29.471045  4922 tablet_service.cc:1511] Processing CreateTablet for tablet 102e1754129b4dea9a2dab06dbab54c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:29.473034  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102e1754129b4dea9a2dab06dbab54c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.472949  4925 tablet_service.cc:1511] Processing CreateTablet for tablet ccd276985af7409ea9d00bf0d850b3b2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:29.474471  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd276985af7409ea9d00bf0d850b3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.474380  4990 tablet_service.cc:1511] Processing CreateTablet for tablet ccd276985af7409ea9d00bf0d850b3b2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:29.475940  4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd276985af7409ea9d00bf0d850b3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.476629  4771 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5a1385cb5e4ceea7a319f6861603a7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:29.476783  4849 tablet_service.cc:1511] Processing CreateTablet for tablet a2ea7c05d7854df3bd11f18d32aed4e0 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:29.481969  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ea7c05d7854df3bd11f18d32aed4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.481969  4771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5a1385cb5e4ceea7a319f6861603a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.484076  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102e1754129b4dea9a2dab06dbab54c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.480513  4919 tablet_service.cc:1511] Processing CreateTablet for tablet a2ea7c05d7854df3bd11f18d32aed4e0 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:29.485183  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ea7c05d7854df3bd11f18d32aed4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.480430  4776 tablet_service.cc:1511] Processing CreateTablet for tablet ccd276985af7409ea9d00bf0d850b3b2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:29.486728  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd276985af7409ea9d00bf0d850b3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.487809  4774 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb1376921f9451bbafdf0355341d793 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:29.489428  4774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb1376921f9451bbafdf0355341d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.493279  4848 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5a1385cb5e4ceea7a319f6861603a7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:29.500392  5055 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:29.500947  5055 ts_tablet_manager.cc:1403] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.150s	user 0.027s	sys 0.046s
I20260709 13:12:29.504127  5055 raft_consensus.cc:359] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:29.504899  5055 raft_consensus.cc:385] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.505299  5055 raft_consensus.cc:740] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.504961  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5a1385cb5e4ceea7a319f6861603a7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:29.508572  4845 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb1376921f9451bbafdf0355341d793 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:29.509933  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb1376921f9451bbafdf0355341d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.511936  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb1376921f9451bbafdf0355341d793 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:29.513345  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb1376921f9451bbafdf0355341d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.517515  4775 tablet_service.cc:1511] Processing CreateTablet for tablet 65e7df4527b14d3e9e9d026dca65d9b6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:29.518814  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e7df4527b14d3e9e9d026dca65d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.522249  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 65e7df4527b14d3e9e9d026dca65d9b6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:29.522433  5055 consensus_queue.cc:260] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:29.523648  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e7df4527b14d3e9e9d026dca65d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.530071  4848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5a1385cb5e4ceea7a319f6861603a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.525207  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102e1754129b4dea9a2dab06dbab54c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.539065  4886 heartbeater.cc:499] Master 127.28.152.62:37459 was elected leader, sending a full tablet report...
I20260709 13:12:29.536070  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5a1385cb5e4ceea7a319f6861603a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.563947  5055 ts_tablet_manager.cc:1434] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 13:12:29.565109  4998 tablet_service.cc:1511] Processing CreateTablet for tablet a2ea7c05d7854df3bd11f18d32aed4e0 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:29.566617  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ea7c05d7854df3bd11f18d32aed4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.569276  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 65e7df4527b14d3e9e9d026dca65d9b6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:29.572743  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e7df4527b14d3e9e9d026dca65d9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.580160  5054 ts_tablet_manager.cc:1434] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.008s
I20260709 13:12:29.581132  4960 heartbeater.cc:499] Master 127.28.152.62:37459 was elected leader, sending a full tablet report...
I20260709 13:12:29.587747  5055 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:29.603550  4849 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56e2153ec4421281afc2150b970668 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:29.604389  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56e2153ec4421281afc2150b970668 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:29.605472  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56e2153ec4421281afc2150b970668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.605515  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56e2153ec4421281afc2150b970668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.615623  5054 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:29.618983  4811 heartbeater.cc:499] Master 127.28.152.62:37459 was elected leader, sending a full tablet report...
I20260709 13:12:29.619079  4775 tablet_service.cc:1511] Processing CreateTablet for tablet b4e66b31d7944054bde6909f874d9531 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:29.625715  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e66b31d7944054bde6909f874d9531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.626003  5054 tablet_bootstrap.cc:654] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.601421  4992 tablet_service.cc:1511] Processing CreateTablet for tablet 62609ec3ccb34bd699d9ec237ef73fc7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:29.636698  5060 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.637265  5060 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:29.651837  5062 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:29.658150  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 62609ec3ccb34bd699d9ec237ef73fc7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:29.656608  5060 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:29.668876  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 62609ec3ccb34bd699d9ec237ef73fc7 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:29.679497  4924 tablet_service.cc:1511] Processing CreateTablet for tablet b4e66b31d7944054bde6909f874d9531 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:29.683383  5062 tablet_bootstrap.cc:654] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.690790  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62609ec3ccb34bd699d9ec237ef73fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.695269  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62609ec3ccb34bd699d9ec237ef73fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.703276  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 3b56e2153ec4421281afc2150b970668 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:29.704636  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b56e2153ec4421281afc2150b970668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.707831  5056 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:29.708366  5056 ts_tablet_manager.cc:1403] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.349s	user 0.022s	sys 0.017s
I20260709 13:12:29.715998  5056 raft_consensus.cc:359] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:29.716462  4887 tablet.cc:2406] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:29.716785  5056 raft_consensus.cc:385] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.717103  5056 raft_consensus.cc:740] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.717881  5056 consensus_queue.cc:260] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.718853  5055 tablet_bootstrap.cc:654] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.726107  5059 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.726895  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62609ec3ccb34bd699d9ec237ef73fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.726788  5059 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.733431  5059 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:29.739835  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e66b31d7944054bde6909f874d9531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.744815  4845 tablet_service.cc:1511] Processing CreateTablet for tablet b4e66b31d7944054bde6909f874d9531 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:29.749673  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e66b31d7944054bde6909f874d9531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.756333  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:29.758554  4826 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:29.759424  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 8903177763274513a4ded75b98ac1ea5 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:29.761076  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8903177763274513a4ded75b98ac1ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.761770  4775 tablet_service.cc:1511] Processing CreateTablet for tablet 8903177763274513a4ded75b98ac1ea5 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:29.763099  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8903177763274513a4ded75b98ac1ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.796008  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:29.797623  4827 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:29.798110  4827 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:29.798952  5055 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:29.799414  5055 ts_tablet_manager.cc:1403] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.212s	user 0.005s	sys 0.020s
I20260709 13:12:29.801748  5055 raft_consensus.cc:359] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.802225  5055 raft_consensus.cc:385] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.802426  5055 raft_consensus.cc:740] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.803128  5055 consensus_queue.cc:260] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.803591  5060 raft_consensus.cc:2749] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:29.808648  4848 tablet_service.cc:1511] Processing CreateTablet for tablet 8903177763274513a4ded75b98ac1ea5 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:29.812719  4848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8903177763274513a4ded75b98ac1ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.812574  4773 tablet_service.cc:1511] Processing CreateTablet for tablet abd842ad26db48e1aa55713f47a1fe66 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:29.817179  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd842ad26db48e1aa55713f47a1fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.815217  4924 tablet_service.cc:1511] Processing CreateTablet for tablet abd842ad26db48e1aa55713f47a1fe66 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:29.822523  4992 tablet_service.cc:1511] Processing CreateTablet for tablet abd842ad26db48e1aa55713f47a1fe66 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:29.825475  5054 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:29.824273  5056 ts_tablet_manager.cc:1434] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.021s
I20260709 13:12:29.821919  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd842ad26db48e1aa55713f47a1fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.838222  5062 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:29.825659  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd842ad26db48e1aa55713f47a1fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.826026  5054 ts_tablet_manager.cc:1403] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.211s	user 0.006s	sys 0.005s
I20260709 13:12:29.826718  5056 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:29.841171  5062 ts_tablet_manager.cc:1403] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.010s
I20260709 13:12:29.845597  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 91c40c4ad6094ad0a5be7f2f349a9d29 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:29.848268  5054 raft_consensus.cc:359] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.882136  4849 tablet_service.cc:1511] Processing CreateTablet for tablet 77c87c0a10ce45b48f3527e14aed165a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:29.882874  5054 raft_consensus.cc:385] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.883291  5054 raft_consensus.cc:740] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.879534  5062 raft_consensus.cc:359] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.880901  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c40c4ad6094ad0a5be7f2f349a9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.871762  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 91c40c4ad6094ad0a5be7f2f349a9d29 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:29.879196  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 91c40c4ad6094ad0a5be7f2f349a9d29 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:29.887984  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c40c4ad6094ad0a5be7f2f349a9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.885725  5056 tablet_bootstrap.cc:654] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:29.892539  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c40c4ad6094ad0a5be7f2f349a9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.896719  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:29.898344  4901 leader_election.cc:343] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:29.885809  5062 raft_consensus.cc:385] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:29.899031  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c87c0a10ce45b48f3527e14aed165a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.898936  5062 raft_consensus.cc:740] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:29.903044  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:29.903893  5055 ts_tablet_manager.cc:1434] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.104s	user 0.021s	sys 0.042s
W20260709 13:12:29.904659  4900 leader_election.cc:343] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:29.905139  4900 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:29.906286  5059 raft_consensus.cc:2749] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:29.903369  5062 consensus_queue.cc:260] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.884096  5054 consensus_queue.cc:260] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:29.906956  5055 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:29.906960  4775 tablet_service.cc:1511] Processing CreateTablet for tablet 77c87c0a10ce45b48f3527e14aed165a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:29.908646  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c87c0a10ce45b48f3527e14aed165a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:29.913422  5054 ts_tablet_manager.cc:1434] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:12:29.914450  5054 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:29.933936  5034 heartbeater.cc:499] Master 127.28.152.62:37459 was elected leader, sending a full tablet report...
I20260709 13:12:30.000774  4845 tablet_service.cc:1511] Processing CreateTablet for tablet 16f58579d1984a7490486826d572a5c8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:29.985355  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 77c87c0a10ce45b48f3527e14aed165a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:30.003526  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f58579d1984a7490486826d572a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.003052  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc863e914714666afa0468d30e21e3a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:30.003123  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 16f58579d1984a7490486826d572a5c8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:30.006629  5059 raft_consensus.cc:493] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.009971  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 16f58579d1984a7490486826d572a5c8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:30.011586  5059 raft_consensus.cc:515] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.013581  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f58579d1984a7490486826d572a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.015463  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc863e914714666afa0468d30e21e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.019320  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc863e914714666afa0468d30e21e3a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:30.022526  5056 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.022553  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f58579d1984a7490486826d572a5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.026127  5055 tablet_bootstrap.cc:654] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.023618  5056 ts_tablet_manager.cc:1403] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.197s	user 0.016s	sys 0.001s
I20260709 13:12:30.027655  5062 ts_tablet_manager.cc:1434] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.151s	user 0.015s	sys 0.017s
I20260709 13:12:30.031445  5056 raft_consensus.cc:359] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.032447  5056 raft_consensus.cc:385] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.032786  5056 raft_consensus.cc:740] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.033742  5056 consensus_queue.cc:260] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.033815  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dc48f4b54413583c9249d86ec89af" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.035141  4786 raft_consensus.cc:2468] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.036057  5059 leader_election.cc:290] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.037004  4901 leader_election.cc:304] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.039830  5062 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:30.044857  5059 raft_consensus.cc:2804] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.045320  5059 raft_consensus.cc:493] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.045710  5059 raft_consensus.cc:3060] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.048316  5054 tablet_bootstrap.cc:654] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.050244  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c87c0a10ce45b48f3527e14aed165a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.059862  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc863e914714666afa0468d30e21e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.064538  5056 ts_tablet_manager.cc:1434] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.009s
I20260709 13:12:30.066061  5056 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.069420  5073 raft_consensus.cc:493] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.070116  5073 raft_consensus.cc:515] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.076619  5068 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.077219  5068 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.077732  5073 leader_election.cc:290] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.080355  5068 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:30.093201  4775 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc863e914714666afa0468d30e21e3a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:30.095178  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc863e914714666afa0468d30e21e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.105638  5062 tablet_bootstrap.cc:654] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.106835  5055 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:30.117323  5055 ts_tablet_manager.cc:1403] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.211s	user 0.015s	sys 0.002s
I20260709 13:12:30.136977  5056 tablet_bootstrap.cc:654] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.121433  5055 raft_consensus.cc:359] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.152341  5055 raft_consensus.cc:385] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.152712  5055 raft_consensus.cc:740] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.154158  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dc48f4b54413583c9249d86ec89af" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.156939  4861 raft_consensus.cc:2468] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.160539  4845 tablet_service.cc:1511] Processing CreateTablet for tablet cd2cac51497e440e9a975e6e0bd8efa8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:30.161152  4923 tablet_service.cc:1511] Processing CreateTablet for tablet cd2cac51497e440e9a975e6e0bd8efa8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:30.162071  4992 tablet_service.cc:1511] Processing CreateTablet for tablet cd2cac51497e440e9a975e6e0bd8efa8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:30.164686  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2cac51497e440e9a975e6e0bd8efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.169595  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffeaaf1e8242629b324e7fda7bb872 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:30.171322  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffeaaf1e8242629b324e7fda7bb872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.173842  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 7d44c39b62f14dfeb860991634e29c03 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:30.170843  5055 consensus_queue.cc:260] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.158907  5059 raft_consensus.cc:515] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.163272  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2cac51497e440e9a975e6e0bd8efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.169661  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffeaaf1e8242629b324e7fda7bb872 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:30.176005  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d44c39b62f14dfeb860991634e29c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.186743  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 7d44c39b62f14dfeb860991634e29c03 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:30.188057  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d44c39b62f14dfeb860991634e29c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.188584  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dc48f4b54413583c9249d86ec89af" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:30.189203  4786 raft_consensus.cc:3060] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.187183  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2cac51497e440e9a975e6e0bd8efa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.193533  5055 ts_tablet_manager.cc:1434] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:12:30.201097  5059 leader_election.cc:290] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.204049  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 30ffeaaf1e8242629b324e7fda7bb872 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:30.205861  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffeaaf1e8242629b324e7fda7bb872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.207983  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:30.209923  4975 leader_election.cc:343] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.210959  4849 tablet_service.cc:1511] Processing CreateTablet for tablet 7d44c39b62f14dfeb860991634e29c03 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:30.216300  4786 raft_consensus.cc:2468] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:30.221166  4901 leader_election.cc:304] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.221740  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30ffeaaf1e8242629b324e7fda7bb872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.221823  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:30.224120  4973 leader_election.cc:343] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.224490  5059 raft_consensus.cc:2804] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.224140  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dc48f4b54413583c9249d86ec89af" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:30.228839  4861 raft_consensus.cc:3060] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.231506  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.232625  4860 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:30.224579  4973 leader_election.cc:304] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:30.234337  4749 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.234642  5073 raft_consensus.cc:2749] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:30.235697  5068 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.236164  5068 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.236536  5068 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.239343  4861 raft_consensus.cc:2468] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:30.243901  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d44c39b62f14dfeb860991634e29c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.245678  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:30.235661  5055 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:30.246785  5054 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
W20260709 13:12:30.247473  4751 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.247579  5054 ts_tablet_manager.cc:1403] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.333s	user 0.018s	sys 0.001s
I20260709 13:12:30.251073  5068 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.251804  5054 raft_consensus.cc:359] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.252573  5054 raft_consensus.cc:385] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.252862  5054 raft_consensus.cc:740] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.254055  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:30.255533  4751 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.256090  5056 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.256621  5056 ts_tablet_manager.cc:1403] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.016s
I20260709 13:12:30.257928  5059 raft_consensus.cc:697] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:30.259299  5068 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:30.259145  5059 consensus_queue.cc:237] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.259922  5056 raft_consensus.cc:359] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.260672  5056 raft_consensus.cc:385] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.260968  5056 raft_consensus.cc:740] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.253750  5054 consensus_queue.cc:260] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.265820  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:30.266660  4861 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.267582  5054 ts_tablet_manager.cc:1434] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.008s
I20260709 13:12:30.268890  5054 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:30.275749  5054 tablet_bootstrap.cc:654] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.276857  4920 tablet_service.cc:1511] Processing CreateTablet for tablet a3bb45754e1f48068c332ed71e97ad32 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:30.278119  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3bb45754e1f48068c332ed71e97ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.278071  4992 tablet_service.cc:1511] Processing CreateTablet for tablet a3bb45754e1f48068c332ed71e97ad32 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:30.278899  5056 consensus_queue.cc:260] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.279620  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3bb45754e1f48068c332ed71e97ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.281239  5056 ts_tablet_manager.cc:1434] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:12:30.281227  4682 catalog_manager.cc:5697] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.293543  4861 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:30.295078  5056 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.294997  4749 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:30.297009  5062 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:30.297561  5062 ts_tablet_manager.cc:1403] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.259s	user 0.008s	sys 0.015s
I20260709 13:12:30.299607  5091 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.305253  5056 tablet_bootstrap.cc:654] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.306583  5054 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:30.307178  5054 ts_tablet_manager.cc:1403] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.005s
I20260709 13:12:30.310447  5054 raft_consensus.cc:359] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.311237  5054 raft_consensus.cc:385] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.311578  5054 raft_consensus.cc:740] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.312592  5054 consensus_queue.cc:260] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.315258  5054 ts_tablet_manager.cc:1434] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:30.316461  5054 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:30.323050  5062 raft_consensus.cc:359] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.323872  5062 raft_consensus.cc:385] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.324267  5062 raft_consensus.cc:740] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.325076  5054 tablet_bootstrap.cc:654] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.325186  5062 consensus_queue.cc:260] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.330819  5091 raft_consensus.cc:697] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:30.332172  5091 consensus_queue.cc:237] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.333349  4775 tablet_service.cc:1511] Processing CreateTablet for tablet a3bb45754e1f48068c332ed71e97ad32 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:30.334676  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3bb45754e1f48068c332ed71e97ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.339262  4923 tablet_service.cc:1511] Processing CreateTablet for tablet feb6150ed16c4b01b553aeed27359f05 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:30.340607  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb6150ed16c4b01b553aeed27359f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.345106  5062 ts_tablet_manager.cc:1434] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:12:30.347319  5062 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:30.357326  5056 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.357858  5056 ts_tablet_manager.cc:1403] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.014s
I20260709 13:12:30.359607  4845 tablet_service.cc:1511] Processing CreateTablet for tablet ef15cbb1e0264e3fae50d98caeaed84a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:30.360965  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15cbb1e0264e3fae50d98caeaed84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.366295  4684 catalog_manager.cc:5697] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.349586  4849 tablet_service.cc:1511] Processing CreateTablet for tablet feb6150ed16c4b01b553aeed27359f05 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:30.370642  4776 tablet_service.cc:1511] Processing CreateTablet for tablet ef15cbb1e0264e3fae50d98caeaed84a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:30.371587  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb6150ed16c4b01b553aeed27359f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.372082  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15cbb1e0264e3fae50d98caeaed84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.352036  4992 tablet_service.cc:1511] Processing CreateTablet for tablet feb6150ed16c4b01b553aeed27359f05 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:30.373257  5062 tablet_bootstrap.cc:654] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.373857  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb6150ed16c4b01b553aeed27359f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.379202  5055 tablet_bootstrap.cc:654] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.384418  5056 raft_consensus.cc:359] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.385301  5056 raft_consensus.cc:385] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.385802  5056 raft_consensus.cc:740] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.386814  5056 consensus_queue.cc:260] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.389668  5056 ts_tablet_manager.cc:1434] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:12:30.394369  5056 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.395092  4920 tablet_service.cc:1511] Processing CreateTablet for tablet ef15cbb1e0264e3fae50d98caeaed84a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:30.396652  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15cbb1e0264e3fae50d98caeaed84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.395560  5062 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:30.397921  5062 ts_tablet_manager.cc:1403] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.004s
I20260709 13:12:30.401981  5056 tablet_bootstrap.cc:654] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.406553  4998 tablet_service.cc:1511] Processing CreateTablet for tablet a83e926be0c443dbadd95607ab1d8979 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:30.406119  5062 raft_consensus.cc:359] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.408183  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83e926be0c443dbadd95607ab1d8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.408313  5062 raft_consensus.cc:385] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.409188  5062 raft_consensus.cc:740] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.411001  5062 consensus_queue.cc:260] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.413311  4846 tablet_service.cc:1511] Processing CreateTablet for tablet a83e926be0c443dbadd95607ab1d8979 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:30.414562  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83e926be0c443dbadd95607ab1d8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.411429  4776 tablet_service.cc:1511] Processing CreateTablet for tablet a83e926be0c443dbadd95607ab1d8979 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:30.417513  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83e926be0c443dbadd95607ab1d8979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.419296  5062 ts_tablet_manager.cc:1434] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:12:30.421347  5062 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:30.427960  5056 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.428541  5056 ts_tablet_manager.cc:1403] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.011s
I20260709 13:12:30.431803  5056 raft_consensus.cc:359] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.434885  5056 raft_consensus.cc:385] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.438642  5056 raft_consensus.cc:740] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.441449  5091 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.442031  5091 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.446377  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:30.447366  5009 raft_consensus.cc:2468] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:30.449855  5091 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
W20260709 13:12:30.454258  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:30.454581  4751 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.461542  5091 raft_consensus.cc:2804] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.462088  5091 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.462563  5091 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.474457  5091 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.474586  5056 consensus_queue.cc:260] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.479233  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:30.479364  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:30.480016  5056 ts_tablet_manager.cc:1434] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:12:30.480095  4935 raft_consensus.cc:2468] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:30.481662  5056 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.487494  5062 tablet_bootstrap.cc:654] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.488224  5091 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:30.491215  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:30.491925  5009 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.495970  5055 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:30.496598  5055 ts_tablet_manager.cc:1403] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.261s	user 0.009s	sys 0.006s
I20260709 13:12:30.500590  5056 tablet_bootstrap.cc:654] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.506115  5055 raft_consensus.cc:359] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.508049  5055 raft_consensus.cc:385] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.509488  5055 raft_consensus.cc:740] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.510267  5055 consensus_queue.cc:260] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.510598  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 94a86b4bab4f4187a53108485c2ad257 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:30.511977  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a86b4bab4f4187a53108485c2ad257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.511682  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 94a86b4bab4f4187a53108485c2ad257 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:30.512924  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a86b4bab4f4187a53108485c2ad257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.513998  5055 ts_tablet_manager.cc:1434] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:12:30.515177  5055 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:30.519930  5062 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:30.520897  5062 ts_tablet_manager.cc:1403] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.005s
I20260709 13:12:30.521291  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 94a86b4bab4f4187a53108485c2ad257 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:30.522560  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a86b4bab4f4187a53108485c2ad257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.523468  5054 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:30.523981  5054 ts_tablet_manager.cc:1403] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.208s	user 0.034s	sys 0.052s
I20260709 13:12:30.527202  5054 raft_consensus.cc:359] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.527957  5054 raft_consensus.cc:385] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.528262  5054 raft_consensus.cc:740] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.529922  5055 tablet_bootstrap.cc:654] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.531193  5062 raft_consensus.cc:359] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.531975  5062 raft_consensus.cc:385] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.532271  5062 raft_consensus.cc:740] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.533248  5062 consensus_queue.cc:260] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.535280  5054 consensus_queue.cc:260] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.536545  5009 raft_consensus.cc:2468] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:30.537853  4751 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:30.539508  5091 raft_consensus.cc:2804] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.539783  5062 ts_tablet_manager.cc:1434] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:12:30.539973  5091 raft_consensus.cc:697] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:30.540984  5062 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:30.540890  5091 consensus_queue.cc:237] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.543020  5056 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.543532  5056 ts_tablet_manager.cc:1403] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.000s
I20260709 13:12:30.546831  5056 raft_consensus.cc:359] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.547602  5056 raft_consensus.cc:385] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.547977  5056 raft_consensus.cc:740] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.548331  5062 tablet_bootstrap.cc:654] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.548779  5056 consensus_queue.cc:260] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.551368  5056 ts_tablet_manager.cc:1434] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:30.552635  5056 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.556442  5054 ts_tablet_manager.cc:1434] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:12:30.557659  5054 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:30.555366  4845 tablet_service.cc:1511] Processing CreateTablet for tablet c88dea137c8e49a484a715cf7078e4c2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:30.559072  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88dea137c8e49a484a715cf7078e4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.569079  5054 tablet_bootstrap.cc:654] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.574003  5062 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:30.574733  5062 ts_tablet_manager.cc:1403] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.009s
I20260709 13:12:30.577526  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 0a97f5da08f0457389cd2720c8c64d6d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:30.578423  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a97f5da08f0457389cd2720c8c64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.574189  4998 tablet_service.cc:1511] Processing CreateTablet for tablet c88dea137c8e49a484a715cf7078e4c2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:30.581014  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88dea137c8e49a484a715cf7078e4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.581753  5059 raft_consensus.cc:493] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.582247  5059 raft_consensus.cc:515] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.584520  5059 leader_election.cc:290] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.577019  4849 tablet_service.cc:1511] Processing CreateTablet for tablet 0a97f5da08f0457389cd2720c8c64d6d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:30.585557  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 0a97f5da08f0457389cd2720c8c64d6d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:30.586238  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a97f5da08f0457389cd2720c8c64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.586089  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.586845  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a97f5da08f0457389cd2720c8c64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:30.588148  4901 leader_election.cc:343] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.591544  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:30.591789  5071 raft_consensus.cc:493] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.592202  5009 raft_consensus.cc:2468] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.592535  5071 raft_consensus.cc:515] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.593648  4900 leader_election.cc:304] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:30.594939  5059 raft_consensus.cc:2804] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.595345  5059 raft_consensus.cc:493] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.588526  4920 tablet_service.cc:1511] Processing CreateTablet for tablet c88dea137c8e49a484a715cf7078e4c2 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:30.595713  5059 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.596637  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88dea137c8e49a484a715cf7078e4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.596863  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.597731  4786 raft_consensus.cc:2468] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:30.599556  4827 leader_election.cc:304] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.580986  5062 raft_consensus.cc:359] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.606544  5071 leader_election.cc:290] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:30.621579  5107 raft_consensus.cc:2804] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.622316  5107 raft_consensus.cc:493] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.621539  4682 catalog_manager.cc:5697] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.622819  5107 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.624598  5055 tablet_bootstrap.cc:492] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:30.625198  5055 ts_tablet_manager.cc:1403] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.002s
I20260709 13:12:30.628448  5055 raft_consensus.cc:359] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.633522  4992 tablet_service.cc:1511] Processing CreateTablet for tablet e29c0f2d503146f6b27e75a54137a273 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:30.633347  5107 raft_consensus.cc:515] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.635552  4775 tablet_service.cc:1511] Processing CreateTablet for tablet e29c0f2d503146f6b27e75a54137a273 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:30.636787  4845 tablet_service.cc:1511] Processing CreateTablet for tablet e29c0f2d503146f6b27e75a54137a273 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:30.637264  5087 raft_consensus.cc:493] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.665320  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29c0f2d503146f6b27e75a54137a273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.665001  5087 raft_consensus.cc:515] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.665638  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29c0f2d503146f6b27e75a54137a273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.637518  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 57c70fd50ee1480c93f859973675ed01 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:30.667945  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c70fd50ee1480c93f859973675ed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.616503  5062 raft_consensus.cc:385] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.670843  5062 raft_consensus.cc:740] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.671657  5062 consensus_queue.cc:260] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.672065  5087 leader_election.cc:290] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:30.645725  5056 tablet_bootstrap.cc:654] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.648535  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 57c70fd50ee1480c93f859973675ed01 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:30.650703  5073 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.650741  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 57c70fd50ee1480c93f859973675ed01 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:30.652311  5086 raft_consensus.cc:493] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.652544  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 51025d71068843cfb90078f0d937070d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:30.672564  5107 leader_election.cc:290] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:30.676901  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51025d71068843cfb90078f0d937070d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.654822  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 51025d71068843cfb90078f0d937070d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:30.655714  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 51025d71068843cfb90078f0d937070d (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:30.657810  4770 tablet_service.cc:1511] Processing CreateTablet for tablet e023474754444ca7835a8410266d6d7b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:30.660516  5059 raft_consensus.cc:515] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.681067  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51025d71068843cfb90078f0d937070d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.681727  4775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29c0f2d503146f6b27e75a54137a273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.682291  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c70fd50ee1480c93f859973675ed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.686857  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d8d1af32d4333bfb27a527def8b9c" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:30.687559  5009 raft_consensus.cc:2468] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.687652  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d8d1af32d4333bfb27a527def8b9c" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.687917  4848 tablet_service.cc:1511] Processing CreateTablet for tablet e023474754444ca7835a8410266d6d7b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:30.689149  4848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e023474754444ca7835a8410266d6d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.689092  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:30.689832  4785 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.689724  5087 consensus_queue.cc:1048] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:30.681228  5086 raft_consensus.cc:515] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.663441  5055 raft_consensus.cc:385] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.698400  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51025d71068843cfb90078f0d937070d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.699697  5059 leader_election.cc:290] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.700723  5086 leader_election.cc:290] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:30.703871  4900 leader_election.cc:304] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:30.704625  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:30.679562  5073 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.706089  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce5374ea4094a1da56f0705db711237" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.706830  4784 raft_consensus.cc:2468] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.709573  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c70fd50ee1480c93f859973675ed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.711228  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce5374ea4094a1da56f0705db711237" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.712585  4770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e023474754444ca7835a8410266d6d7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:30.718010  4898 leader_election.cc:343] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:30.719642  4901 leader_election.cc:343] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.720402  4901 leader_election.cc:304] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:30.721434  5073 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:30.728008  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 339747664ecc489f95b3d04d961ac367 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:30.729231  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339747664ecc489f95b3d04d961ac367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.723860  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:30.725313  5086 raft_consensus.cc:2804] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.725466  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.737989  5009 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.696357  5055 raft_consensus.cc:740] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.726229  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 339747664ecc489f95b3d04d961ac367 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:30.735217  5110 raft_consensus.cc:2804] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.737516  5086 raft_consensus.cc:493] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.750192  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339747664ecc489f95b3d04d961ac367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.750267  5055 consensus_queue.cc:260] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.752074  5054 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:30.752590  5054 ts_tablet_manager.cc:1403] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.195s	user 0.031s	sys 0.022s
I20260709 13:12:30.752924  5062 ts_tablet_manager.cc:1434] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.178s	user 0.006s	sys 0.010s
I20260709 13:12:30.754876  4861 raft_consensus.cc:2468] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:30.754017  5055 ts_tablet_manager.cc:1434] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.000s
I20260709 13:12:30.743884  5110 raft_consensus.cc:493] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.745858  5086 raft_consensus.cc:3060] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.768939  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3e883f43749a59653968b3183850e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:30.770283  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3e883f43749a59653968b3183850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.770797  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 339747664ecc489f95b3d04d961ac367 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:30.772069  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339747664ecc489f95b3d04d961ac367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.773350  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.774158  4861 raft_consensus.cc:2393] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:30.775797  4972 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:30.777810  5073 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.782338  5107 raft_consensus.cc:493] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.782867  5107 raft_consensus.cc:515] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.784842  5107 leader_election.cc:290] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.789556  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.790285  4784 raft_consensus.cc:2468] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:30.791803  4827 leader_election.cc:304] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.792573  5107 raft_consensus.cc:2804] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:30.792913  5107 raft_consensus.cc:493] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.793274  5111 raft_consensus.cc:493] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.793957  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:30.794979  5056 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:30.793862  5111 raft_consensus.cc:515] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.793280  5107 raft_consensus.cc:3060] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.801553  5062 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:30.762526  5110 raft_consensus.cc:3060] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.806629  5056 ts_tablet_manager.cc:1403] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.254s	user 0.025s	sys 0.023s
W20260709 13:12:30.811338  4826 leader_election.cc:343] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.818857  5111 leader_election.cc:290] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:30.819744  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:30.822789  5009 raft_consensus.cc:2468] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:30.824016  5091 consensus_queue.cc:1048] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:30.824163  4900 leader_election.cc:304] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:30.825060  5087 raft_consensus.cc:2804] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:30.825475  4975 leader_election.cc:343] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.826423  5087 raft_consensus.cc:697] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:30.828404  5087 consensus_queue.cc:237] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.829861  5107 raft_consensus.cc:515] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:30.831455  5054 raft_consensus.cc:359] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.832217  5054 raft_consensus.cc:385] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.832520  5054 raft_consensus.cc:740] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.839717  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:30.841146  4785 raft_consensus.cc:2468] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:30.842496  4827 leader_election.cc:304] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:30.843323  5071 raft_consensus.cc:2804] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.845295  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3e883f43749a59653968b3183850e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:30.848556  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3e883f43749a59653968b3183850e (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:30.850198  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3e883f43749a59653968b3183850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.853732  5055 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:30.854928  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:30.855770  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:30.856894  4825 leader_election.cc:343] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.759487  4923 tablet_service.cc:1511] Processing CreateTablet for tablet e023474754444ca7835a8410266d6d7b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:12:30.864686  4825 leader_election.cc:343] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:30.871312  4972 leader_election.cc:343] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.875325  4972 leader_election.cc:304] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:30.875998  5056 raft_consensus.cc:359] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.876507  5111 raft_consensus.cc:2749] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:30.876827  5056 raft_consensus.cc:385] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:30.877140  5056 raft_consensus.cc:740] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:30.880759  4682 catalog_manager.cc:5697] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.882947  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3e883f43749a59653968b3183850e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.889309  5087 consensus_queue.cc:1048] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:30.906322  5086 raft_consensus.cc:515] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.909415  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d8d1af32d4333bfb27a527def8b9c" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:30.910053  4860 raft_consensus.cc:3060] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.911790  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 63b20012ccf24e2394387d169d9c75fe (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:30.913087  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b20012ccf24e2394387d169d9c75fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.923085  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e023474754444ca7835a8410266d6d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.839783  5054 consensus_queue.cc:260] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.877912  5056 consensus_queue.cc:260] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:30.920836  5073 raft_consensus.cc:2749] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:30.920580  5071 raft_consensus.cc:697] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:30.943222  5091 consensus_queue.cc:1048] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:30.943754  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 63b20012ccf24e2394387d169d9c75fe (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:30.938824  5110 raft_consensus.cc:515] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:30.949115  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d8d1af32d4333bfb27a527def8b9c" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:30.949748  5009 raft_consensus.cc:3060] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.950932  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b20012ccf24e2394387d169d9c75fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.951619  5062 tablet_bootstrap.cc:654] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:30.957906  4992 tablet_service.cc:1511] Processing CreateTablet for tablet 63b20012ccf24e2394387d169d9c75fe (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:30.961715  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b20012ccf24e2394387d169d9c75fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.964449  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 296e8f525bb74ec48853794077e3bddf (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:30.965585  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296e8f525bb74ec48853794077e3bddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.959867  5086 leader_election.cc:290] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:30.966418  4845 tablet_service.cc:1511] Processing CreateTablet for tablet 296e8f525bb74ec48853794077e3bddf (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:30.968171  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:30.969485  4826 leader_election.cc:343] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:30.968456  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296e8f525bb74ec48853794077e3bddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:30.971583  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:30.971956  5056 ts_tablet_manager.cc:1434] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.139s	user 0.003s	sys 0.004s
I20260709 13:12:30.973143  5056 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:30.941152  4860 raft_consensus.cc:2468] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:30.974324  5107 leader_election.cc:290] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:30.975360  4898 leader_election.cc:304] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:30.976666  5086 raft_consensus.cc:2804] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:30.978878  5086 raft_consensus.cc:697] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:30.972332  4785 raft_consensus.cc:3060] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:30.979820  5086 consensus_queue.cc:237] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:30.980921  5009 raft_consensus.cc:2468] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:30.993942  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 296e8f525bb74ec48853794077e3bddf (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:31.001670  5055 tablet_bootstrap.cc:654] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.000876  5071 consensus_queue.cc:237] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.017479  4990 tablet_service.cc:1511] Processing CreateTablet for tablet e56552e1ca874e52bfef190ac96a1740 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:31.019115  4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56552e1ca874e52bfef190ac96a1740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.031286  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce5374ea4094a1da56f0705db711237" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:31.032043  4784 raft_consensus.cc:3060] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.032290  5054 ts_tablet_manager.cc:1434] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.279s	user 0.008s	sys 0.004s
I20260709 13:12:31.032377  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce5374ea4094a1da56f0705db711237" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:31.033851  5054 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
W20260709 13:12:31.033950  4898 leader_election.cc:343] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.034535  5091 consensus_queue.cc:1048] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.031267  5110 leader_election.cc:290] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:31.039834  4784 raft_consensus.cc:2468] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:31.040516  5056 tablet_bootstrap.cc:654] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.041083  4901 leader_election.cc:304] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:31.042161  4935 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.042340  5110 raft_consensus.cc:2804] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.043159  5110 raft_consensus.cc:697] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:31.044122  5110 consensus_queue.cc:237] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.047073  4770 tablet_service.cc:1511] Processing CreateTablet for tablet e56552e1ca874e52bfef190ac96a1740 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:31.052697  4770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56552e1ca874e52bfef190ac96a1740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.076956  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 2b456ffffa884668a41f15046cec623b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:31.078444  4846 tablet_service.cc:1511] Processing CreateTablet for tablet e56552e1ca874e52bfef190ac96a1740 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:31.079931  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56552e1ca874e52bfef190ac96a1740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.067778  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296e8f525bb74ec48853794077e3bddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.100337  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 2b456ffffa884668a41f15046cec623b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:31.102316  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b456ffffa884668a41f15046cec623b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.111171  4785 raft_consensus.cc:2468] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:31.115106  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b456ffffa884668a41f15046cec623b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.115741  4827 leader_election.cc:304] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:31.117453  5062 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:31.118009  5062 ts_tablet_manager.cc:1403] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.012s
I20260709 13:12:31.120671  5119 raft_consensus.cc:2804] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.121199  5119 raft_consensus.cc:697] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:31.121310  5062 raft_consensus.cc:359] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.122083  5062 raft_consensus.cc:385] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.122377  5062 raft_consensus.cc:740] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.122108  5119 consensus_queue.cc:237] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.144807  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 2b456ffffa884668a41f15046cec623b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:31.147887  4845 tablet_service.cc:1511] Processing CreateTablet for tablet d34da2d7f05c4d8abebd5e99d71cf8c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:31.149438  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34da2d7f05c4d8abebd5e99d71cf8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.162006  4776 tablet_service.cc:1511] Processing CreateTablet for tablet ed486b7fc9ef4feca3baf9633a218b34 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:31.163079  4923 tablet_service.cc:1511] Processing CreateTablet for tablet d34da2d7f05c4d8abebd5e99d71cf8c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:31.164584  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34da2d7f05c4d8abebd5e99d71cf8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.146636  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b456ffffa884668a41f15046cec623b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.170982  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed486b7fc9ef4feca3baf9633a218b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.191546  4992 tablet_service.cc:1511] Processing CreateTablet for tablet d34da2d7f05c4d8abebd5e99d71cf8c6 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:31.193332  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34da2d7f05c4d8abebd5e99d71cf8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.196007  5091 consensus_queue.cc:1048] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.215629  5054 tablet_bootstrap.cc:654] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.215636  4847 tablet_service.cc:1511] Processing CreateTablet for tablet ed486b7fc9ef4feca3baf9633a218b34 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:31.217255  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed486b7fc9ef4feca3baf9633a218b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.203475  5062 consensus_queue.cc:260] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.225759  5062 ts_tablet_manager.cc:1434] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.004s
I20260709 13:12:31.226269  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 103e2af53ccd444cac711b88eb93573f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:31.226773  5073 raft_consensus.cc:493] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.227272  5073 raft_consensus.cc:515] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.227705  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103e2af53ccd444cac711b88eb93573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.229328  5092 raft_consensus.cc:493] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.229830  5092 raft_consensus.cc:515] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.234558  5092 leader_election.cc:290] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:31.236034  5062 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:31.248989  4681 catalog_manager.cc:5697] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.250026  5056 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:31.250609  5056 ts_tablet_manager.cc:1403] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.278s	user 0.022s	sys 0.023s
I20260709 13:12:31.253386  5056 raft_consensus.cc:359] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.254056  5056 raft_consensus.cc:385] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.254312  5056 raft_consensus.cc:740] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.253726  4684 catalog_manager.cc:5697] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.254930  5056 consensus_queue.cc:260] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.257233  5056 ts_tablet_manager.cc:1434] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:31.257438  5110 consensus_queue.cc:1048] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.258221  5056 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
W20260709 13:12:31.268883  4750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 89517.4us
I20260709 13:12:31.280040  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:31.281373  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 103e2af53ccd444cac711b88eb93573f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:31.284077  4925 tablet_service.cc:1511] Processing CreateTablet for tablet ed486b7fc9ef4feca3baf9633a218b34 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:31.285876  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed486b7fc9ef4feca3baf9633a218b34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.285919  5073 leader_election.cc:290] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:31.275774  4681 catalog_manager.cc:5697] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.295614  5055 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.296157  5055 ts_tablet_manager.cc:1403] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.485s	user 0.008s	sys 0.033s
I20260709 13:12:31.296295  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103e2af53ccd444cac711b88eb93573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.299746  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:31.301316  4975 leader_election.cc:343] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.302613  5055 raft_consensus.cc:359] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.303426  5055 raft_consensus.cc:385] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.304275  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:31.305162  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:31.305944  4751 leader_election.cc:304] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9
W20260709 13:12:31.306664  4973 leader_election.cc:343] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.309690  5091 raft_consensus.cc:2749] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:31.305845  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 103e2af53ccd444cac711b88eb93573f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:31.311162  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103e2af53ccd444cac711b88eb93573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.307173  4973 leader_election.cc:304] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:31.303719  5055 raft_consensus.cc:740] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.314980  5073 raft_consensus.cc:2749] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:31.315537  5055 consensus_queue.cc:260] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.318184  5055 ts_tablet_manager.cc:1434] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:12:31.319339  5055 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.324746  4923 tablet_service.cc:1511] Processing CreateTablet for tablet e90059dfb0354efcbdf13a0b245cefb3 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:31.325904  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90059dfb0354efcbdf13a0b245cefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.328629  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 937c0a0afa904d0ba5e441074701b4d8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:31.330224  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937c0a0afa904d0ba5e441074701b4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.331066  5110 raft_consensus.cc:493] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.306836  5062 tablet_bootstrap.cc:654] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.331687  5110 raft_consensus.cc:515] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.336125  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:31.338095  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:31.339440  4900 leader_election.cc:343] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.340353  4785 raft_consensus.cc:2468] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:31.340802  4776 tablet_service.cc:1511] Processing CreateTablet for tablet e90059dfb0354efcbdf13a0b245cefb3 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:31.342069  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90059dfb0354efcbdf13a0b245cefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.341923  4901 leader_election.cc:304] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:31.346809  5110 leader_election.cc:290] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:31.353571  4992 tablet_service.cc:1511] Processing CreateTablet for tablet e90059dfb0354efcbdf13a0b245cefb3 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:31.357450  5056 tablet_bootstrap.cc:654] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.361629  5110 raft_consensus.cc:2804] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:31.361001  4681 catalog_manager.cc:5697] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.362097  5110 raft_consensus.cc:493] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.362622  5110 raft_consensus.cc:3060] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.364802  5055 tablet_bootstrap.cc:654] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.369069  5054 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:31.369611  5054 ts_tablet_manager.cc:1403] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.336s	user 0.010s	sys 0.010s
I20260709 13:12:31.374392  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90059dfb0354efcbdf13a0b245cefb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.384228  5054 raft_consensus.cc:359] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.384999  5054 raft_consensus.cc:385] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.385278  5054 raft_consensus.cc:740] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.385905  5054 consensus_queue.cc:260] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.387938  4785 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.389287  5054 ts_tablet_manager.cc:1434] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:31.390527  5054 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:31.396466  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 937c0a0afa904d0ba5e441074701b4d8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:31.400484  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937c0a0afa904d0ba5e441074701b4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.404170  5054 tablet_bootstrap.cc:654] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.445277  4992 tablet_service.cc:1511] Processing CreateTablet for tablet 937c0a0afa904d0ba5e441074701b4d8 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:31.446488  4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937c0a0afa904d0ba5e441074701b4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.448345  5087 consensus_queue.cc:1048] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.450968  4847 tablet_service.cc:1511] Processing CreateTablet for tablet cf96d3b028bf425fa8ef6948ef4d699a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:31.452702  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf96d3b028bf425fa8ef6948ef4d699a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.457116  4773 tablet_service.cc:1511] Processing CreateTablet for tablet cf96d3b028bf425fa8ef6948ef4d699a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:31.458460  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf96d3b028bf425fa8ef6948ef4d699a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.459215  5087 consensus_queue.cc:1048] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:31.466670  5055 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.467206  5055 ts_tablet_manager.cc:1403] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.148s	user 0.055s	sys 0.032s
I20260709 13:12:31.470278  5055 raft_consensus.cc:359] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.471020  5055 raft_consensus.cc:385] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.471312  5055 raft_consensus.cc:740] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.471235  5110 raft_consensus.cc:515] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.472988  5055 consensus_queue.cc:260] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.474445  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:31.475754  5055 ts_tablet_manager.cc:1434] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:12:31.476276  4900 leader_election.cc:343] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.476854  5055 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.478237  5062 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:31.480044  4935 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.484095  5055 tablet_bootstrap.cc:654] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.493063  5062 ts_tablet_manager.cc:1403] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.266s	user 0.008s	sys 0.005s
I20260709 13:12:31.495416  4859 raft_consensus.cc:3060] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.496143  5055 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.496660  5055 ts_tablet_manager.cc:1403] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:12:31.499493  5055 raft_consensus.cc:359] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.500126  5055 raft_consensus.cc:385] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.500401  5055 raft_consensus.cc:740] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.501103  5071 consensus_queue.cc:1048] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.501276  5055 consensus_queue.cc:260] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:31.501876  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:31.502152  5119 raft_consensus.cc:493] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.502629  5119 raft_consensus.cc:515] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.504670  5062 raft_consensus.cc:359] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.507591  5062 raft_consensus.cc:385] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.507966  5062 raft_consensus.cc:740] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.506572  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:31.515556  5006 raft_consensus.cc:2468] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:31.516870  4826 leader_election.cc:304] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:31.505540  5110 leader_election.cc:290] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:31.509392  5119 leader_election.cc:290] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:31.483711  5054 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:31.513305  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:31.519586  5054 ts_tablet_manager.cc:1403] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.011s
W20260709 13:12:31.519860  4827 leader_election.cc:343] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.512614  5055 ts_tablet_manager.cc:1434] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:31.518045  5071 raft_consensus.cc:2804] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:31.511650  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:31.521417  5071 raft_consensus.cc:493] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.521584  4786 raft_consensus.cc:3060] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.521849  5071 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.522547  4921 tablet_service.cc:1511] Processing CreateTablet for tablet cf96d3b028bf425fa8ef6948ef4d699a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:31.524065  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf96d3b028bf425fa8ef6948ef4d699a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.516819  5059 consensus_queue.cc:1048] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:31.530273  5071 raft_consensus.cc:515] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:31.538841  4826 consensus_peers.cc:597] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 -> Peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Couldn't send request to peer e3b9d92f86c74ea0b6537c30a8846eab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.533922  5054 raft_consensus.cc:359] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.540520  5054 raft_consensus.cc:385] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.540951  5054 raft_consensus.cc:740] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.541754  5054 consensus_queue.cc:260] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.535347  5055 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.543180  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:31.537777  5062 consensus_queue.cc:260] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.543991  5009 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.545503  5062 ts_tablet_manager.cc:1434] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:12:31.540251  5119 consensus_queue.cc:1048] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:31.548576  5062 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:31.541993  4786 raft_consensus.cc:2468] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:31.553301  5055 tablet_bootstrap.cc:654] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.560446  4901 leader_election.cc:304] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:31.563483  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
W20260709 13:12:31.566259  4827 leader_election.cc:343] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.564069  5062 tablet_bootstrap.cc:654] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.569804  5054 ts_tablet_manager.cc:1434] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:12:31.571542  5086 consensus_queue.cc:1048] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:31.570775  5087 raft_consensus.cc:2804] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.581032  5087 raft_consensus.cc:697] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:31.591043  5056 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:31.591629  5056 ts_tablet_manager.cc:1403] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.334s	user 0.015s	sys 0.011s
I20260709 13:12:31.592811  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 7dde9a121e3b41e3afb39390e431154f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:31.595077  5054 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:31.582006  5087 consensus_queue.cc:237] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.599798  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 7dde9a121e3b41e3afb39390e431154f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:31.601437  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dde9a121e3b41e3afb39390e431154f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.540266  5071 leader_election.cc:290] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:31.594679  5056 raft_consensus.cc:359] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.601538  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dde9a121e3b41e3afb39390e431154f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.606042  5056 raft_consensus.cc:385] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.606858  5056 raft_consensus.cc:740] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.607688  5056 consensus_queue.cc:260] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.610348  5056 ts_tablet_manager.cc:1434] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:31.611176  5009 raft_consensus.cc:2468] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:31.611574  5056 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:31.613914  4826 leader_election.cc:304] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:31.617134  5071 consensus_queue.cc:1048] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:31.622975  5071 raft_consensus.cc:2804] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.623526  5071 raft_consensus.cc:697] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:31.624428  5071 consensus_queue.cc:237] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.625662  5152 consensus_queue.cc:1048] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:31.628553  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 7dde9a121e3b41e3afb39390e431154f (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:31.631903  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dde9a121e3b41e3afb39390e431154f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.638055  5054 tablet_bootstrap.cc:654] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.651432  5056 tablet_bootstrap.cc:654] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.669061  5062 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:31.669263  4994 tablet_service.cc:1511] Processing CreateTablet for tablet dbaafca747714377b26752357eb9c97b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:31.670910  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaafca747714377b26752357eb9c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.673022  5055 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.669821  5062 ts_tablet_manager.cc:1403] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.002s
I20260709 13:12:31.673580  5055 ts_tablet_manager.cc:1403] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.021s
I20260709 13:12:31.673218  4921 tablet_service.cc:1511] Processing CreateTablet for tablet dbaafca747714377b26752357eb9c97b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:31.675217  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaafca747714377b26752357eb9c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.676702  5055 raft_consensus.cc:359] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.677457  5055 raft_consensus.cc:385] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.677762  5055 raft_consensus.cc:740] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.678449  5055 consensus_queue.cc:260] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.682546  5055 ts_tablet_manager.cc:1434] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:31.685102  5062 raft_consensus.cc:359] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.686000  5062 raft_consensus.cc:385] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.686297  5062 raft_consensus.cc:740] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.688305  4773 tablet_service.cc:1511] Processing CreateTablet for tablet dbaafca747714377b26752357eb9c97b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:31.689632  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaafca747714377b26752357eb9c97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.687868  5062 consensus_queue.cc:260] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.699352  5062 ts_tablet_manager.cc:1434] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:12:31.700524  5062 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:31.701538  4683 catalog_manager.cc:5697] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.707027  5062 tablet_bootstrap.cc:654] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.715342  5055 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.721644  4846 tablet_service.cc:1511] Processing CreateTablet for tablet 9388dee194834b479a120a34a1460d47 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:31.723058  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9388dee194834b479a120a34a1460d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.736796  5055 tablet_bootstrap.cc:654] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.750167  5056 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:31.750721  5056 ts_tablet_manager.cc:1403] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.004s
I20260709 13:12:31.751245  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 9388dee194834b479a120a34a1460d47 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:31.757381  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9388dee194834b479a120a34a1460d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.768939  5056 raft_consensus.cc:359] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.769814  5056 raft_consensus.cc:385] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.770123  5056 raft_consensus.cc:740] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.770905  5056 consensus_queue.cc:260] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.773147  5056 ts_tablet_manager.cc:1434] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:12:31.773027  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 9388dee194834b479a120a34a1460d47 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:31.774314  5056 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:31.774592  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9388dee194834b479a120a34a1460d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.777606  5055 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.778151  5055 ts_tablet_manager.cc:1403] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.014s
I20260709 13:12:31.774163  4681 catalog_manager.cc:5697] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.781088  5055 raft_consensus.cc:359] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.781850  5055 raft_consensus.cc:385] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.782136  5055 raft_consensus.cc:740] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.782966  5055 consensus_queue.cc:260] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.785408  4846 tablet_service.cc:1511] Processing CreateTablet for tablet eaa38c5ee7284bf6a4390de9a0f8ea74 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:31.786758  4846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa38c5ee7284bf6a4390de9a0f8ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.791213  4923 tablet_service.cc:1511] Processing CreateTablet for tablet eaa38c5ee7284bf6a4390de9a0f8ea74 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:31.792157  5056 tablet_bootstrap.cc:654] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.792490  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa38c5ee7284bf6a4390de9a0f8ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.785460  5055 ts_tablet_manager.cc:1434] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:12:31.795969  5055 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.800002  4776 tablet_service.cc:1511] Processing CreateTablet for tablet eaa38c5ee7284bf6a4390de9a0f8ea74 (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:31.801251  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa38c5ee7284bf6a4390de9a0f8ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.802963  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 92327700b56842d580bb260af45dad1b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:31.804245  5054 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:31.804803  5054 ts_tablet_manager.cc:1403] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.210s	user 0.011s	sys 0.015s
I20260709 13:12:31.804919  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92327700b56842d580bb260af45dad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.805962  4773 tablet_service.cc:1511] Processing CreateTablet for tablet 92327700b56842d580bb260af45dad1b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:31.807389  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92327700b56842d580bb260af45dad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.823382  5056 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:31.825986  5062 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:31.826553  5062 ts_tablet_manager.cc:1403] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.000s
I20260709 13:12:31.829460  5062 raft_consensus.cc:359] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.830199  5062 raft_consensus.cc:385] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.824038  5056 ts_tablet_manager.cc:1403] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.010s
I20260709 13:12:31.832924  4847 tablet_service.cc:1511] Processing CreateTablet for tablet 92327700b56842d580bb260af45dad1b (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:31.833829  5056 raft_consensus.cc:359] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.834578  5056 raft_consensus.cc:385] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.834877  5056 raft_consensus.cc:740] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.838280  5055 tablet_bootstrap.cc:654] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.838935  5056 consensus_queue.cc:260] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.840407  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2fbed84cd431a80e4b6875377505a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:31.841229  5056 ts_tablet_manager.cc:1434] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:31.841779  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2fbed84cd431a80e4b6875377505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.842314  5056 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:31.842861  5071 raft_consensus.cc:493] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.843384  5071 raft_consensus.cc:515] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.845665  5071 leader_election.cc:290] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:31.830514  5062 raft_consensus.cc:740] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.845778  5054 raft_consensus.cc:359] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.846660  5054 raft_consensus.cc:385] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.846951  5062 consensus_queue.cc:260] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.849628  5062 ts_tablet_manager.cc:1434] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:12:31.852419  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:31.854980  4825 leader_election.cc:343] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.856644  5056 tablet_bootstrap.cc:654] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.856835  5087 raft_consensus.cc:493] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.857396  5087 raft_consensus.cc:515] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.858855  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:31.859604  5009 raft_consensus.cc:2468] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:31.847007  5054 raft_consensus.cc:740] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.861063  5073 raft_consensus.cc:493] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.841562  4847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92327700b56842d580bb260af45dad1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.862119  4826 leader_election.cc:304] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:31.863071  5071 raft_consensus.cc:2804] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:31.863523  5071 raft_consensus.cc:493] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.863977  5071 raft_consensus.cc:3060] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.868330  5087 leader_election.cc:290] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:31.867796  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:31.869411  4860 raft_consensus.cc:2468] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:31.870920  4898 leader_election.cc:304] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:31.872187  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:31.872946  5087 raft_consensus.cc:2804] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:31.873445  5087 raft_consensus.cc:493] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.873831  5087 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:31.874028  4900 leader_election.cc:343] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.861596  5073 raft_consensus.cc:515] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.876217  5062 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:31.860746  5054 consensus_queue.cc:260] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.872170  5071 raft_consensus.cc:515] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.883548  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:31.884027  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:31.884663  5009 raft_consensus.cc:3060] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:31.885298  4825 leader_election.cc:343] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.892532  5054 ts_tablet_manager.cc:1434] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.004s
I20260709 13:12:31.892995  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:31.893841  5054 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:31.894222  5073 leader_election.cc:290] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:31.895342  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3481089e907345869da25ad79e97a113" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:31.898412  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2fbed84cd431a80e4b6875377505a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:31.899887  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2fbed84cd431a80e4b6875377505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.903079  4972 leader_election.cc:304] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:31.904589  5073 raft_consensus.cc:2749] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:31.905432  5071 leader_election.cc:290] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:31.906354  5009 raft_consensus.cc:2468] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:31.925197  5055 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:31.925781  5055 ts_tablet_manager.cc:1403] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.130s	user 0.019s	sys 0.027s
I20260709 13:12:31.926589  5087 raft_consensus.cc:515] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.929133  4826 leader_election.cc:304] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:31.930763  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:31.931162  5056 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:31.931458  4860 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.931747  5056 ts_tablet_manager.cc:1403] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.010s
I20260709 13:12:31.933085  5055 raft_consensus.cc:359] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.933933  5055 raft_consensus.cc:385] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.934286  5055 raft_consensus.cc:740] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.934932  5056 raft_consensus.cc:359] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.935678  5056 raft_consensus.cc:385] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.935166  5055 consensus_queue.cc:260] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.936015  5056 raft_consensus.cc:740] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.936532  5107 raft_consensus.cc:2804] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.937093  5107 raft_consensus.cc:697] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:31.936898  5056 consensus_queue.cc:260] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.938139  5107 consensus_queue.cc:237] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.942133  4860 raft_consensus.cc:2468] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:31.936844  4776 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2fbed84cd431a80e4b6875377505a (DEFAULT_TABLE table=test-workload [id=789d20aab7ec42a9a00cf1324f962ad9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:31.944048  4776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2fbed84cd431a80e4b6875377505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:31.946105  5055 ts_tablet_manager.cc:1434] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:12:31.946796  5062 tablet_bootstrap.cc:654] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.947182  5054 tablet_bootstrap.cc:654] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.950390  5056 ts_tablet_manager.cc:1434] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:31.953218  5055 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:31.956568  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:31.958372  4900 leader_election.cc:343] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.958752  5054 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:31.959321  5054 ts_tablet_manager.cc:1403] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.003s
I20260709 13:12:31.960904  4898 leader_election.cc:304] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:31.962153  5056 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:31.962250  5152 raft_consensus.cc:2804] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:31.962513  5054 raft_consensus.cc:359] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.963058  5152 raft_consensus.cc:697] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:31.963377  5054 raft_consensus.cc:385] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:31.963299  5092 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.964061  5092 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:31.959167  5087 leader_election.cc:290] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:31.964612  5071 raft_consensus.cc:493] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.966184  5054 raft_consensus.cc:740] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:31.966782  5152 consensus_queue.cc:237] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.969178  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:31.969756  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:31.970026  4859 raft_consensus.cc:2468] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:31.971364  5056 tablet_bootstrap.cc:654] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:31.971374  4749 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:31.972755  5131 raft_consensus.cc:2804] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:31.973282  5131 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.973071  5054 consensus_queue.cc:260] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:31.973748  5131 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:31.972359  5071 raft_consensus.cc:515] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:31.975497  5092 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
W20260709 13:12:31.975265  4750 leader_election.cc:343] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:31.985888  5054 ts_tablet_manager.cc:1434] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:12:31.987747  5054 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:31.983793  5092 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.988754  5092 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:31.995160  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:31.997282  4825 leader_election.cc:343] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.000597  5062 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:31.999500  5071 leader_election.cc:290] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.007483  5054 tablet_bootstrap.cc:654] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.012815  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.013270  5092 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.011057  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:32.009039  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:32.015364  4749 leader_election.cc:343] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.014573  5006 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:32.018536  4751 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:32.002390  5055 tablet_bootstrap.cc:654] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:32.019402  4826 leader_election.cc:343] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.019969  5092 raft_consensus.cc:2804] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.019935  4826 leader_election.cc:304] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:32.022109  5092 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.022619  5092 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.023088  5131 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
W20260709 13:12:32.026044  4900 consensus_peers.cc:597] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Couldn't send request to peer e3b9d92f86c74ea0b6537c30a8846eab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:32.026373  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.026587  5107 raft_consensus.cc:2749] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.021898  4681 catalog_manager.cc:5697] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.027108  4860 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.036892  5056 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.037432  5056 ts_tablet_manager.cc:1403] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 13:12:32.026286  4682 catalog_manager.cc:5697] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.040323  5056 raft_consensus.cc:359] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.041038  5056 raft_consensus.cc:385] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.041342  5056 raft_consensus.cc:740] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.042068  5056 consensus_queue.cc:260] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.029655  5062 ts_tablet_manager.cc:1403] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.004s
I20260709 13:12:32.045625  5087 raft_consensus.cc:493] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.046180  5087 raft_consensus.cc:515] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.029783  5091 raft_consensus.cc:493] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.030303  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:32.048069  5091 raft_consensus.cc:515] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.048755  5087 leader_election.cc:290] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:32.053078  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.053818  4784 raft_consensus.cc:2468] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:32.050446  5091 leader_election.cc:290] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
W20260709 13:12:32.054979  4750 leader_election.cc:343] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.055033  4901 leader_election.cc:304] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.055837  5062 raft_consensus.cc:359] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.056397  5152 raft_consensus.cc:2804] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.056557  5062 raft_consensus.cc:385] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.056895  5152 raft_consensus.cc:493] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.056974  5062 raft_consensus.cc:740] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.057423  5152 raft_consensus.cc:3060] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.057833  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:32.057972  5062 consensus_queue.cc:260] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.058466  5006 raft_consensus.cc:2468] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:32.059690  5062 ts_tablet_manager.cc:1434] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:12:32.060757  5062 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.044340  5055 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.053318  5054 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.063241  5054 ts_tablet_manager.cc:1403] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.013s
I20260709 13:12:32.066359  5054 raft_consensus.cc:359] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.066857  5062 tablet_bootstrap.cc:654] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.067207  5054 raft_consensus.cc:385] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.067596  5054 raft_consensus.cc:740] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.068173  5055 ts_tablet_manager.cc:1403] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.007s
I20260709 13:12:32.068470  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:32.033455  5092 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:32.073513  4751 leader_election.cc:343] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.075052  5056 ts_tablet_manager.cc:1434] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:12:32.076155  5056 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.056821  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.076834  4860 raft_consensus.cc:2468] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:32.077652  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:32.078200  4749 leader_election.cc:343] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.071770  5054 consensus_queue.cc:260] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.071491  5055 raft_consensus.cc:359] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.078742  4749 leader_election.cc:304] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:32.080125  5055 raft_consensus.cc:385] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.080500  5055 raft_consensus.cc:740] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.081099  5091 raft_consensus.cc:2749] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.081290  5054 ts_tablet_manager.cc:1434] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:32.078337  5009 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.081779  5055 consensus_queue.cc:260] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.082623  5054 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.085834  5006 raft_consensus.cc:3060] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.029081  5131 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.090121  5092 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.090523  5107 consensus_queue.cc:1048] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.091637  4749 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:32.093381  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.093983  4860 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.101156  4860 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:32.102416  5056 tablet_bootstrap.cc:654] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.102385  4749 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.103427  5131 raft_consensus.cc:2804] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.104100  5091 raft_consensus.cc:2804] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.104843  5131 raft_consensus.cc:697] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:32.101405  5054 tablet_bootstrap.cc:654] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.105839  5131 consensus_queue.cc:237] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.085834  5055 ts_tablet_manager.cc:1434] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:32.108201  5055 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.122843  5055 tablet_bootstrap.cc:654] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.124101  4784 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.124620  5062 tablet_bootstrap.cc:492] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.125083  5062 ts_tablet_manager.cc:1403] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.004s
I20260709 13:12:32.123405  5152 raft_consensus.cc:515] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.125555  5087 raft_consensus.cc:493] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.134063  5152 leader_election.cc:290] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:32.135389  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:32.136186  4785 raft_consensus.cc:3060] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.137501  5009 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:32.128885  5087 raft_consensus.cc:515] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.140184  5087 leader_election.cc:290] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.142678  5091 raft_consensus.cc:697] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:32.145423  5091 consensus_queue.cc:237] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.145814  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c66086fcb84985afe1bf786ed3726e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:32.146113  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.150377  5107 consensus_queue.cc:1048] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:32.150660  4901 leader_election.cc:343] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.156204  5059 consensus_queue.cc:1048] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.146415  5009 raft_consensus.cc:3060] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.159849  5056 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.160357  5056 ts_tablet_manager.cc:1403] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.009s
I20260709 13:12:32.156244  5062 raft_consensus.cc:359] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.163578  5062 raft_consensus.cc:385] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.163833  5062 raft_consensus.cc:740] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.164922  5062 consensus_queue.cc:260] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.171137  5056 raft_consensus.cc:359] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.172619  5056 raft_consensus.cc:385] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.173041  5062 ts_tablet_manager.cc:1434] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:32.173117  5056 raft_consensus.cc:740] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.174283  5062 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.172948  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.174582  5056 consensus_queue.cc:260] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.191852  4785 raft_consensus.cc:2468] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
W20260709 13:12:32.200927  4898 leader_election.cc:343] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.201469  4898 leader_election.cc:304] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:32.202641  5059 raft_consensus.cc:2749] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.197118  4901 leader_election.cc:304] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.204160  5059 raft_consensus.cc:2804] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.204349  5062 tablet_bootstrap.cc:654] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.204687  5059 raft_consensus.cc:697] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:32.205595  5059 consensus_queue.cc:237] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.201553  5009 raft_consensus.cc:2468] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:32.210717  5054 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.211298  5056 ts_tablet_manager.cc:1434] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:12:32.211424  5054 ts_tablet_manager.cc:1403] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.129s	user 0.025s	sys 0.018s
I20260709 13:12:32.212846  5056 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.216670  5055 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.217260  5055 ts_tablet_manager.cc:1403] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.000s
I20260709 13:12:32.220032  5055 raft_consensus.cc:359] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.220660  5055 raft_consensus.cc:385] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.220932  5055 raft_consensus.cc:740] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.222194  5055 consensus_queue.cc:260] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.237586  4683 catalog_manager.cc:5697] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.240211  5055 ts_tablet_manager.cc:1434] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:32.241420  5055 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.244562  4681 catalog_manager.cc:5697] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.246901  4681 catalog_manager.cc:5697] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.249442  5054 raft_consensus.cc:359] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.250200  5054 raft_consensus.cc:385] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.250530  5054 raft_consensus.cc:740] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.251252  5054 consensus_queue.cc:260] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.252036  5055 tablet_bootstrap.cc:654] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.256652  5062 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.257128  5062 ts_tablet_manager.cc:1403] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.008s
I20260709 13:12:32.261444  5056 tablet_bootstrap.cc:654] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.277374  5062 raft_consensus.cc:359] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.278179  5062 raft_consensus.cc:385] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.278447  5062 raft_consensus.cc:740] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.282639  5062 consensus_queue.cc:260] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.288640  5062 ts_tablet_manager.cc:1434] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:12:32.289588  5062 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.296868  5062 tablet_bootstrap.cc:654] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.300637  5055 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.301218  5055 ts_tablet_manager.cc:1403] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.003s
I20260709 13:12:32.304642  5055 raft_consensus.cc:359] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.308339  5054 ts_tablet_manager.cc:1434] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.000s
I20260709 13:12:32.312559  5062 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.313207  5054 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.313380  5062 ts_tablet_manager.cc:1403] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:12:32.316991  5062 raft_consensus.cc:359] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.317800  5062 raft_consensus.cc:385] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.318801  5152 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.319391  5152 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.318370  5062 raft_consensus.cc:740] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.320888  5062 consensus_queue.cc:260] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.308369  5055 raft_consensus.cc:385] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.323336  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.323799  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.324903  4860 raft_consensus.cc:2393] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:32.323415  5055 raft_consensus.cc:740] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.325131  5152 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.323804  5062 ts_tablet_manager.cc:1434] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:32.325827  5055 consensus_queue.cc:260] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.343910  5055 ts_tablet_manager.cc:1434] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:12:32.344697  5054 tablet_bootstrap.cc:654] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.345014  5055 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.350734  5087 raft_consensus.cc:493] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.351634  5062 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.351317  5087 raft_consensus.cc:515] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.353677  5087 leader_election.cc:290] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.355827  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:32.357380  4900 leader_election.cc:343] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.334678  5056 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.326139  4898 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:32.359031  5056 ts_tablet_manager.cc:1403] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.003s
I20260709 13:12:32.360504  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.361130  4860 raft_consensus.cc:2468] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:32.361797  5056 raft_consensus.cc:359] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.362205  4898 leader_election.cc:304] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:32.362464  5056 raft_consensus.cc:385] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.362812  5056 raft_consensus.cc:740] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.362879  5087 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.363551  5056 consensus_queue.cc:260] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.365545  5056 ts_tablet_manager.cc:1434] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:32.366488  5056 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.368021  5055 tablet_bootstrap.cc:654] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.369767  5152 raft_consensus.cc:2804] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.370174  5152 raft_consensus.cc:493] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.368278  5062 tablet_bootstrap.cc:654] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.370532  5152 raft_consensus.cc:3060] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.374441  5056 tablet_bootstrap.cc:654] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.379236  5055 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.379739  5055 ts_tablet_manager.cc:1403] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 13:12:32.378492  5152 raft_consensus.cc:515] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.385823  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.386499  4860 raft_consensus.cc:3060] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.388151  5062 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.388710  5062 ts_tablet_manager.cc:1403] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 13:12:32.391794  5062 raft_consensus.cc:359] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.392545  5062 raft_consensus.cc:385] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.392832  5062 raft_consensus.cc:740] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.395136  5056 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.395406  4860 raft_consensus.cc:2468] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:32.395715  5056 ts_tablet_manager.cc:1403] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:12:32.396760  4898 leader_election.cc:304] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:32.398922  5056 raft_consensus.cc:359] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.399706  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:32.400452  5059 raft_consensus.cc:2804] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.401104  5059 raft_consensus.cc:697] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
W20260709 13:12:32.401561  4900 leader_election.cc:343] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.399866  5152 leader_election.cc:290] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.400599  5062 consensus_queue.cc:260] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.382586  5087 raft_consensus.cc:2749] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.399749  5056 raft_consensus.cc:385] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.403380  5056 raft_consensus.cc:740] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.382488  5055 raft_consensus.cc:359] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.402180  5059 consensus_queue.cc:237] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.404713  5056 consensus_queue.cc:260] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.404230  5055 raft_consensus.cc:385] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.405895  5055 raft_consensus.cc:740] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.410663  5054 tablet_bootstrap.cc:492] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
W20260709 13:12:32.410888  4825 consensus_peers.cc:597] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:32.411214  5054 ts_tablet_manager.cc:1403] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.041s
I20260709 13:12:32.413559  5056 ts_tablet_manager.cc:1434] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:32.414777  5056 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.414621  5054 raft_consensus.cc:359] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.415441  5054 raft_consensus.cc:385] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.415715  5054 raft_consensus.cc:740] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.412119  5055 consensus_queue.cc:260] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.412202  5062 ts_tablet_manager.cc:1434] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:12:32.419327  5062 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.429348  5055 ts_tablet_manager.cc:1434] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:32.416476  5054 consensus_queue.cc:260] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.430866  5055 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.432386  5054 ts_tablet_manager.cc:1434] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:12:32.433458  5054 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.437675  5056 tablet_bootstrap.cc:654] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.442214  5107 raft_consensus.cc:493] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.442740  5107 raft_consensus.cc:515] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.444834  5107 leader_election.cc:290] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.445176  5054 tablet_bootstrap.cc:654] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.445552  4682 catalog_manager.cc:5697] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.447209  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.447908  4935 raft_consensus.cc:2468] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:32.449282  4825 leader_election.cc:304] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:32.450431  5119 raft_consensus.cc:2804] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.450801  5119 raft_consensus.cc:493] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.451123  5119 raft_consensus.cc:3060] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.451596  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.452250  4785 raft_consensus.cc:2468] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:32.441985  5062 tablet_bootstrap.cc:654] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.454438  5054 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.454931  5054 ts_tablet_manager.cc:1403] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 13:12:32.456238  5184 raft_consensus.cc:493] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.456746  5184 raft_consensus.cc:515] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.457716  5054 raft_consensus.cc:359] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.458380  5054 raft_consensus.cc:385] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.458630  5054 raft_consensus.cc:740] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.458884  5184 leader_election.cc:290] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.459518  5054 consensus_queue.cc:260] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.460289  5055 tablet_bootstrap.cc:654] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.460819  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.460892  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.461485  4785 raft_consensus.cc:2468] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:32.461674  4860 raft_consensus.cc:2468] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:32.462272  5054 ts_tablet_manager.cc:1434] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:32.463009  4975 leader_election.cc:304] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.463968  5184 raft_consensus.cc:2804] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.464386  5184 raft_consensus.cc:493] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.464802  5184 raft_consensus.cc:3060] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.468139  5054 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.468693  5073 raft_consensus.cc:493] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.469379  5073 raft_consensus.cc:515] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.474836  5073 leader_election.cc:290] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:32.475893  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.476898  5087 consensus_queue.cc:1048] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.475981  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd276985af7409ea9d00bf0d850b3b2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.479925  4975 leader_election.cc:304] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:32.482434  5119 raft_consensus.cc:515] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.484081  5073 raft_consensus.cc:2749] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.487947  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:32.488796  4785 raft_consensus.cc:3060] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.489794  5091 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.490321  5091 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.494012  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.494132  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:32.495482  4749 leader_election.cc:343] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.496464  5091 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.497195  5184 raft_consensus.cc:515] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.495079  4935 raft_consensus.cc:2468] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:32.500308  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:32.500905  4784 raft_consensus.cc:3060] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.500977  4750 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:32.502648  5091 raft_consensus.cc:2804] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.503135  5091 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.503557  5091 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.511583  5071 consensus_queue.cc:1048] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.512629  5062 tablet_bootstrap.cc:492] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.513386  5062 ts_tablet_manager.cc:1403] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.002s
I20260709 13:12:32.516172  5056 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.516691  5056 ts_tablet_manager.cc:1403] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.001s
I20260709 13:12:32.517158  5062 raft_consensus.cc:359] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.519124  5119 leader_election.cc:290] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.520766  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102e1754129b4dea9a2dab06dbab54c6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:32.521426  4935 raft_consensus.cc:3060] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.525197  4785 raft_consensus.cc:2468] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:32.526314  5091 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.518146  5062 raft_consensus.cc:385] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.527539  4827 leader_election.cc:304] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.528662  5056 raft_consensus.cc:359] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.530114  5056 raft_consensus.cc:385] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.530416  5056 raft_consensus.cc:740] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.531067  5056 consensus_queue.cc:260] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.531553  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b5a1385cb5e4ceea7a319f6861603a7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.532384  4859 raft_consensus.cc:3060] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.533166  5056 ts_tablet_manager.cc:1434] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:32.529613  5062 raft_consensus.cc:740] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.536787  5056 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.537889  5119 raft_consensus.cc:2804] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.540529  5119 raft_consensus.cc:697] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:32.541414  5119 consensus_queue.cc:237] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.535547  5184 leader_election.cc:290] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.542991  5073 raft_consensus.cc:493] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.538370  5062 consensus_queue.cc:260] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.543726  5073 raft_consensus.cc:515] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.539060  5054 tablet_bootstrap.cc:654] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.547227  4784 raft_consensus.cc:2468] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:32.558797  4975 leader_election.cc:304] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.554280  4859 raft_consensus.cc:2468] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:32.565743  5055 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.565828  5062 ts_tablet_manager.cc:1434] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.052s	user 0.020s	sys 0.007s
I20260709 13:12:32.566274  5055 ts_tablet_manager.cc:1403] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.136s	user 0.036s	sys 0.053s
W20260709 13:12:32.563268  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:32.569541  5008 raft_consensus.cc:3060] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.564806  5184 raft_consensus.cc:2804] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.570217  5184 raft_consensus.cc:697] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:32.571548  5091 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.573498  5073 leader_election.cc:290] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:32.574131  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.571199  5184 consensus_queue.cc:237] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:32.586423  4973 leader_election.cc:343] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.586640  5091 consensus_queue.cc:1048] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.582861  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.591365  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.592024  4784 raft_consensus.cc:2468] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:32.592907  5009 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.592828  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:32.593621  4934 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.593529  4975 leader_election.cc:304] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:32.594964  5073 raft_consensus.cc:2804] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.595351  5073 raft_consensus.cc:493] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.595721  5073 raft_consensus.cc:3060] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.602761  5056 tablet_bootstrap.cc:654] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.608629  5062 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.616698  5073 raft_consensus.cc:515] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.620915  4935 raft_consensus.cc:2468] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
W20260709 13:12:32.622784  4749 leader_election.cc:343] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.617662  5087 consensus_queue.cc:1048] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:32.624161  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:32.630065  5073 leader_election.cc:290] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:32.631997  5062 tablet_bootstrap.cc:654] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:32.632275  4973 leader_election.cc:343] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.635087  5055 raft_consensus.cc:359] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.636039  5055 raft_consensus.cc:385] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.637817  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:32.638453  4784 raft_consensus.cc:3060] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.639276  5091 consensus_queue.cc:1048] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.640552  5054 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.641027  5054 ts_tablet_manager.cc:1403] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.023s
I20260709 13:12:32.642796  5055 raft_consensus.cc:740] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.643778  5055 consensus_queue.cc:260] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.643846  5054 raft_consensus.cc:359] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.644675  5054 raft_consensus.cc:385] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.644958  5054 raft_consensus.cc:740] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.645602  5054 consensus_queue.cc:260] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.646178  5055 ts_tablet_manager.cc:1434] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.004s
I20260709 13:12:32.647337  5055 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.649369  5092 consensus_queue.cc:1048] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.651362  5054 ts_tablet_manager.cc:1434] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:32.652380  5054 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.646624  4934 raft_consensus.cc:2468] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:32.663515  5087 raft_consensus.cc:493] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.671710  5087 raft_consensus.cc:515] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.675422  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.683368  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95057452fb6c47048344f8f068d7c0d1" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:32.684940  4681 catalog_manager.cc:5697] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.674471  5087 leader_election.cc:290] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.690124  4900 leader_election.cc:304] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:32.694352  5054 tablet_bootstrap.cc:654] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.697643  5055 tablet_bootstrap.cc:654] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.704314  5152 raft_consensus.cc:2749] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.701858  5073 raft_consensus.cc:493] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.705201  4750 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:32.708683  4784 raft_consensus.cc:2468] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:32.709985  5086 consensus_queue.cc:1048] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.716183  5091 raft_consensus.cc:2804] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.712493  5073 raft_consensus.cc:515] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.733734  5073 leader_election.cc:290] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.735098  5062 tablet_bootstrap.cc:492] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.735661  5062 ts_tablet_manager.cc:1403] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.037s
I20260709 13:12:32.735487  5091 raft_consensus.cc:697] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:32.729737  4975 leader_election.cc:304] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:32.736882  5091 consensus_queue.cc:237] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.738095  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.738554  5062 raft_consensus.cc:359] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.739245  5062 raft_consensus.cc:385] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.739502  5062 raft_consensus.cc:740] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
W20260709 13:12:32.739777  4972 leader_election.cc:343] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.740211  5062 consensus_queue.cc:260] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.741370  5184 raft_consensus.cc:2804] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.741952  5184 raft_consensus.cc:697] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:32.746675  5062 ts_tablet_manager.cc:1434] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:32.751209  5062 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.742501  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:32.744488  5092 consensus_queue.cc:1048] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:32.743057  5184 consensus_queue.cc:237] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.755059  5056 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:32.770404  5056 ts_tablet_manager.cc:1403] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.003s
I20260709 13:12:32.776221  5062 tablet_bootstrap.cc:654] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.756093  4784 raft_consensus.cc:2468] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:32.766819  5107 raft_consensus.cc:493] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.780566  5107 raft_consensus.cc:515] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.756572  5086 consensus_queue.cc:1048] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:12:32.791759  5107 leader_election.cc:290] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.792524  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56e2153ec4421281afc2150b970668" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.793020  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56e2153ec4421281afc2150b970668" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:32.793484  4935 raft_consensus.cc:2468] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:32.793717  5009 raft_consensus.cc:2468] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:32.795022  4826 leader_election.cc:304] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:32.798875  4975 leader_election.cc:304] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:32.799576  5073 raft_consensus.cc:2804] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.799952  5073 raft_consensus.cc:493] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.800258  5073 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.797415  5107 raft_consensus.cc:2804] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.805706  5107 raft_consensus.cc:493] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.809051  5107 raft_consensus.cc:3060] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.813865  4681 catalog_manager.cc:5697] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.816725  5055 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.817221  5055 ts_tablet_manager.cc:1403] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.013s
I20260709 13:12:32.824404  5184 raft_consensus.cc:493] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.825009  5184 raft_consensus.cc:515] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.830257  5184 leader_election.cc:290] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.831737  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:32.832568  4858 raft_consensus.cc:2393] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f0ebe0c3053f48d6852e07257efbf0f9 in this term.
I20260709 13:12:32.833729  5055 raft_consensus.cc:359] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.834444  5055 raft_consensus.cc:385] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.835430  5055 raft_consensus.cc:740] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.836508  5055 consensus_queue.cc:260] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:32.840173  5055 ts_tablet_manager.cc:1434] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:12:32.840945  5055 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.850016  5056 raft_consensus.cc:359] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.850982  5056 raft_consensus.cc:385] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.851341  5056 raft_consensus.cc:740] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.854092  5073 raft_consensus.cc:515] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.856819  5054 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.857419  5054 ts_tablet_manager.cc:1403] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.010s
I20260709 13:12:32.858238  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:32.859114  4784 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.860467  5054 raft_consensus.cc:359] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.868907  5054 raft_consensus.cc:385] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.869274  5054 raft_consensus.cc:740] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.870095  4784 raft_consensus.cc:2468] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:32.863236  4682 catalog_manager.cc:5697] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.870092  5054 consensus_queue.cc:260] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.873931  5054 ts_tablet_manager.cc:1434] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:12:32.874840  5054 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.870163  4683 catalog_manager.cc:5697] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.878022  5009 raft_consensus.cc:3060] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.879684  4975 leader_election.cc:304] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:32.880564  5184 raft_consensus.cc:2804] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.881031  5184 raft_consensus.cc:697] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:32.881063  5073 leader_election.cc:290] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:32.882252  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:32.883581  5054 tablet_bootstrap.cc:654] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:32.884027  4972 leader_election.cc:343] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.884889  5062 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:32.885398  5062 ts_tablet_manager.cc:1403] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.047s
I20260709 13:12:32.888809  5062 raft_consensus.cc:359] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.864142  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6936f88d50994becb09fad0cbb8de81a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.899374  4973 leader_election.cc:304] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:32.865373  5055 tablet_bootstrap.cc:654] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.867646  5056 consensus_queue.cc:260] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:32.902515  5056 ts_tablet_manager.cc:1434] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.000s
I20260709 13:12:32.881985  5184 consensus_queue.cc:237] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:32.906881  5056 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:32.911161  5086 consensus_queue.cc:1048] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.889688  5062 raft_consensus.cc:385] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:32.865008  5217 log.cc:927] Time spent T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:32.902940  5206 raft_consensus.cc:2749] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:32.913715  5062 raft_consensus.cc:740] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.916003  5062 consensus_queue.cc:260] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.915364  5056 tablet_bootstrap.cc:654] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.922875  5062 ts_tablet_manager.cc:1434] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 13:12:32.923907  5062 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:32.930199  5062 tablet_bootstrap.cc:654] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.868151  5107 raft_consensus.cc:515] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.945298  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56e2153ec4421281afc2150b970668" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:32.945575  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b56e2153ec4421281afc2150b970668" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:32.945930  4934 raft_consensus.cc:3060] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.946180  5007 raft_consensus.cc:3060] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.951936  4681 catalog_manager.cc:5697] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.953225  5107 leader_election.cc:290] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:32.954252  5007 raft_consensus.cc:2468] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:32.955470  4826 leader_election.cc:304] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:32.956468  5107 raft_consensus.cc:2804] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.957160  5054 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:32.957603  5107 raft_consensus.cc:697] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:32.957877  5054 ts_tablet_manager.cc:1403] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.060s
I20260709 13:12:32.960713  4935 raft_consensus.cc:3060] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.961568  4934 raft_consensus.cc:2468] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:32.962594  5054 raft_consensus.cc:359] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.963621  5054 raft_consensus.cc:385] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.963974  5054 raft_consensus.cc:740] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.965059  5054 consensus_queue.cc:260] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.968014  5054 ts_tablet_manager.cc:1434] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:32.968282  5206 raft_consensus.cc:493] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.968973  5054 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:32.968817  5206 raft_consensus.cc:515] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.971905  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c40c4ad6094ad0a5be7f2f349a9d29" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:32.973423  4972 leader_election.cc:343] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:32.974195  5206 leader_election.cc:290] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:32.975118  5055 tablet_bootstrap.cc:492] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:32.977841  5055 ts_tablet_manager.cc:1403] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.137s	user 0.006s	sys 0.008s
I20260709 13:12:32.980652  5055 raft_consensus.cc:359] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.981734  5055 raft_consensus.cc:385] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.981629  5152 consensus_queue.cc:1048] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.982273  5055 raft_consensus.cc:740] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.983139  5055 consensus_queue.cc:260] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:32.983727  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c40c4ad6094ad0a5be7f2f349a9d29" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:32.984490  4934 raft_consensus.cc:2468] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:32.975123  5054 tablet_bootstrap.cc:654] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.986240  4973 leader_election.cc:304] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:32.986589  5055 ts_tablet_manager.cc:1434] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:32.987758  5055 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:32.987787  5184 raft_consensus.cc:2804] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:32.988402  5184 raft_consensus.cc:493] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.988766  5184 raft_consensus.cc:3060] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.997282  5055 tablet_bootstrap.cc:654] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.006431  5119 consensus_queue.cc:1048] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.009341  5206 consensus_queue.cc:1048] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:32.975399  5107 consensus_queue.cc:237] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.030042  5184 raft_consensus.cc:515] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.030450  5071 consensus_queue.cc:1048] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:32.942586  5056 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.042917  5056 ts_tablet_manager.cc:1403] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.004s
I20260709 13:12:33.045895  5056 raft_consensus.cc:359] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.046430  5056 raft_consensus.cc:385] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.053580  4681 catalog_manager.cc:5697] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.059695  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c40c4ad6094ad0a5be7f2f349a9d29" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:33.060638  4861 raft_consensus.cc:3060] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.065023  5184 leader_election.cc:290] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.064845  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c40c4ad6094ad0a5be7f2f349a9d29" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.069471  4934 raft_consensus.cc:3060] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.072065  4861 raft_consensus.cc:2468] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:33.046663  5056 raft_consensus.cc:740] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.076766  5056 consensus_queue.cc:260] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.077224  4972 leader_election.cc:304] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:33.078732  5184 raft_consensus.cc:2804] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.078833  5056 ts_tablet_manager.cc:1434] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:12:33.081357  5062 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.081856  5056 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.081851  5062 ts_tablet_manager.cc:1403] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.021s
I20260709 13:12:33.086588  5062 raft_consensus.cc:359] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.087306  5062 raft_consensus.cc:385] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.087574  5062 raft_consensus.cc:740] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.089704  5056 tablet_bootstrap.cc:654] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.089954  5055 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.090454  5055 ts_tablet_manager.cc:1403] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.103s	user 0.038s	sys 0.032s
I20260709 13:12:33.092959  5184 raft_consensus.cc:697] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:33.093092  5055 raft_consensus.cc:359] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.093802  5055 raft_consensus.cc:385] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.094125  5055 raft_consensus.cc:740] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.093940  5184 consensus_queue.cc:237] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.088408  5062 consensus_queue.cc:260] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.095628  5055 consensus_queue.cc:260] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.097687  5055 ts_tablet_manager.cc:1434] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:12:33.074680  5054 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.100803  5062 ts_tablet_manager.cc:1434] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:12:33.101790  5062 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.099248  5206 consensus_queue.cc:1048] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:33.103626  5054 ts_tablet_manager.cc:1403] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.016s
I20260709 13:12:33.098598  5055 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.106462  5054 raft_consensus.cc:359] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.112624  5054 raft_consensus.cc:385] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.112937  5054 raft_consensus.cc:740] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.113379  5107 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.113698  5054 consensus_queue.cc:260] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.113919  5107 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.115759  5054 ts_tablet_manager.cc:1434] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:33.116120  5107 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.116707  5054 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.117743  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.119283  4934 raft_consensus.cc:2468] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:33.119683  5062 tablet_bootstrap.cc:654] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.120105  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.122913  5055 tablet_bootstrap.cc:654] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.123131  4935 raft_consensus.cc:2393] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d069c6c6db44e9882ec432292c00563 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:33.129604  5056 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.130064  5056 ts_tablet_manager.cc:1403] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.005s
I20260709 13:12:33.132247  5056 raft_consensus.cc:359] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.132882  5056 raft_consensus.cc:385] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.133176  5056 raft_consensus.cc:740] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.127556  4825 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:33.135121  5056 consensus_queue.cc:260] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.135749  5107 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.145965  5056 ts_tablet_manager.cc:1434] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:12:33.147125  5056 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.144505  4682 catalog_manager.cc:5697] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.152504  5054 tablet_bootstrap.cc:654] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.154171  5056 tablet_bootstrap.cc:654] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.155988  5107 raft_consensus.cc:2749] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.158414  5086 raft_consensus.cc:493] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.158990  5086 raft_consensus.cc:515] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.161095  5092 consensus_queue.cc:1048] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.162659  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.163383  5007 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:33.161095  5086 leader_election.cc:290] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.164876  4900 leader_election.cc:304] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:33.164882  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.168045  5086 raft_consensus.cc:2804] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.167366  4785 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:33.177922  5086 raft_consensus.cc:493] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.178579  5086 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.180596  5062 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.181176  5062 ts_tablet_manager.cc:1403] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.006s
I20260709 13:12:33.185396  5054 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.185874  5054 ts_tablet_manager.cc:1403] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.008s
I20260709 13:12:33.191586  5055 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.192137  5055 ts_tablet_manager.cc:1403] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.026s
I20260709 13:12:33.192003  5054 raft_consensus.cc:359] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.192835  5054 raft_consensus.cc:385] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.193145  5054 raft_consensus.cc:740] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.195559  5054 consensus_queue.cc:260] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.195974  5055 raft_consensus.cc:359] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.196764  5055 raft_consensus.cc:385] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.197149  5055 raft_consensus.cc:740] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.198127  5054 ts_tablet_manager.cc:1434] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:12:33.197860  5055 consensus_queue.cc:260] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.200246  5055 ts_tablet_manager.cc:1434] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:33.200403  5054 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.200554  5062 raft_consensus.cc:359] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.201279  5062 raft_consensus.cc:385] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.201388  5055 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.201594  5062 raft_consensus.cc:740] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.203804  5056 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.204310  5056 ts_tablet_manager.cc:1403] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260709 13:12:33.207425  5056 raft_consensus.cc:359] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.207897  5055 tablet_bootstrap.cc:654] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.208122  5056 raft_consensus.cc:385] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.208431  5056 raft_consensus.cc:740] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.208630  5054 tablet_bootstrap.cc:654] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.209306  5062 consensus_queue.cc:260] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.210414  5056 consensus_queue.cc:260] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.214815  5062 ts_tablet_manager.cc:1434] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:12:33.216910  5056 ts_tablet_manager.cc:1434] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:33.218165  5056 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.222827  5062 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.256397  5131 consensus_queue.cc:1048] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.259888  5056 tablet_bootstrap.cc:654] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.263468  5062 tablet_bootstrap.cc:654] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.257647  5086 raft_consensus.cc:515] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:33.265681  5246 log.cc:927] Time spent T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: Append to log took a long time: real 0.082s	user 0.000s	sys 0.004s
I20260709 13:12:33.272782  5086 leader_election.cc:290] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.276319  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:33.276814  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:33.282171  5055 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.282574  5055 ts_tablet_manager.cc:1403] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.081s	user 0.035s	sys 0.021s
I20260709 13:12:33.283119  4784 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.283600  5007 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.284456  5054 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.284902  5054 ts_tablet_manager.cc:1403] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.028s
I20260709 13:12:33.289827  5184 consensus_queue.cc:1048] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.301108  5007 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:33.306116  4900 leader_election.cc:304] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:33.306797  5086 raft_consensus.cc:493] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.307068  5152 raft_consensus.cc:2804] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.307679  5152 raft_consensus.cc:697] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:33.308513  5152 consensus_queue.cc:237] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.309147  5055 raft_consensus.cc:359] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.310117  5055 raft_consensus.cc:385] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.311108  5071 raft_consensus.cc:493] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.311583  5071 raft_consensus.cc:515] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.307324  5086 raft_consensus.cc:515] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.313613  5071 leader_election.cc:290] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.303604  4784 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:33.313992  5086 leader_election.cc:290] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.313957  5054 raft_consensus.cc:359] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.315774  5054 raft_consensus.cc:385] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.316143  5054 raft_consensus.cc:740] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.315502  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.316783  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.316844  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.317739  4783 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.319020  5062 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.317215  4786 raft_consensus.cc:2393] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate e3b9d92f86c74ea0b6537c30a8846eab in this term.
I20260709 13:12:33.319514  5062 ts_tablet_manager.cc:1403] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.104s	user 0.025s	sys 0.007s
I20260709 13:12:33.310485  5055 raft_consensus.cc:740] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.316922  5054 consensus_queue.cc:260] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.322108  4934 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.321954  5055 consensus_queue.cc:260] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.323205  4933 raft_consensus.cc:3060] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.326419  5054 ts_tablet_manager.cc:1434] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:12:33.327736  5054 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.320720  4827 leader_election.cc:304] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.332633  5055 ts_tablet_manager.cc:1434] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:12:33.333072  5107 raft_consensus.cc:2804] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.333683  5055 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.333796  5107 raft_consensus.cc:493] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.336100  5107 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.338956  5062 raft_consensus.cc:359] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.339735  5062 raft_consensus.cc:385] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.342478  5056 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.342557  5184 consensus_queue.cc:1048] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.343245  5056 ts_tablet_manager.cc:1403] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.004s
I20260709 13:12:33.346038  5056 raft_consensus.cc:359] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.347249  5071 raft_consensus.cc:493] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.347855  5071 raft_consensus.cc:515] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.341197  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62609ec3ccb34bd699d9ec237ef73fc7" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.340091  5062 raft_consensus.cc:740] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.350658  5054 tablet_bootstrap.cc:654] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.350823  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.354781  5055 tablet_bootstrap.cc:654] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.353726  5056 raft_consensus.cc:385] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.357970  5056 raft_consensus.cc:740] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.351570  5107 raft_consensus.cc:515] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.359608  5056 consensus_queue.cc:260] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.352340  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.363149  4827 leader_election.cc:304] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:33.364362  5119 raft_consensus.cc:2749] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.353681  5071 leader_election.cc:290] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.361121  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:33.352233  4900 leader_election.cc:304] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:33.361122  5056 ts_tablet_manager.cc:1434] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:12:33.367785  5086 raft_consensus.cc:2749] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.368690  5056 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.369374  5184 consensus_queue.cc:1048] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.366902  4784 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.375432  5107 leader_election.cc:290] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.383155  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.383985  4935 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.392439  4784 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:33.398125  4827 leader_election.cc:304] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.399363  5107 raft_consensus.cc:2804] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.400218  5107 raft_consensus.cc:697] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:33.401314  5107 consensus_queue.cc:237] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.354169  5062 consensus_queue.cc:260] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.406399  4861 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.409003  5062 ts_tablet_manager.cc:1434] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 13:12:33.410315  5062 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.395637  5056 tablet_bootstrap.cc:654] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.414881  5206 consensus_queue.cc:1048] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.424459  5092 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.425077  5092 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.426260  4680 catalog_manager.cc:5697] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.428169  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.428858  5009 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.429920  4751 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.430910  5131 raft_consensus.cc:2804] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.431236  5092 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:33.431269  5131 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.432179  5131 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.435822  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:33.436487  4860 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.439221  4935 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:33.447044  5062 tablet_bootstrap.cc:654] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.452744  5131 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.459344  5071 consensus_queue.cc:1048] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.459728  5131 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:33.464955  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:33.465271  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:33.465566  5009 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.465960  4861 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.467775  4682 catalog_manager.cc:5697] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.475627  4861 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:33.476230  5056 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.476743  5056 ts_tablet_manager.cc:1403] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 13:12:33.476908  4749 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.479525  5054 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.480019  5054 ts_tablet_manager.cc:1403] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.032s
I20260709 13:12:33.481894  5009 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:33.483426  5056 raft_consensus.cc:359] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.484189  5056 raft_consensus.cc:385] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.484467  5056 raft_consensus.cc:740] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.485117  5056 consensus_queue.cc:260] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.486093  5092 raft_consensus.cc:2804] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.485963  5263 consensus_queue.cc:1048] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.486611  5092 raft_consensus.cc:697] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:33.487217  5056 ts_tablet_manager.cc:1434] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:33.487447  5092 consensus_queue.cc:237] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.488170  5056 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.494280  5055 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.494793  5055 ts_tablet_manager.cc:1403] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.161s	user 0.021s	sys 0.007s
I20260709 13:12:33.497453  5055 raft_consensus.cc:359] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.498080  5055 raft_consensus.cc:385] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.498334  5055 raft_consensus.cc:740] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.499516  5054 raft_consensus.cc:359] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.500300  5054 raft_consensus.cc:385] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.500566  5054 raft_consensus.cc:740] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.494515  5056 tablet_bootstrap.cc:654] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.503042  5131 raft_consensus.cc:493] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.503739  5131 raft_consensus.cc:515] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.509971  5131 leader_election.cc:290] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:33.510124  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.516561  5009 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.518181  4751 leader_election.cc:304] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.513628  5056 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.519327  5056 ts_tablet_manager.cc:1403] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:12:33.519518  5055 consensus_queue.cc:260] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.519904  4683 catalog_manager.cc:5697] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.522269  5055 ts_tablet_manager.cc:1434] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:12:33.522394  5056 raft_consensus.cc:359] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.515224  5054 consensus_queue.cc:260] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.515859  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.523234  5055 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.523973  4935 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.526389  5054 ts_tablet_manager.cc:1434] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 13:12:33.527664  5054 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.529340  5055 tablet_bootstrap.cc:654] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.534006  5054 tablet_bootstrap.cc:654] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.523357  5091 raft_consensus.cc:2804] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.534951  5091 raft_consensus.cc:493] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.535408  5091 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.523188  5056 raft_consensus.cc:385] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.537153  5056 raft_consensus.cc:740] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.538092  5056 consensus_queue.cc:260] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.540686  5056 ts_tablet_manager.cc:1434] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:12:33.541694  5056 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.552965  5056 tablet_bootstrap.cc:654] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.558988  5091 raft_consensus.cc:515] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.563544  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.564347  4935 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.564870  5263 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.565567  5263 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.571820  5131 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.572409  5131 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.574589  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.575309  4786 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.575398  5131 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.578303  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.579054  4934 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.579607  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:33.580286  4858 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.580824  4750 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.581902  5131 raft_consensus.cc:2804] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.582330  5131 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.582715  5131 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.582847  4827 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.583777  5071 raft_consensus.cc:2804] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.584144  5071 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.584266  5258 consensus_queue.cc:1048] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.584558  5071 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.590632  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.591312  4934 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.591773  4935 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:33.593065  4750 leader_election.cc:304] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.593919  5092 raft_consensus.cc:2804] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.594820  5263 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.596244  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:33.596917  5009 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.599575  5054 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.600090  5054 ts_tablet_manager.cc:1403] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.073s	user 0.004s	sys 0.009s
I20260709 13:12:33.594885  5091 leader_election.cc:290] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:33.590679  5131 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.605707  5071 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.606060  5258 consensus_queue.cc:1048] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.608794  5009 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:33.617269  5119 raft_consensus.cc:493] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.617885  5119 raft_consensus.cc:515] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.619356  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:33.620256  4861 raft_consensus.cc:2393] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c95e5d9485488f9de4ffe24035c81d in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:33.621004  5119 leader_election.cc:290] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:33.625497  5054 raft_consensus.cc:359] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.626423  5054 raft_consensus.cc:385] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.628144  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.629403  5054 raft_consensus.cc:740] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.631325  5054 consensus_queue.cc:260] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.628795  5092 raft_consensus.cc:697] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:33.633795  5062 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.634363  5062 ts_tablet_manager.cc:1403] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.224s	user 0.024s	sys 0.016s
I20260709 13:12:33.635149  5131 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
W20260709 13:12:33.637564  4825 leader_election.cc:343] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.638059  5131 raft_consensus.cc:493] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.639756  5131 raft_consensus.cc:515] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.640379  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:33.640784  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.641137  4786 raft_consensus.cc:2393] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d069c6c6db44e9882ec432292c00563 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:33.641373  4933 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.641952  5062 raft_consensus.cc:359] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.642596  5062 raft_consensus.cc:385] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.642897  5062 raft_consensus.cc:740] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.643535  5062 consensus_queue.cc:260] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.646728  5062 ts_tablet_manager.cc:1434] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:12:33.646804  5131 leader_election.cc:290] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:33.647437  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:33.649366  4749 leader_election.cc:343] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.650125  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.632915  5092 consensus_queue.cc:237] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.652560  5056 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.651829  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.663319  5009 raft_consensus.cc:2468] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.664780  5056 ts_tablet_manager.cc:1403] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.011s
I20260709 13:12:33.665560  4826 leader_election.cc:304] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:33.666421  5263 raft_consensus.cc:2804] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.666822  5263 raft_consensus.cc:493] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.667146  5263 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.667636  5056 raft_consensus.cc:359] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.668349  5056 raft_consensus.cc:385] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.668605  5056 raft_consensus.cc:740] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.669374  5056 consensus_queue.cc:260] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.655067  4825 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:33.670748  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.670876  5119 raft_consensus.cc:2749] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.671196  5056 ts_tablet_manager.cc:1434] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:12:33.672217  4751 leader_election.cc:343] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.672677  4751 leader_election.cc:304] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:33.655460  5055 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.674480  5055 ts_tablet_manager.cc:1403] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.031s
I20260709 13:12:33.675455  5272 raft_consensus.cc:2749] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.675510  5263 raft_consensus.cc:515] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.651914  5071 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.678261  5055 raft_consensus.cc:359] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.681432  5055 raft_consensus.cc:385] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.681195  5056 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.679090  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:33.681751  5054 ts_tablet_manager.cc:1434] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.005s
I20260709 13:12:33.681860  5055 raft_consensus.cc:740] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.684327  5054 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.685688  5055 consensus_queue.cc:260] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.687084  5062 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.680647  5263 leader_election.cc:290] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:33.679436  4933 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:33.684964  5009 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.694242  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:33.700452  5055 ts_tablet_manager.cc:1434] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:12:33.701273  5055 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.706092  4750 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:33.708636  5131 raft_consensus.cc:2804] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.709220  5131 raft_consensus.cc:697] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
W20260709 13:12:33.708206  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:33.712153  4825 leader_election.cc:343] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.714465  5062 tablet_bootstrap.cc:654] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.717515  5009 raft_consensus.cc:2468] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:33.719503  4826 leader_election.cc:304] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:33.724866  5263 raft_consensus.cc:2804] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.725613  5263 raft_consensus.cc:697] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:33.729936  5055 tablet_bootstrap.cc:654] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.726882  5263 consensus_queue.cc:237] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.730935  5056 tablet_bootstrap.cc:654] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.732059  5054 tablet_bootstrap.cc:654] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.710084  5131 consensus_queue.cc:237] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.783308  5056 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.783742  5056 ts_tablet_manager.cc:1403] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.003s
I20260709 13:12:33.784773  5055 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.785205  5055 ts_tablet_manager.cc:1403] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.018s
I20260709 13:12:33.785898  5062 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.786414  5062 ts_tablet_manager.cc:1403] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.018s
I20260709 13:12:33.787320  5055 raft_consensus.cc:359] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.787904  5055 raft_consensus.cc:385] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.788147  5055 raft_consensus.cc:740] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.787467  4680 catalog_manager.cc:5697] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.788727  5055 consensus_queue.cc:260] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.789039  5062 raft_consensus.cc:359] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.789768  5062 raft_consensus.cc:385] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.790053  5062 raft_consensus.cc:740] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.789417  4680 catalog_manager.cc:5697] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.790478  5055 ts_tablet_manager.cc:1434] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:33.791270  5055 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:33.792071  5054 tablet_bootstrap.cc:492] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.792536  5054 ts_tablet_manager.cc:1403] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.004s
I20260709 13:12:33.793598  5056 raft_consensus.cc:359] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.794247  5056 raft_consensus.cc:385] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.794510  5056 raft_consensus.cc:740] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.795766  5062 consensus_queue.cc:260] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.795110  5054 raft_consensus.cc:359] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.798250  5062 ts_tablet_manager.cc:1434] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:12:33.798331  5054 raft_consensus.cc:385] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.798801  5054 raft_consensus.cc:740] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.795372  5056 consensus_queue.cc:260] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.799851  5062 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.799551  5054 consensus_queue.cc:260] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:33.801407  5056 ts_tablet_manager.cc:1434] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:33.802336  5056 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.806520  5062 tablet_bootstrap.cc:654] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.807930  5056 tablet_bootstrap.cc:654] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.811117  5055 tablet_bootstrap.cc:654] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.822494  5059 consensus_queue.cc:1048] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.833168  5062 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:33.839779  5263 consensus_queue.cc:1048] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.854279  5062 ts_tablet_manager.cc:1403] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.012s
I20260709 13:12:33.866088  5119 consensus_queue.cc:1048] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:33.867635  5119 raft_consensus.cc:493] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.868283  5054 ts_tablet_manager.cc:1434] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 13:12:33.868114  5119 raft_consensus.cc:515] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.869330  5054 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:33.871114  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.871366  5131 raft_consensus.cc:493] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.871815  5007 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.871971  5272 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.871837  5131 raft_consensus.cc:515] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.872467  5272 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.874280  4826 leader_election.cc:304] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:33.876328  5131 leader_election.cc:290] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:33.877302  5263 raft_consensus.cc:2804] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.877760  5263 raft_consensus.cc:493] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.878121  5263 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.878225  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:33.879480  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:33.877434  5272 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
W20260709 13:12:33.881167  4749 leader_election.cc:343] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.884058  5119 leader_election.cc:290] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.883829  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:33.884665  4751 leader_election.cc:343] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.886340  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.886859  4751 leader_election.cc:304] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:33.887396  4933 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:33.888893  5263 raft_consensus.cc:515] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.890488  4750 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.891671  5092 raft_consensus.cc:2749] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.892472  5092 raft_consensus.cc:493] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.893009  5092 raft_consensus.cc:515] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:33.894793  5131 raft_consensus.cc:2804] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:33.892462  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:33.895851  4784 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:33.893721  5263 leader_election.cc:290] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:33.905691  5054 tablet_bootstrap.cc:654] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.907737  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:33.909253  4749 leader_election.cc:343] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.911043  5092 leader_election.cc:290] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:33.913523  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:33.895275  5131 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.872403  4683 catalog_manager.cc:5697] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:33.918850  4750 leader_election.cc:343] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.931329  5056 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:33.931866  5056 ts_tablet_manager.cc:1403] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.130s	user 0.042s	sys 0.041s
I20260709 13:12:33.922080  5062 raft_consensus.cc:359] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.935096  5062 raft_consensus.cc:385] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.935402  5062 raft_consensus.cc:740] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.936113  5062 consensus_queue.cc:260] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.937579  5062 ts_tablet_manager.cc:1434] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:12:33.938434  5062 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:33.946338  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:33.946462  5056 raft_consensus.cc:359] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.947137  5007 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.947639  5056 raft_consensus.cc:385] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:33.948035  5056 raft_consensus.cc:740] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:33.946400  5086 consensus_queue.cc:1048] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:33.949029  5056 consensus_queue.cc:260] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:33.953351  5056 ts_tablet_manager.cc:1434] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:12:33.954646  5056 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:33.935247  4750 leader_election.cc:304] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:33.947301  5092 consensus_queue.cc:1048] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:33.959645  5272 raft_consensus.cc:2749] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:33.924309  5131 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:33.895848  4751 leader_election.cc:343] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:33.963308  5056 tablet_bootstrap.cc:654] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:33.963339  4751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:34929, user_credentials={real_user=slave}} blocked reactor thread for 67527us
I20260709 13:12:33.968258  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:33.968875  4784 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:33.969774  5062 tablet_bootstrap.cc:654] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:33.976850  4784 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:33.978015  4827 leader_election.cc:304] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:33.978884  5263 raft_consensus.cc:2804] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:33.979424  5263 raft_consensus.cc:697] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:33.980223  5263 consensus_queue.cc:237] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:33.984079  5092 consensus_queue.cc:1048] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:33.997323  5055 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:33.997889  5055 ts_tablet_manager.cc:1403] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.207s	user 0.035s	sys 0.034s
I20260709 13:12:33.998061  5054 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:33.998574  5054 ts_tablet_manager.cc:1403] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.001s
I20260709 13:12:33.998970  5086 raft_consensus.cc:493] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.999491  5086 raft_consensus.cc:515] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.000888  5055 raft_consensus.cc:359] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.001566  5055 raft_consensus.cc:385] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.001621  5086 leader_election.cc:290] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.001921  5055 raft_consensus.cc:740] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.002890  5119 raft_consensus.cc:493] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.003315  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.003611  5119 raft_consensus.cc:515] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.005030  5055 consensus_queue.cc:260] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.006006  5054 raft_consensus.cc:359] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.006656  5054 raft_consensus.cc:385] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.006916  5119 leader_election.cc:290] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.007098  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.007241  5054 raft_consensus.cc:740] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.007462  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.008141  5054 consensus_queue.cc:260] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
W20260709 13:12:34.008978  4826 leader_election.cc:343] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.009032  4933 raft_consensus.cc:2468] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:34.010453  5055 ts_tablet_manager.cc:1434] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:12:34.011372  5054 ts_tablet_manager.cc:1434] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:34.012689  5054 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.011417  5055 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.052377  5055 tablet_bootstrap.cc:654] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.052228  5007 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:34.052630  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.053529  5005 raft_consensus.cc:2393] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:34.059092  5131 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.061406  5131 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.062090  5054 tablet_bootstrap.cc:654] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.064785  5056 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.065351  5056 ts_tablet_manager.cc:1403] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.010s
I20260709 13:12:34.070863  5184 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.071473  5184 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.093868  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:34.095024  5007 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.114657  5062 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.115453  5062 ts_tablet_manager.cc:1403] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.005s
I20260709 13:12:34.120369  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.121282  4785 raft_consensus.cc:2393] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:34.121261  4825 leader_election.cc:304] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.124416  5107 raft_consensus.cc:2804] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.124939  5107 raft_consensus.cc:493] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.125393  5107 raft_consensus.cc:3060] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.134985  5184 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:34.135563  5286 log.cc:927] Time spent T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260709 13:12:34.144255  5056 raft_consensus.cc:359] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.145387  5056 raft_consensus.cc:385] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.145727  5056 raft_consensus.cc:740] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.150607  5062 raft_consensus.cc:359] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.151628  5062 raft_consensus.cc:385] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.151962  5062 raft_consensus.cc:740] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.152870  5062 consensus_queue.cc:260] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.156203  5056 consensus_queue.cc:260] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.159619  5056 ts_tablet_manager.cc:1434] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:12:34.160496  5056 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:34.162278  5062 ts_tablet_manager.cc:1434] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:12:34.163630  5062 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
W20260709 13:12:34.156317  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:34929, user_credentials={real_user=slave}} blocked reactor thread for 84867.4us
I20260709 13:12:34.166714  4900 leader_election.cc:304] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.172438  5055 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.172950  5055 ts_tablet_manager.cc:1403] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.004s
I20260709 13:12:34.176518  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:34.177212  4935 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.178632  5131 consensus_queue.cc:1048] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.178890  5263 consensus_queue.cc:1048] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.183465  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.193816  5054 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.194414  5054 ts_tablet_manager.cc:1403] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.010s
I20260709 13:12:34.198925  4973 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:34.207777  5297 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.206866  5055 raft_consensus.cc:359] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.211580  5055 raft_consensus.cc:385] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.211908  5055 raft_consensus.cc:740] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.217923  5055 consensus_queue.cc:260] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.221122  4935 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:34.222968  4680 catalog_manager.cc:5697] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.223942  5107 raft_consensus.cc:515] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.226152  5107 leader_election.cc:290] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.228608  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:34.228662  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:34.229496  4932 raft_consensus.cc:3060] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:34.230805  4826 leader_election.cc:343] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.237008  4750 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.237957  5131 raft_consensus.cc:2804] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.238660  5091 consensus_queue.cc:1048] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.240113  5131 raft_consensus.cc:697] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:34.251210  5055 ts_tablet_manager.cc:1434] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:12:34.253213  5055 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.251034  5007 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:34.254112  5184 raft_consensus.cc:2749] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.251924  5131 consensus_queue.cc:237] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.258087  5056 tablet_bootstrap.cc:654] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.264719  5091 consensus_queue.cc:1048] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.265357  5297 raft_consensus.cc:2749] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.276084  5055 tablet_bootstrap.cc:654] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.288764  5119 consensus_queue.cc:1048] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.289137  5054 raft_consensus.cc:359] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.289887  5054 raft_consensus.cc:385] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.290158  5054 raft_consensus.cc:740] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.302996  5054 consensus_queue.cc:260] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.309463  5054 ts_tablet_manager.cc:1434] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:12:34.310878  5062 tablet_bootstrap.cc:654] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.306941  4932 raft_consensus.cc:2468] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:34.321875  5056 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.322399  5056 ts_tablet_manager.cc:1403] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.003s
I20260709 13:12:34.325023  5056 raft_consensus.cc:359] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.325662  5056 raft_consensus.cc:385] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.325912  5056 raft_consensus.cc:740] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.326490  5056 consensus_queue.cc:260] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.338158  5184 raft_consensus.cc:493] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.338392  5056 ts_tablet_manager.cc:1434] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:34.338680  5184 raft_consensus.cc:515] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.339416  5056 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:34.341924  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.342583  4858 raft_consensus.cc:2468] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:34.342851  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.343802  4972 leader_election.cc:304] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:34.343751  4786 raft_consensus.cc:2468] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:34.344830  5258 raft_consensus.cc:2804] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.345220  5258 raft_consensus.cc:493] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.345553  5258 raft_consensus.cc:3060] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.346197  5131 raft_consensus.cc:493] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.346969  5131 raft_consensus.cc:515] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.350553  5131 leader_election.cc:290] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:34.351512  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.352466  4825 leader_election.cc:304] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.352970  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.354157  5263 raft_consensus.cc:2804] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.354727  5263 raft_consensus.cc:697] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
W20260709 13:12:34.354995  4751 leader_election.cc:343] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.355702  5263 consensus_queue.cc:237] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.362100  5056 tablet_bootstrap.cc:654] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:34.363852  4749 leader_election.cc:343] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.368454  5092 consensus_queue.cc:1048] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.369881  4749 leader_election.cc:304] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.365553  5184 leader_election.cc:290] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:34.379417  5272 raft_consensus.cc:2749] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.381891  5054 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.381157  4684 catalog_manager.cc:5697] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.401085  5258 raft_consensus.cc:515] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.402354  5054 tablet_bootstrap.cc:654] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.402806  5272 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.403394  5272 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.407588  5062 tablet_bootstrap.cc:492] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.408165  5062 ts_tablet_manager.cc:1403] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.004s
I20260709 13:12:34.410185  5272 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.413060  5062 raft_consensus.cc:359] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.413962  5062 raft_consensus.cc:385] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.413863  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.414888  5062 raft_consensus.cc:740] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
W20260709 13:12:34.415329  4751 leader_election.cc:343] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.420581  5055 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.421218  5055 ts_tablet_manager.cc:1403] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.015s
I20260709 13:12:34.424000  5055 raft_consensus.cc:359] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.424645  5055 raft_consensus.cc:385] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.424937  5055 raft_consensus.cc:740] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.425292  5056 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.425776  5056 ts_tablet_manager.cc:1403] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.006s
I20260709 13:12:34.425660  5055 consensus_queue.cc:260] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.415647  5062 consensus_queue.cc:260] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.428313  5055 ts_tablet_manager.cc:1434] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:34.429198  5062 ts_tablet_manager.cc:1434] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:12:34.429275  5055 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.429980  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:34.430585  5062 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:34.430544  4786 raft_consensus.cc:3060] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.426820  4683 catalog_manager.cc:5697] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.435760  5055 tablet_bootstrap.cc:654] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.442092  5055 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.442615  5055 ts_tablet_manager.cc:1403] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:12:34.445277  5055 raft_consensus.cc:359] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.445801  5062 tablet_bootstrap.cc:654] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.446017  5055 raft_consensus.cc:385] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.446413  5055 raft_consensus.cc:740] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.447189  5055 consensus_queue.cc:260] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.456591  5054 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.457113  5054 ts_tablet_manager.cc:1403] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.009s
I20260709 13:12:34.459414  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.459779  5054 raft_consensus.cc:359] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.460471  5054 raft_consensus.cc:385] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.460719  5054 raft_consensus.cc:740] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.461362  5054 consensus_queue.cc:260] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.463976  5054 ts_tablet_manager.cc:1434] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:34.465322  5054 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.469326  4786 raft_consensus.cc:2468] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:34.473310  5055 ts_tablet_manager.cc:1434] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:12:34.484033  5055 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.475881  5054 tablet_bootstrap.cc:654] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.476492  5272 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.484740  5272 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.488168  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:34.489665  4750 leader_election.cc:343] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.490578  5055 tablet_bootstrap.cc:654] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.492100  5272 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.477035  4934 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:34.477077  4975 leader_election.cc:304] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.493052  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.493743  4858 raft_consensus.cc:2468] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:34.494582  5073 raft_consensus.cc:2804] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.495956  4750 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.497313  5272 raft_consensus.cc:2804] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.497704  5272 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.498029  5272 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.500427  4749 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.501338  5131 raft_consensus.cc:2804] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.501705  5131 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.502048  5131 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.504424  5073 raft_consensus.cc:697] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:34.505688  5073 consensus_queue.cc:237] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.507666  5055 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.508175  5055 ts_tablet_manager.cc:1403] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 13:12:34.509397  5131 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.512058  5055 raft_consensus.cc:359] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.512765  5055 raft_consensus.cc:385] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.512691  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:34.513254  5055 raft_consensus.cc:740] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.513502  4858 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.514019  5055 consensus_queue.cc:260] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.515817  5055 ts_tablet_manager.cc:1434] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:34.482335  5056 raft_consensus.cc:359] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.516489  5056 raft_consensus.cc:385] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.516599  5119 raft_consensus.cc:493] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.516831  5056 raft_consensus.cc:740] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.517244  5119 raft_consensus.cc:515] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.517726  5258 leader_election.cc:290] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:34.522370  5056 consensus_queue.cc:260] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.522845  5119 leader_election.cc:290] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:34.522425  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.524729  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.525400  4786 raft_consensus.cc:2468] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:34.528738  4827 leader_election.cc:304] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.530143  5071 raft_consensus.cc:2804] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.530516  5071 raft_consensus.cc:493] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.531010  5071 raft_consensus.cc:3060] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.531971  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
W20260709 13:12:34.533157  4826 leader_election.cc:343] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:34.534148  4750 leader_election.cc:343] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.534855  5131 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.538144  4858 raft_consensus.cc:2468] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:34.543253  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83e926be0c443dbadd95607ab1d8979" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:34.544088  4859 raft_consensus.cc:3060] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.546828  4682 catalog_manager.cc:5697] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.547845  4749 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.549042  5131 raft_consensus.cc:2804] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.549676  5131 raft_consensus.cc:697] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:34.550733  5131 consensus_queue.cc:237] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.553391  5054 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.553890  5054 ts_tablet_manager.cc:1403] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 13:12:34.558794  5071 raft_consensus.cc:515] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.561312  5056 ts_tablet_manager.cc:1434] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 13:12:34.562340  5056 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:34.564844  5054 raft_consensus.cc:359] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.565562  5054 raft_consensus.cc:385] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.565834  5054 raft_consensus.cc:740] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.566483  5054 consensus_queue.cc:260] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.571506  5062 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.572096  5062 ts_tablet_manager.cc:1403] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.142s	user 0.038s	sys 0.032s
I20260709 13:12:34.574199  5055 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.574939  5062 raft_consensus.cc:359] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.575619  5054 ts_tablet_manager.cc:1434] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:34.575699  5062 raft_consensus.cc:385] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.576243  5062 raft_consensus.cc:740] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.576684  5054 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.576982  5062 consensus_queue.cc:260] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.579566  5062 ts_tablet_manager.cc:1434] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:34.577416  4859 raft_consensus.cc:2468] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:34.581228  5056 tablet_bootstrap.cc:654] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.584264  5062 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:34.586143  5054 tablet_bootstrap.cc:654] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.589223  5071 leader_election.cc:290] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:34.590147  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:34.592607  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:34.593252  4785 raft_consensus.cc:3060] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.593432  4684 catalog_manager.cc:5697] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.595311  5263 raft_consensus.cc:493] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.595840  5263 raft_consensus.cc:515] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
W20260709 13:12:34.596299  4826 leader_election.cc:343] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.596740  5272 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.598019  5263 leader_election.cc:290] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.598342  5071 consensus_queue.cc:1048] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.599694  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.599763  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:34.600400  4933 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.599753  5272 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.604496  5062 tablet_bootstrap.cc:654] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.604800  5119 consensus_queue.cc:1048] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:34.606629  4825 leader_election.cc:343] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.610874  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:34.610966  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:34.611536  5009 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:34.613507  4826 leader_election.cc:343] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.613974  4826 leader_election.cc:304] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.622746  5119 raft_consensus.cc:2749] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.627753  4785 raft_consensus.cc:2468] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:34.630903  4827 leader_election.cc:304] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:34.634349  5263 raft_consensus.cc:2804] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.635004  5263 raft_consensus.cc:697] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:34.635499  5009 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:34.636893  4751 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.637948  5131 raft_consensus.cc:2804] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.638160  5055 tablet_bootstrap.cc:654] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.638916  5131 raft_consensus.cc:697] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:34.636001  5263 consensus_queue.cc:237] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.637436  4933 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:34.644032  5056 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.647781  5056 ts_tablet_manager.cc:1403] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.018s
I20260709 13:12:34.651748  5062 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.652441  5062 ts_tablet_manager.cc:1403] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.005s
I20260709 13:12:34.657087  5056 raft_consensus.cc:359] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.657778  5056 raft_consensus.cc:385] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.658047  5056 raft_consensus.cc:740] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.659204  5062 raft_consensus.cc:359] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.639851  5131 consensus_queue.cc:237] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.660460  5056 consensus_queue.cc:260] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.662127  5056 ts_tablet_manager.cc:1434] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.002s
I20260709 13:12:34.663076  5056 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:34.660012  5062 raft_consensus.cc:385] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.666857  5062 raft_consensus.cc:740] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.667915  5062 consensus_queue.cc:260] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.671454  5054 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.672029  5054 ts_tablet_manager.cc:1403] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.009s
I20260709 13:12:34.676031  5054 raft_consensus.cc:359] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.676703  5054 raft_consensus.cc:385] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.677009  5054 raft_consensus.cc:740] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.677702  5054 consensus_queue.cc:260] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.678715  4683 catalog_manager.cc:5697] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.684077  5263 raft_consensus.cc:493] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.684731  5263 raft_consensus.cc:515] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.688027  5263 leader_election.cc:290] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.688328  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.688941  5062 ts_tablet_manager.cc:1434] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:12:34.689026  4786 raft_consensus.cc:2468] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:34.689939  5062 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:34.690117  5054 ts_tablet_manager.cc:1434] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:12:34.690948  4827 leader_election.cc:304] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.691395  5054 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.697243  5054 tablet_bootstrap.cc:654] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.700843  5071 raft_consensus.cc:2804] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.701246  5071 raft_consensus.cc:493] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.701833  5071 raft_consensus.cc:3060] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.701231  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.708869  5055 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.709465  5055 ts_tablet_manager.cc:1403] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.002s
I20260709 13:12:34.712466  5055 raft_consensus.cc:359] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.713531  5055 raft_consensus.cc:385] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.719847  5055 raft_consensus.cc:740] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.718097  5054 tablet_bootstrap.cc:492] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.708890  4933 raft_consensus.cc:2468] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:34.721185  5054 ts_tablet_manager.cc:1403] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.015s
I20260709 13:12:34.719022  5071 raft_consensus.cc:515] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.723480  5055 consensus_queue.cc:260] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.728039  5055 ts_tablet_manager.cc:1434] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:34.729548  5054 raft_consensus.cc:359] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.730316  5054 raft_consensus.cc:385] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.730620  5054 raft_consensus.cc:740] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.731495  5054 consensus_queue.cc:260] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.733649  5054 ts_tablet_manager.cc:1434] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:34.736733  5071 leader_election.cc:290] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.737917  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:34.738868  4785 raft_consensus.cc:3060] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.740337  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:34.740954  4933 raft_consensus.cc:3060] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.741830  5054 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.741896  5272 consensus_queue.cc:1048] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.748445  5055 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.750049  4785 raft_consensus.cc:2468] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:34.751447  4827 leader_election.cc:304] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:34.752512  5062 tablet_bootstrap.cc:654] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.752797  5263 raft_consensus.cc:2804] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.753347  5263 raft_consensus.cc:697] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:34.754190  5263 consensus_queue.cc:237] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.755268  5055 tablet_bootstrap.cc:654] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.755429  5056 tablet_bootstrap.cc:654] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.758481  4933 raft_consensus.cc:2468] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:34.779080  5272 consensus_queue.cc:1048] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.781554  5296 raft_consensus.cc:493] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.782111  5296 raft_consensus.cc:515] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.784325  5296 leader_election.cc:290] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:34.788681  5054 tablet_bootstrap.cc:654] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.792945  5272 raft_consensus.cc:493] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.793500  5272 raft_consensus.cc:515] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.799214  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.799953  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:34.800740  4749 leader_election.cc:343] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.801076  5071 consensus_queue.cc:1048] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:34.801944  4750 leader_election.cc:343] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.802556  4750 leader_election.cc:304] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.803738  5311 raft_consensus.cc:2749] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.806102  5005 raft_consensus.cc:3060] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.796286  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.809454  5272 leader_election.cc:290] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.811015  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:34.811256  4901 leader_election.cc:343] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:34.813197  4900 leader_election.cc:343] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.813853  4900 leader_election.cc:304] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:34.814301  5073 raft_consensus.cc:493] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.815315  5073 raft_consensus.cc:515] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.815923  5296 raft_consensus.cc:2749] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.817351  5073 leader_election.cc:290] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.819826  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.822992  4859 raft_consensus.cc:2468] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
W20260709 13:12:34.824870  5332 log.cc:927] Time spent T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:34.825132  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.825812  4935 raft_consensus.cc:2468] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:34.827525  4973 leader_election.cc:304] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:34.828456  5073 raft_consensus.cc:2804] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.828913  5073 raft_consensus.cc:493] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.829823  5073 raft_consensus.cc:3060] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.834867  4681 catalog_manager.cc:5697] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.835443  5258 raft_consensus.cc:493] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.841244  5258 raft_consensus.cc:515] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.843449  5258 leader_election.cc:290] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.843942  5073 raft_consensus.cc:515] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
W20260709 13:12:34.835840  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:34.837260  5071 consensus_queue.cc:1048] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.846911  5073 leader_election.cc:290] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:34.848018  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:34.848651  4861 raft_consensus.cc:3060] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.850479  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.856670  4861 raft_consensus.cc:2468] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:34.857868  4972 leader_election.cc:304] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:34.857899  4684 catalog_manager.cc:5697] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.860841  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88dea137c8e49a484a715cf7078e4c2" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:34.861233  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb6150ed16c4b01b553aeed27359f05" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.861501  4934 raft_consensus.cc:3060] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.862752  5073 raft_consensus.cc:2804] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.863292  5073 raft_consensus.cc:697] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:34.864104  5073 consensus_queue.cc:237] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.867781  4973 leader_election.cc:304] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.869283  5054 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.876479  5054 ts_tablet_manager.cc:1403] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.002s
I20260709 13:12:34.877512  5056 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.869967  5062 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.878554  5062 ts_tablet_manager.cc:1403] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.189s	user 0.025s	sys 0.004s
I20260709 13:12:34.879235  5054 raft_consensus.cc:359] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.879938  5054 raft_consensus.cc:385] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.880183  5054 raft_consensus.cc:740] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.880877  5054 consensus_queue.cc:260] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.881398  5062 raft_consensus.cc:359] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.882121  5062 raft_consensus.cc:385] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.882377  5062 raft_consensus.cc:740] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.878042  5056 ts_tablet_manager.cc:1403] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.215s	user 0.019s	sys 0.004s
I20260709 13:12:34.885465  5062 consensus_queue.cc:260] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:34.887974  5062 ts_tablet_manager.cc:1434] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:34.888903  5062 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:34.889885  5056 raft_consensus.cc:359] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.891686  5056 raft_consensus.cc:385] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.891993  5056 raft_consensus.cc:740] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.892575  4934 raft_consensus.cc:2468] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:34.893739  5056 consensus_queue.cc:260] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.898325  5258 raft_consensus.cc:2749] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:34.900413  5055 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:34.901190  5055 ts_tablet_manager.cc:1403] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.010s
I20260709 13:12:34.904688  5055 raft_consensus.cc:359] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.906118  5055 raft_consensus.cc:385] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.908552  5055 raft_consensus.cc:740] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.909476  5056 ts_tablet_manager.cc:1434] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:12:34.910498  5056 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:34.913486  5054 ts_tablet_manager.cc:1434] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:12:34.909332  5055 consensus_queue.cc:260] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.914587  5054 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.914999  5297 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.915107  5258 consensus_queue.cc:1048] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:34.915575  5297 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:34.916286  5055 ts_tablet_manager.cc:1434] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 13:12:34.917781  5297 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:34.913193  5062 tablet_bootstrap.cc:654] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.919670  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.920118  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:34.924381  5055 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:34.925139  5131 raft_consensus.cc:493] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.925633  5131 raft_consensus.cc:515] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.926033  5054 tablet_bootstrap.cc:654] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.920585  4859 raft_consensus.cc:2393] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:34.930091  4898 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:34.932554  5301 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.933342  5056 tablet_bootstrap.cc:654] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.938004  5131 leader_election.cc:290] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:34.930545  5055 tablet_bootstrap.cc:654] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.940917  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:34.942788  4751 leader_election.cc:343] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.946395  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:34.949106  5054 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.949798  5054 ts_tablet_manager.cc:1403] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
W20260709 13:12:34.951395  4750 leader_election.cc:343] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.952050  4750 leader_election.cc:304] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:34.952512  5301 raft_consensus.cc:2749] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.953083  5311 raft_consensus.cc:2749] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.952867  5054 raft_consensus.cc:359] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.953966  5054 raft_consensus.cc:385] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.954421  5054 raft_consensus.cc:740] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.955389  5054 consensus_queue.cc:260] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:34.957863  5054 ts_tablet_manager.cc:1434] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:34.959072  5054 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:34.961335  5062 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:34.961858  5062 ts_tablet_manager.cc:1403] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.008s
I20260709 13:12:34.965611  5054 tablet_bootstrap.cc:654] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.971750  5318 consensus_queue.cc:1048] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.974164  5311 consensus_queue.cc:1048] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:34.975448  5301 raft_consensus.cc:493] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.976028  5301 raft_consensus.cc:515] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:34.979025  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:34.979666  4861 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:34.980664  4898 leader_election.cc:304] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:34.981477  5297 raft_consensus.cc:2804] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.981808  5297 raft_consensus.cc:493] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.982110  5297 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.989646  5054 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:34.989851  5056 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:34.990420  5054 ts_tablet_manager.cc:1403] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 13:12:34.990619  5056 ts_tablet_manager.cc:1403] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.008s
I20260709 13:12:34.988950  5297 raft_consensus.cc:515] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.002949  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:35.014760  4861 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.002976  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:35.016456  4900 leader_election.cc:343] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.994666  5056 raft_consensus.cc:359] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.017750  5056 raft_consensus.cc:385] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.018090  5056 raft_consensus.cc:740] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.018991  5056 consensus_queue.cc:260] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.021207  5056 ts_tablet_manager.cc:1434] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.005s
I20260709 13:12:35.022212  4861 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.023912  4898 leader_election.cc:304] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:35.003705  5297 leader_election.cc:290] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.025326  5297 raft_consensus.cc:2804] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.025790  5297 raft_consensus.cc:697] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:35.004408  5054 raft_consensus.cc:359] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.027850  5054 raft_consensus.cc:385] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.028100  5054 raft_consensus.cc:740] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.028808  5054 consensus_queue.cc:260] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.004683  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:35.022778  5056 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:35.034289  5054 ts_tablet_manager.cc:1434] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:12:35.035506  5054 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.036314  5131 consensus_queue.cc:1048] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.038267  5056 tablet_bootstrap.cc:654] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:35.038528  4900 leader_election.cc:343] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.026674  5297 consensus_queue.cc:237] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.044164  5263 consensus_queue.cc:1048] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.046350  4683 catalog_manager.cc:5697] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.013303  5055 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.054592  5054 tablet_bootstrap.cc:654] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.054769  5055 ts_tablet_manager.cc:1403] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.019s
I20260709 13:12:35.009752  5062 raft_consensus.cc:359] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.057010  5062 raft_consensus.cc:385] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.057689  5062 raft_consensus.cc:740] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.058722  5062 consensus_queue.cc:260] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.064510  5055 raft_consensus.cc:359] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.000758  5301 leader_election.cc:290] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.067627  5055 raft_consensus.cc:385] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.055967  5318 raft_consensus.cc:493] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.078542  5062 ts_tablet_manager.cc:1434] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 13:12:35.075409  5055 raft_consensus.cc:740] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.079715  5062 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:35.083451  5318 raft_consensus.cc:515] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.085733  5131 consensus_queue.cc:1048] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.088330  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.090080  5055 consensus_queue.cc:260] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.098516  5055 ts_tablet_manager.cc:1434] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:12:35.100325  5062 tablet_bootstrap.cc:654] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.102574  5055 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.104393  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.105072  4859 raft_consensus.cc:2468] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:35.106684  4683 catalog_manager.cc:5697] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.108938  5055 tablet_bootstrap.cc:654] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.111341  4972 leader_election.cc:304] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:35.112274  5184 raft_consensus.cc:2804] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.112677  5184 raft_consensus.cc:493] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.113034  5184 raft_consensus.cc:3060] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.089033  4786 raft_consensus.cc:2468] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:35.085799  5318 leader_election.cc:290] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.128197  5054 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:35.128729  5054 ts_tablet_manager.cc:1403] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.001s
I20260709 13:12:35.140019  5056 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
W20260709 13:12:35.123229  4898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.2:43901, user_credentials={real_user=slave}} blocked reactor thread for 99407.9us
I20260709 13:12:35.145134  5054 raft_consensus.cc:359] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.145872  5054 raft_consensus.cc:385] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.146116  5054 raft_consensus.cc:740] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.148540  5184 raft_consensus.cc:515] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.140807  5056 ts_tablet_manager.cc:1403] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.002s
I20260709 13:12:35.149910  5054 consensus_queue.cc:260] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.154356  5054 ts_tablet_manager.cc:1434] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:12:35.156065  5054 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.162716  5184 leader_election.cc:290] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.163509  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.164167  4786 raft_consensus.cc:3060] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.165542  5055 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.166110  5055 ts_tablet_manager.cc:1403] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.001s
I20260709 13:12:35.168898  5055 raft_consensus.cc:359] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.169579  5055 raft_consensus.cc:385] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.169765  5301 raft_consensus.cc:493] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.169934  5055 raft_consensus.cc:740] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.170301  5301 raft_consensus.cc:515] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.170775  5055 consensus_queue.cc:260] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.183475  5055 ts_tablet_manager.cc:1434] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:12:35.187775  5055 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.188769  5296 raft_consensus.cc:493] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.189283  5296 raft_consensus.cc:515] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.190611  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29c0f2d503146f6b27e75a54137a273" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:35.191311  4861 raft_consensus.cc:3060] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.191352  5296 leader_election.cc:290] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.193373  5184 raft_consensus.cc:493] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.193919  5184 raft_consensus.cc:515] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.195554  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.196028  5184 leader_election.cc:290] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.196184  4785 raft_consensus.cc:2468] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:35.197424  5311 consensus_queue.cc:1048] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.197783  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.198285  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.198449  4933 raft_consensus.cc:2468] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:35.199867  4973 leader_election.cc:304] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:35.200412  4901 leader_election.cc:304] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.200709  5318 raft_consensus.cc:2804] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.193531  5055 tablet_bootstrap.cc:654] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.201119  5318 raft_consensus.cc:493] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.201704  5297 raft_consensus.cc:2804] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.215067  5318 raft_consensus.cc:3060] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.215802  5297 raft_consensus.cc:493] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.215975  4786 raft_consensus.cc:2468] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:35.216261  5297 raft_consensus.cc:3060] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.204207  5301 leader_election.cc:290] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.205420  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:35.228645  4900 leader_election.cc:343] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.210253  4826 consensus_peers.cc:597] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 -> Peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Couldn't send request to peer e3b9d92f86c74ea0b6537c30a8846eab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.213127  4975 leader_election.cc:343] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.213617  4861 raft_consensus.cc:2468] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:35.187637  5054 tablet_bootstrap.cc:654] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.214900  5056 raft_consensus.cc:359] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.230547  5056 raft_consensus.cc:385] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.230485  4975 leader_election.cc:304] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.230988  5056 raft_consensus.cc:740] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.231536  5184 raft_consensus.cc:2804] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.232339  5184 raft_consensus.cc:697] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:35.231866  5056 consensus_queue.cc:260] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.233246  5184 consensus_queue.cc:237] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.234278  5056 ts_tablet_manager.cc:1434] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:12:35.235106  5301 raft_consensus.cc:493] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.235752  5301 raft_consensus.cc:515] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.236681  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.237340  4861 raft_consensus.cc:2468] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:35.209236  5062 tablet_bootstrap.cc:492] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:35.238193  5062 ts_tablet_manager.cc:1403] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.159s	user 0.025s	sys 0.011s
I20260709 13:12:35.238317  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.238862  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:35.242353  4900 leader_election.cc:343] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.244058  5318 raft_consensus.cc:515] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.239760  5297 raft_consensus.cc:515] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
W20260709 13:12:35.244522  4898 leader_election.cc:343] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.235253  5056 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:35.245149  4898 leader_election.cc:304] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.246491  5301 leader_election.cc:290] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.246814  5296 raft_consensus.cc:2749] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.247623  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.248420  4786 raft_consensus.cc:2468] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:35.249559  4901 leader_election.cc:304] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.251000  5297 leader_election.cc:290] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.251549  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:35.252195  4859 raft_consensus.cc:3060] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.252043  5258 consensus_queue.cc:1048] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.252379  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e023474754444ca7835a8410266d6d7b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.253078  4783 raft_consensus.cc:3060] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.251085  5296 raft_consensus.cc:2804] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.254940  5296 raft_consensus.cc:493] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.255313  5296 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.249624  5062 raft_consensus.cc:359] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.258960  5062 raft_consensus.cc:385] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.263737  5062 raft_consensus.cc:740] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.264526  5062 consensus_queue.cc:260] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.267274  5062 ts_tablet_manager.cc:1434] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 13:12:35.268241  5062 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:35.269375  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.262995  5296 raft_consensus.cc:515] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.270004  4786 raft_consensus.cc:3060] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.272323  5054 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:35.274718  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.278316  5054 ts_tablet_manager.cc:1403] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.003s
I20260709 13:12:35.277437  5318 leader_election.cc:290] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.277578  5296 leader_election.cc:290] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.278270  4785 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.281965  5054 raft_consensus.cc:359] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.276033  4783 raft_consensus.cc:2468] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.283241  5054 raft_consensus.cc:385] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.286145  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:35.291451  5054 raft_consensus.cc:740] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.286433  5119 consensus_queue.cc:1048] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.287238  4859 raft_consensus.cc:2468] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.287110  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c70fd50ee1480c93f859973675ed01" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:35.288223  5055 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.295853  5055 ts_tablet_manager.cc:1403] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.018s
I20260709 13:12:35.289301  5062 tablet_bootstrap.cc:654] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.290633  5073 raft_consensus.cc:493] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.292246  5056 tablet_bootstrap.cc:654] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.292198  5054 consensus_queue.cc:260] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.300350  5073 raft_consensus.cc:515] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.300987  4935 raft_consensus.cc:3060] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.307572  4785 raft_consensus.cc:2468] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.311863  4786 raft_consensus.cc:2468] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
W20260709 13:12:35.301476  4900 leader_election.cc:343] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.304088  4898 leader_election.cc:304] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:35.305259  5318 consensus_queue.cc:1048] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:35.321429  5054 ts_tablet_manager.cc:1434] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.005s
I20260709 13:12:35.312506  5073 leader_election.cc:290] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.325153  4901 leader_election.cc:304] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.326519  5349 raft_consensus.cc:2804] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.323895  5301 raft_consensus.cc:2804] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.337718  5301 raft_consensus.cc:697] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:35.338730  5301 consensus_queue.cc:237] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.341003  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.342140  4859 raft_consensus.cc:2393] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f0ebe0c3053f48d6852e07257efbf0f9 in this term.
I20260709 13:12:35.344712  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.356161  4972 leader_election.cc:304] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:35.361831  5054 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.374563  5055 raft_consensus.cc:359] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.376078  5055 raft_consensus.cc:385] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.376436  5055 raft_consensus.cc:740] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.369828  5318 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.377735  5055 consensus_queue.cc:260] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.375916  4975 leader_election.cc:304] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.399224  5055 ts_tablet_manager.cc:1434] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:12:35.395273  5184 raft_consensus.cc:2804] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.405542  5184 raft_consensus.cc:697] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:35.385775  5349 raft_consensus.cc:697] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:35.407936  5055 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.413587  5056 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:35.414139  5056 ts_tablet_manager.cc:1403] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.179s	user 0.012s	sys 0.012s
I20260709 13:12:35.417644  5131 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.419790  5131 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.419890  5119 consensus_queue.cc:1048] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:35.406435  5184 consensus_queue.cc:237] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.423158  5056 raft_consensus.cc:359] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.427886  5056 raft_consensus.cc:385] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.428162  5056 raft_consensus.cc:740] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.433466  5055 tablet_bootstrap.cc:654] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.421303  5349 consensus_queue.cc:237] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.448128  5056 consensus_queue.cc:260] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.425314  4935 raft_consensus.cc:2468] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:35.451149  5056 ts_tablet_manager.cc:1434] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:12:35.452603  5056 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:35.477541  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.478286  4859 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:35.481094  5107 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.481366  5131 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.481740  5056 tablet_bootstrap.cc:654] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.481585  5107 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.486059  4749 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.486480  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.487196  4786 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:35.488760  4827 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.489132  5318 raft_consensus.cc:2749] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.490061  5272 raft_consensus.cc:2804] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.491068  5358 raft_consensus.cc:2804] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.491613  5358 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.492125  5358 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.494155  5054 tablet_bootstrap.cc:654] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.500048  5107 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.500645  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:35.502228  4825 leader_election.cc:343] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.505093  5055 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.505658  5055 ts_tablet_manager.cc:1403] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.011s
I20260709 13:12:35.513854  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.514045  5055 raft_consensus.cc:359] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.519507  5055 raft_consensus.cc:385] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.519984  5263 raft_consensus.cc:493] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.520658  5263 raft_consensus.cc:515] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.522670  5263 leader_election.cc:290] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
W20260709 13:12:35.522890  4972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:43901, user_credentials={real_user=slave}} blocked reactor thread for 77562.2us
I20260709 13:12:35.524771  5055 raft_consensus.cc:740] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.524618  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.527590  4935 raft_consensus.cc:2468] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:35.527910  5272 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.526551  5054 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:35.528435  5272 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.528872  5054 ts_tablet_manager.cc:1403] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.000s
I20260709 13:12:35.527729  5055 consensus_queue.cc:260] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.532537  5055 ts_tablet_manager.cc:1434] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:12:35.533512  5055 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.534164  5358 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.539111  5055 tablet_bootstrap.cc:654] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.540800  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.544831  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
W20260709 13:12:35.547197  4825 leader_election.cc:343] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.548125  5358 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.552069  5055 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.552557  5055 ts_tablet_manager.cc:1403] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:12:35.555265  5055 raft_consensus.cc:359] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.545646  4683 catalog_manager.cc:5697] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.555567  5054 raft_consensus.cc:359] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.555982  5055 raft_consensus.cc:385] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.556278  5054 raft_consensus.cc:385] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.556469  5055 raft_consensus.cc:740] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.556603  5054 raft_consensus.cc:740] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.560339  5054 consensus_queue.cc:260] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.560339  5055 consensus_queue.cc:260] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.563827  5055 ts_tablet_manager.cc:1434] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:35.563714  4825 leader_election.cc:304] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:35.564363  5054 ts_tablet_manager.cc:1434] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:12:35.564713  5358 raft_consensus.cc:2804] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.565389  5054 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.565099  5358 raft_consensus.cc:493] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.568065  5358 raft_consensus.cc:3060] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.572331  5056 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:35.571522  4682 catalog_manager.cc:5697] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.572899  5056 ts_tablet_manager.cc:1403] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.004s
I20260709 13:12:35.573694  4682 catalog_manager.cc:5697] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.575896  5358 raft_consensus.cc:515] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.579159  5358 leader_election.cc:290] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.580574  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:35.582437  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:35.591580  4750 leader_election.cc:343] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.592034  4826 leader_election.cc:343] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.592319  5054 tablet_bootstrap.cc:654] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.595655  5056 raft_consensus.cc:359] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.596312  5056 raft_consensus.cc:385] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.596571  5056 raft_consensus.cc:740] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.596336  5349 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.597283  5056 consensus_queue.cc:260] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:35.598389  4826 leader_election.cc:343] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.605691  5055 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.612136  5055 tablet_bootstrap.cc:654] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.616505  5297 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.632294  5055 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.663544  5055 ts_tablet_manager.cc:1403] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.003s
I20260709 13:12:35.666288  5055 raft_consensus.cc:359] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.666993  5055 raft_consensus.cc:385] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.667241  5055 raft_consensus.cc:740] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.667871  5055 consensus_queue.cc:260] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.670077  5055 ts_tablet_manager.cc:1434] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:35.643271  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:35.671000  4935 raft_consensus.cc:3060] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.671253  5367 raft_consensus.cc:493] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.622612  5272 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.671794  5367 raft_consensus.cc:515] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.672358  4783 raft_consensus.cc:2393] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d069c6c6db44e9882ec432292c00563 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:35.674028  5367 leader_election.cc:290] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.674301  5272 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.654785  5062 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:35.675580  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34da2d7f05c4d8abebd5e99d71cf8c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:35.676149  5062 ts_tablet_manager.cc:1403] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.408s	user 0.024s	sys 0.013s
I20260709 13:12:35.676393  4827 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:35.631861  5056 ts_tablet_manager.cc:1434] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:12:35.677611  5056 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:35.639200  4683 catalog_manager.cc:5697] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.678380  4935 raft_consensus.cc:2468] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:35.678952  5062 raft_consensus.cc:359] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.679632  4825 leader_election.cc:304] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.679983  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:35.679653  5062 raft_consensus.cc:385] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:35.680922  4900 leader_election.cc:343] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.681092  5054 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:35.681010  5062 raft_consensus.cc:740] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.681759  5054 ts_tablet_manager.cc:1403] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.030s
W20260709 13:12:35.681843  4750 leader_election.cc:343] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.682195  5062 consensus_queue.cc:260] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.682726  5107 raft_consensus.cc:2804] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.683274  5107 raft_consensus.cc:697] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:35.684156  5107 consensus_queue.cc:237] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.684564  5358 raft_consensus.cc:2749] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.684507  5054 raft_consensus.cc:359] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.685361  5054 raft_consensus.cc:385] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.685722  5054 raft_consensus.cc:740] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.685654  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34da2d7f05c4d8abebd5e99d71cf8c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.686483  5367 raft_consensus.cc:493] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.686501  4859 raft_consensus.cc:2468] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:35.687166  5367 raft_consensus.cc:515] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.687750  4898 leader_election.cc:304] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.684147  5056 tablet_bootstrap.cc:654] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.687955  5054 consensus_queue.cc:260] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.688942  5301 raft_consensus.cc:2804] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.689309  5301 raft_consensus.cc:493] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.689754  5301 raft_consensus.cc:3060] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.690274  5367 leader_election.cc:290] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.690470  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.691210  4783 raft_consensus.cc:2468] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:35.692301  4901 leader_election.cc:304] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.693192  5055 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.694110  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:35.695603  4900 leader_election.cc:343] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.696995  5301 raft_consensus.cc:515] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.699643  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34da2d7f05c4d8abebd5e99d71cf8c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:35.699957  5055 tablet_bootstrap.cc:654] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.700277  4859 raft_consensus.cc:3060] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.704126  5054 ts_tablet_manager.cc:1434] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:12:35.705377  5054 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.707288  5367 raft_consensus.cc:2804] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.707710  5367 raft_consensus.cc:493] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.708050  5367 raft_consensus.cc:3060] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.685659  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:35.712893  5378 consensus_queue.cc:1048] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.719982  5054 tablet_bootstrap.cc:654] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.718950  4859 raft_consensus.cc:2468] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.720625  5301 leader_election.cc:290] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:35.723802  5055 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.726550  4898 leader_election.cc:304] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:35.727175  5055 ts_tablet_manager.cc:1403] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.007s
I20260709 13:12:35.727509  5301 raft_consensus.cc:2804] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.728113  5301 raft_consensus.cc:697] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:35.729007  5301 consensus_queue.cc:237] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.737329  5367 raft_consensus.cc:515] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.744537  5055 raft_consensus.cc:359] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.748219  5055 raft_consensus.cc:385] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.748692  5055 raft_consensus.cc:740] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.749430  5055 consensus_queue.cc:260] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.751067  5055 ts_tablet_manager.cc:1434] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:12:35.756470  5378 raft_consensus.cc:493] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.756330  4681 catalog_manager.cc:5697] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.756956  5378 raft_consensus.cc:515] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.757222  5184 consensus_queue.cc:1048] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.759522  5378 leader_election.cc:290] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.763051  5062 ts_tablet_manager.cc:1434] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 13:12:35.764086  5062 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:35.766211  5055 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.712918  4861 raft_consensus.cc:2393] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6c95e5d9485488f9de4ffe24035c81d in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:35.768121  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34da2d7f05c4d8abebd5e99d71cf8c6" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:35.769305  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.783736  4783 raft_consensus.cc:2393] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f0ebe0c3053f48d6852e07257efbf0f9 in this term.
I20260709 13:12:35.785501  4749 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:35.787194  5055 tablet_bootstrap.cc:654] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.787315  5311 raft_consensus.cc:2749] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.790251  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.791572  4684 catalog_manager.cc:5697] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.794759  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.795360  4783 raft_consensus.cc:3060] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.799108  4973 leader_election.cc:304] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:35.799924  5073 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.803092  5367 leader_election.cc:290] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.802459  4783 raft_consensus.cc:2468] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:35.804580  4901 leader_election.cc:304] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.807883  5301 raft_consensus.cc:2804] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.808367  5301 raft_consensus.cc:697] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:35.808818  5073 raft_consensus.cc:2749] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.809512  5301 consensus_queue.cc:237] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.834501  5071 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.835095  5071 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.837131  5071 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.837590  5071 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.837832  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:35.838022  5071 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:35.839672  4826 leader_election.cc:343] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.840523  5071 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.841221  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:35.842635  4826 leader_election.cc:343] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.843128  5056 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:35.843811  5056 ts_tablet_manager.cc:1403] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.005s
I20260709 13:12:35.845795  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:35.847039  4827 leader_election.cc:343] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.847499  4827 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:35.848951  5071 raft_consensus.cc:2749] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.850129  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:35.851372  4827 leader_election.cc:343] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.851850  4827 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:35.853499  5071 raft_consensus.cc:2749] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:35.858219  4900 leader_election.cc:343] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.860383  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
W20260709 13:12:35.868382  4900 leader_election.cc:343] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.869338  5054 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:35.869997  5056 raft_consensus.cc:359] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.870622  5062 tablet_bootstrap.cc:654] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.870033  5054 ts_tablet_manager.cc:1403] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.025s
I20260709 13:12:35.871485  5056 raft_consensus.cc:385] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.873325  5056 raft_consensus.cc:740] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.874046  5056 consensus_queue.cc:260] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.878324  5055 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.878858  5055 ts_tablet_manager.cc:1403] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.113s	user 0.041s	sys 0.047s
I20260709 13:12:35.881583  5055 raft_consensus.cc:359] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.882242  5055 raft_consensus.cc:385] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.882516  5055 raft_consensus.cc:740] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.883219  5055 consensus_queue.cc:260] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.886587  5055 ts_tablet_manager.cc:1434] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:35.886883  5107 raft_consensus.cc:493] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.887455  5055 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:35.887377  5107 raft_consensus.cc:515] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.890029  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.890633  4783 raft_consensus.cc:2468] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 0.
I20260709 13:12:35.891860  4827 leader_election.cc:304] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:35.892591  5301 consensus_queue.cc:1048] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.892895  5358 raft_consensus.cc:2804] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.893316  5358 raft_consensus.cc:493] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.893659  5358 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.893760  5055 tablet_bootstrap.cc:654] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.900923  4681 catalog_manager.cc:5697] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.905297  5062 tablet_bootstrap.cc:492] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:35.905983  5062 ts_tablet_manager.cc:1403] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.002s
I20260709 13:12:35.906450  5056 ts_tablet_manager.cc:1434] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.004s
I20260709 13:12:35.910034  5056 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:35.913391  5272 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.913991  5272 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.908223  5054 raft_consensus.cc:359] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.916808  5054 raft_consensus.cc:385] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.916950  5272 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.921319  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:35.921867  5054 raft_consensus.cc:740] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.925302  5054 consensus_queue.cc:260] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.923839  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:35.925930  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:35.929730  4861 raft_consensus.cc:2468] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:35.930667  5054 ts_tablet_manager.cc:1434] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
W20260709 13:12:35.931437  4825 leader_election.cc:343] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.923058  4751 leader_election.cc:343] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.933028  5054 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:35.932842  4749 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:35.936441  5311 raft_consensus.cc:2804] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.936806  5311 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.937125  5311 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.941023  5301 consensus_queue.cc:1048] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.949998  5311 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:35.955235  5358 raft_consensus.cc:515] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:35.957494  5358 leader_election.cc:290] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:35.960160  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:35.960923  4785 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.961344  5062 raft_consensus.cc:359] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.962316  5062 raft_consensus.cc:385] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.963454  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:35.934283  5056 tablet_bootstrap.cc:654] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.957176  5297 consensus_queue.cc:1048] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.969120  5297 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.962643  5062 raft_consensus.cc:740] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.969794  5055 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.969589  5297 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:35.970307  5055 ts_tablet_manager.cc:1403] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.043s
I20260709 13:12:35.970458  5062 consensus_queue.cc:260] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.971025  5296 consensus_queue.cc:1048] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.971810  5297 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:35.972885  5062 ts_tablet_manager.cc:1434] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:12:35.973096  5055 raft_consensus.cc:359] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:35.973767  5055 raft_consensus.cc:385] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.974048  5055 raft_consensus.cc:740] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.973915  4784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:35.974859  5055 consensus_queue.cc:260] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
W20260709 13:12:35.976109  4901 leader_election.cc:343] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.975450  5311 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:35.976974  5055 ts_tablet_manager.cc:1434] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:35.977908  5055 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
W20260709 13:12:35.980600  4751 leader_election.cc:343] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.983387  5055 tablet_bootstrap.cc:654] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.934437  5107 leader_election.cc:290] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
W20260709 13:12:35.983971  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:35.973920  5062 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:35.990743  5062 tablet_bootstrap.cc:654] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.995740  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:35.997399  5055 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:35.998107  5055 ts_tablet_manager.cc:1403] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:12:36.001361  5054 tablet_bootstrap.cc:654] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.001858  5055 raft_consensus.cc:359] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.003446  5055 raft_consensus.cc:385] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.003749  5055 raft_consensus.cc:740] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.004508  5055 consensus_queue.cc:260] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.005378  5062 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.005867  5062 ts_tablet_manager.cc:1403] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.003s
I20260709 13:12:36.007617  5378 consensus_queue.cc:1048] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.008661  5062 raft_consensus.cc:359] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.009330  5062 raft_consensus.cc:385] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.009588  5062 raft_consensus.cc:740] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.010172  5056 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.010455  5062 consensus_queue.cc:260] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.010952  5056 ts_tablet_manager.cc:1403] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.004s
I20260709 13:12:36.012806  5062 ts_tablet_manager.cc:1434] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:36.013752  5062 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.016134  5056 raft_consensus.cc:359] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.017395  5056 raft_consensus.cc:385] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.017859  5056 raft_consensus.cc:740] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.020133  5062 tablet_bootstrap.cc:654] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.020562  5054 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.021071  5054 ts_tablet_manager.cc:1403] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.004s
I20260709 13:12:36.021198  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.017328  5055 ts_tablet_manager.cc:1434] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:12:36.024241  5055 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
W20260709 13:12:36.028733  4825 leader_election.cc:343] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.032380  5055 tablet_bootstrap.cc:654] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.033032  5056 consensus_queue.cc:260] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.035719  5056 ts_tablet_manager.cc:1434] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:12:36.036614  5056 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:36.043102  5056 tablet_bootstrap.cc:654] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.044986  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:36.045463  5055 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:36.045676  4859 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.045951  5055 ts_tablet_manager.cc:1403] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:12:36.050239  5062 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.050746  5062 ts_tablet_manager.cc:1403] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.015s
I20260709 13:12:36.051846  5055 raft_consensus.cc:359] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.052539  5055 raft_consensus.cc:385] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.052826  5055 raft_consensus.cc:740] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.053455  5055 consensus_queue.cc:260] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.053978  5062 raft_consensus.cc:359] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.054642  5062 raft_consensus.cc:385] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.054919  5062 raft_consensus.cc:740] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.055768  5055 ts_tablet_manager.cc:1434] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:12:36.055578  5062 consensus_queue.cc:260] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.056692  5055 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:36.057662  5062 ts_tablet_manager.cc:1434] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:12:36.058265  5054 raft_consensus.cc:359] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.058976  5054 raft_consensus.cc:385] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.059253  5054 raft_consensus.cc:740] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.059490  5062 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.059881  5054 consensus_queue.cc:260] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.061972  5054 ts_tablet_manager.cc:1434] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:12:36.063537  5054 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.064762  5056 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.065352  5056 ts_tablet_manager.cc:1403] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 13:12:36.065732  5062 tablet_bootstrap.cc:654] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.068212  5056 raft_consensus.cc:359] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.069028  5056 raft_consensus.cc:385] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.069401  5056 raft_consensus.cc:740] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.073223  5056 consensus_queue.cc:260] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.075809  5056 ts_tablet_manager.cc:1434] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:12:36.076738  5056 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
W20260709 13:12:36.078683  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:34929, user_credentials={real_user=slave}} blocked reactor thread for 55275.4us
W20260709 13:12:36.079625  4900 leader_election.cc:343] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.071254  5054 tablet_bootstrap.cc:654] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.080135  4900 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.063886  5055 tablet_bootstrap.cc:654] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.081120  5367 raft_consensus.cc:2749] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.088634  5056 tablet_bootstrap.cc:654] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.091259  5073 raft_consensus.cc:493] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.091872  5054 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.091826  5073 raft_consensus.cc:515] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.092427  5054 ts_tablet_manager.cc:1403] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:12:36.096046  5062 tablet_bootstrap.cc:492] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.096410  5073 leader_election.cc:290] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.099510  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.102914  5055 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:36.103204  4785 raft_consensus.cc:2468] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:36.096666  5062 ts_tablet_manager.cc:1403] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.017s
I20260709 13:12:36.103404  5055 ts_tablet_manager.cc:1403] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.006s
I20260709 13:12:36.109617  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "339747664ecc489f95b3d04d961ac367" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.116613  5062 raft_consensus.cc:359] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.121624  5062 raft_consensus.cc:385] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.104928  4827 leader_election.cc:304] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:36.121982  5062 raft_consensus.cc:740] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.122681  5054 raft_consensus.cc:359] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.127564  5054 raft_consensus.cc:385] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.127841  5054 raft_consensus.cc:740] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.126922  4975 leader_election.cc:304] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.128469  5054 consensus_queue.cc:260] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.129814  5318 raft_consensus.cc:2749] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.130920  5054 ts_tablet_manager.cc:1434] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:12:36.130995  5107 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.131112  5062 consensus_queue.cc:260] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.132129  5054 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.131850  5107 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.122855  5378 raft_consensus.cc:493] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.125797  5358 raft_consensus.cc:2804] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.138111  5358 raft_consensus.cc:697] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:36.138972  5358 consensus_queue.cc:237] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.110412  4859 raft_consensus.cc:2468] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.141640  4749 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:36.142417  5311 raft_consensus.cc:2804] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.142524  5107 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:36.142964  5311 raft_consensus.cc:697] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.143231  5378 raft_consensus.cc:515] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.143816  5311 consensus_queue.cc:237] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.144898  5131 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.145367  5131 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.146291  5378 leader_election.cc:290] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:36.147138  5062 ts_tablet_manager.cc:1434] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:12:36.148202  5062 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.147907  5055 raft_consensus.cc:359] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.148600  5055 raft_consensus.cc:385] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.148224  5131 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.148954  5055 raft_consensus.cc:740] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.149396  5119 raft_consensus.cc:493] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.149708  5055 consensus_queue.cc:260] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.149821  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.149874  5119 raft_consensus.cc:515] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.150588  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:36.151329  4827 leader_election.cc:343] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.152037  5119 leader_election.cc:290] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.152249  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:36.151871  4751 leader_election.cc:343] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.151840  5055 ts_tablet_manager.cc:1434] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:12:36.154754  5055 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: Bootstrap starting.
I20260709 13:12:36.158783  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:36.160300  4825 leader_election.cc:343] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.162536  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.164124  5055 tablet_bootstrap.cc:654] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.164199  5071 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.164736  5071 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.170369  5006 raft_consensus.cc:3060] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.176774  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
W20260709 13:12:36.177999  4827 leader_election.cc:343] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.192270  5349 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.192854  5349 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.193262  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.194989  5349 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.196458  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.197201  4861 raft_consensus.cc:2393] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
W20260709 13:12:36.203236  4826 leader_election.cc:343] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.203866  4826 leader_election.cc:304] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:36.205252  4785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.206338  4785 raft_consensus.cc:2393] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:36.210563  5056 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.211264  5056 ts_tablet_manager.cc:1403] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.001s
I20260709 13:12:36.213011  5054 tablet_bootstrap.cc:654] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.219381  5071 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:36.221096  5062 tablet_bootstrap.cc:654] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.212625  5263 raft_consensus.cc:2749] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:36.227413  4826 leader_election.cc:343] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.227097  4901 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.238896  5349 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.247148  4826 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.254400  5263 raft_consensus.cc:2749] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.255520  5263 raft_consensus.cc:493] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.255964  5263 raft_consensus.cc:515] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.242887  5258 consensus_queue.cc:1048] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:12:36.257956  5263 leader_election.cc:290] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:36.259678  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.260164  5005 raft_consensus.cc:3060] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:36.261858  4827 leader_election.cc:343] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.270918  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:36.274044  4825 leader_election.cc:343] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.274464  4825 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.275852  5071 raft_consensus.cc:2749] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.276499  5107 consensus_queue.cc:1048] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.231829  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b20012ccf24e2394387d169d9c75fe" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.284228  4935 raft_consensus.cc:2393] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:36.287596  5055 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: No bootstrap required, opened a new log
I20260709 13:12:36.287817  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.288143  5055 ts_tablet_manager.cc:1403] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.008s
I20260709 13:12:36.290810  5055 raft_consensus.cc:359] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.291447  5055 raft_consensus.cc:385] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.291733  5055 raft_consensus.cc:740] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.292379  5055 consensus_queue.cc:260] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.293155  5056 raft_consensus.cc:359] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.293828  5056 raft_consensus.cc:385] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.293854  5055 ts_tablet_manager.cc:1434] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:36.294170  5056 raft_consensus.cc:740] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
W20260709 13:12:36.298431  4826 leader_election.cc:343] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.302263  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.302965  4932 raft_consensus.cc:2468] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.299113  4826 leader_election.cc:304] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.304569  5107 raft_consensus.cc:2749] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:36.305160  4750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 70969.7us
I20260709 13:12:36.304591  5414 consensus_queue.cc:1048] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:36.308643  5007 raft_consensus.cc:3060] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.310551  5056 consensus_queue.cc:260] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.313297  5349 raft_consensus.cc:2749] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.309950  4973 leader_election.cc:304] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:36.318804  5056 ts_tablet_manager.cc:1434] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 13:12:36.319766  5056 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:36.322999  5054 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.325398  5054 ts_tablet_manager.cc:1403] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.004s
W20260709 13:12:36.322093  4900 consensus_peers.cc:597] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Couldn't send request to peer e3b9d92f86c74ea0b6537c30a8846eab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.328341  5131 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.328819  5131 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.329744  5367 consensus_queue.cc:1048] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.310331  4680 catalog_manager.cc:5697] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.331975  5131 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:36.331771  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.320658  4750 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:36.332679  4859 raft_consensus.cc:2468] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.334359  5131 raft_consensus.cc:2804] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.335062  4749 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.334873  5131 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.335799  5131 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.336755  5272 raft_consensus.cc:2804] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.337150  5272 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.337458  5272 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.344728  5272 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.354243  5054 raft_consensus.cc:359] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.365464  5054 raft_consensus.cc:385] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.365819  5054 raft_consensus.cc:740] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.366541  5054 consensus_queue.cc:260] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.367790  5062 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.368247  5062 ts_tablet_manager.cc:1403] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.007s
I20260709 13:12:36.369059  5054 ts_tablet_manager.cc:1434] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:12:36.355564  4684 catalog_manager.cc:5697] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.358317  5318 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.370005  5318 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.370982  5062 raft_consensus.cc:359] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.343513  5131 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.360610  5258 raft_consensus.cc:2749] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.361757  5263 consensus_queue.cc:1048] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.362994  5301 raft_consensus.cc:493] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.363703  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.372162  5318 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.372781  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.383724  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:36.385205  5131 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.375826  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:36.376348  5272 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:36.385824  4859 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.386633  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:36.378203  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:36.387259  4935 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.379210  4934 raft_consensus.cc:2468] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.374680  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.389272  4861 raft_consensus.cc:2393] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 1: Already voted for candidate f6c95e5d9485488f9de4ffe24035c81d in this term.
I20260709 13:12:36.391055  4972 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.381024  5413 consensus_queue.cc:1048] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:36.371661  5062 raft_consensus.cc:385] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.392937  5062 raft_consensus.cc:740] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.393204  4859 raft_consensus.cc:2468] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.396760  4749 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:36.396970  5062 consensus_queue.cc:260] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.397912  5004 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.398021  5258 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.404987  5004 raft_consensus.cc:2468] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.405339  5258 raft_consensus.cc:2749] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.407362  5062 ts_tablet_manager.cc:1434] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:12:36.408358  5062 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.408699  4751 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.409835  5272 raft_consensus.cc:2804] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.411813  5272 raft_consensus.cc:697] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.412834  5272 consensus_queue.cc:237] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.415334  5062 tablet_bootstrap.cc:654] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.397751  5131 raft_consensus.cc:2804] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.421030  5131 raft_consensus.cc:697] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.421953  5131 consensus_queue.cc:237] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.425280  5054 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.396011  4935 raft_consensus.cc:2468] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.379421  5301 raft_consensus.cc:515] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.430997  5301 leader_election.cc:290] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.431720  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937c0a0afa904d0ba5e441074701b4d8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.432575  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937c0a0afa904d0ba5e441074701b4d8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.432675  4859 raft_consensus.cc:2468] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:36.433529  5062 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
W20260709 13:12:36.433996  4900 leader_election.cc:343] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.434043  5062 ts_tablet_manager.cc:1403] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:12:36.381884  5056 tablet_bootstrap.cc:654] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.434574  4898 leader_election.cc:304] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:36.435835  5301 raft_consensus.cc:2804] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.436246  5301 raft_consensus.cc:493] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.436612  5301 raft_consensus.cc:3060] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.437021  5062 raft_consensus.cc:359] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.437704  5062 raft_consensus.cc:385] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.437964  5062 raft_consensus.cc:740] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.438756  5062 consensus_queue.cc:260] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.440994  5062 ts_tablet_manager.cc:1434] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:36.441895  5062 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.447490  5062 tablet_bootstrap.cc:654] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.458779  5062 tablet_bootstrap.cc:492] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.459220  5062 ts_tablet_manager.cc:1403] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:12:36.462345  5062 raft_consensus.cc:359] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.463032  5062 raft_consensus.cc:385] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.463294  5062 raft_consensus.cc:740] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.464038  5062 consensus_queue.cc:260] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.473742  5301 raft_consensus.cc:515] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.475886  5301 leader_election.cc:290] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.476529  5062 ts_tablet_manager.cc:1434] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:36.483539  5054 tablet_bootstrap.cc:654] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.485152  5062 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.488585  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937c0a0afa904d0ba5e441074701b4d8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:36.494196  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937c0a0afa904d0ba5e441074701b4d8" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:36.494870  5007 raft_consensus.cc:3060] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.496959  5378 raft_consensus.cc:493] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.497442  5378 raft_consensus.cc:515] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.499687  5378 leader_election.cc:290] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:36.500360  5349 raft_consensus.cc:493] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.500792  5062 tablet_bootstrap.cc:654] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.500885  5349 raft_consensus.cc:515] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.503126  5349 leader_election.cc:290] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.503717  5272 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.505815  5272 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.511446  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.511935  4859 raft_consensus.cc:3060] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.517686  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.520453  5272 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.522228  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.530755  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b456ffffa884668a41f15046cec623b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.537957  4684 catalog_manager.cc:5697] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.547411  4684 catalog_manager.cc:5697] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.531312  4783 raft_consensus.cc:2393] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 1: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:36.552867  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:36.554785  4751 leader_election.cc:343] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.558629  4859 raft_consensus.cc:2468] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:36.559631  4901 leader_election.cc:304] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.560793  4975 leader_election.cc:304] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.560873  4898 leader_election.cc:304] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:36.551375  5007 raft_consensus.cc:2468] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:36.563177  5318 raft_consensus.cc:2749] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.564268  5414 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.574873  5056 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.575650  5056 ts_tablet_manager.cc:1403] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.256s	user 0.031s	sys 0.012s
I20260709 13:12:36.576946  5414 raft_consensus.cc:2749] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.565555  5301 raft_consensus.cc:2804] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.577647  5301 raft_consensus.cc:697] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:36.578524  5301 consensus_queue.cc:237] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.581982  5062 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.582465  5062 ts_tablet_manager.cc:1403] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.100s	user 0.026s	sys 0.015s
I20260709 13:12:36.581629  5056 raft_consensus.cc:359] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.584281  5056 raft_consensus.cc:385] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.584584  5056 raft_consensus.cc:740] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.584470  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.585578  4859 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.586861  5054 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.587010  4749 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:36.587378  5054 ts_tablet_manager.cc:1403] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.000s
I20260709 13:12:36.588528  5415 raft_consensus.cc:2804] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.588888  5415 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.589226  5415 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.591033  5056 consensus_queue.cc:260] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.595613  5062 raft_consensus.cc:359] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.598440  5056 ts_tablet_manager.cc:1434] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:12:36.600642  5056 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:36.606544  5272 consensus_queue.cc:1048] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:36.608058  5056 tablet_bootstrap.cc:654] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.609814  5062 raft_consensus.cc:385] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.610193  5062 raft_consensus.cc:740] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.611038  5062 consensus_queue.cc:260] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.617432  5119 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.618006  5119 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.620463  5119 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:36.621214  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.622529  5062 ts_tablet_manager.cc:1434] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
W20260709 13:12:36.622913  4827 leader_election.cc:343] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.623766  5062 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.624123  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.625298  4682 catalog_manager.cc:5697] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.627221  5054 raft_consensus.cc:359] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:36.630721  4825 leader_election.cc:343] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.630244  5415 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.641058  4825 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.642860  5071 consensus_queue.cc:1048] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.644050  5071 raft_consensus.cc:2749] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.645155  5415 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.647037  5062 tablet_bootstrap.cc:654] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.647138  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:36.647956  5007 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.632614  5056 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.651279  5056 ts_tablet_manager.cc:1403] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.006s
I20260709 13:12:36.656559  5056 raft_consensus.cc:359] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.657611  5056 raft_consensus.cc:385] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.657955  5056 raft_consensus.cc:740] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.657271  5054 raft_consensus.cc:385] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.658748  5054 raft_consensus.cc:740] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.660567  5119 consensus_queue.cc:1048] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.663239  5054 consensus_queue.cc:260] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.665633  5311 consensus_queue.cc:1048] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.674161  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:36.677819  4859 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.689213  5007 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.664196  5056 consensus_queue.cc:260] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.689558  5054 ts_tablet_manager.cc:1434] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:12:36.692544  4751 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.708249  5056 ts_tablet_manager.cc:1434] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:12:36.714316  5311 raft_consensus.cc:2804] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.709479  5056 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:36.714895  5311 raft_consensus.cc:697] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.715936  5311 consensus_queue.cc:237] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.721102  5056 tablet_bootstrap.cc:654] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.697979  4859 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.704475  5062 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.725838  5062 ts_tablet_manager.cc:1403] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.026s
I20260709 13:12:36.726889  5131 raft_consensus.cc:493] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.727566  5131 raft_consensus.cc:515] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.728577  5062 raft_consensus.cc:359] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.729282  5062 raft_consensus.cc:385] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.729532  5062 raft_consensus.cc:740] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.729846  5054 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.731462  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.731299  5062 consensus_queue.cc:260] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.732064  4935 raft_consensus.cc:2468] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.735112  5062 ts_tablet_manager.cc:1434] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:36.736886  4750 leader_election.cc:304] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.742978  5054 tablet_bootstrap.cc:654] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.745111  5311 raft_consensus.cc:2804] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.745527  5311 raft_consensus.cc:493] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.745900  5311 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.750151  5062 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.755537  5131 leader_election.cc:290] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.756353  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
W20260709 13:12:36.758379  4751 leader_election.cc:343] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.763967  5062 tablet_bootstrap.cc:654] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.785185  5062 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:36.784955  5311 raft_consensus.cc:515] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.785748  5062 ts_tablet_manager.cc:1403] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
I20260709 13:12:36.793481  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:36.794271  4935 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.798398  5062 raft_consensus.cc:359] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.799449  5062 raft_consensus.cc:385] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.799762  5062 raft_consensus.cc:740] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.800938  5311 leader_election.cc:290] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:36.802922  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:36.817024  5443 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.817850  5443 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.821240  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:36.821401  5054 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.822171  5007 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.824676  4751 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.825789  5311 raft_consensus.cc:2804] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.826264  5311 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.826838  5311 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.828584  5054 ts_tablet_manager.cc:1403] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.099s	user 0.031s	sys 0.024s
I20260709 13:12:36.831642  5007 raft_consensus.cc:3060] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.823099  5062 consensus_queue.cc:260] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.836946  5005 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.840118  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:36.847404  4859 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:36.846506  5054 raft_consensus.cc:359] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.848023  5054 raft_consensus.cc:385] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.848322  5054 raft_consensus.cc:740] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.847302  5415 consensus_queue.cc:1048] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.840204  5443 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.852744  5005 raft_consensus.cc:2468] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.853303  5258 raft_consensus.cc:493] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.853772  5258 raft_consensus.cc:515] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.860212  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:36.861379  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:36.862049  4783 raft_consensus.cc:2468] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:36.863214  4975 leader_election.cc:304] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.864053  5258 leader_election.cc:290] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:36.864879  5056 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.865127  5318 raft_consensus.cc:2804] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:36.865376  5056 ts_tablet_manager.cc:1403] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.156s	user 0.056s	sys 0.079s
I20260709 13:12:36.865559  5318 raft_consensus.cc:493] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.865978  5318 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:36.872298  5062 ts_tablet_manager.cc:1434] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.004s
I20260709 13:12:36.872653  5056 raft_consensus.cc:359] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.875751  5056 raft_consensus.cc:385] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.876034  5056 raft_consensus.cc:740] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.876539  5062 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:36.876775  5056 consensus_queue.cc:260] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.878335  5056 ts_tablet_manager.cc:1434] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:36.834632  5311 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.884277  5311 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:36.874136  4935 raft_consensus.cc:2468] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.874847  5318 raft_consensus.cc:515] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.886708  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:36.886950  5318 leader_election.cc:290] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:36.879237  5056 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:36.873651  5054 consensus_queue.cc:260] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:36.887346  4859 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.882077  4751 leader_election.cc:304] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.887650  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:36.888267  4934 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:36.889132  5054 ts_tablet_manager.cc:1434] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.003s
I20260709 13:12:36.891605  5272 raft_consensus.cc:2804] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.892185  5272 raft_consensus.cc:697] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.893008  5272 consensus_queue.cc:237] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.895136  5054 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.896663  5131 consensus_queue.cc:1048] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.898440  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaafca747714377b26752357eb9c97b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:36.903595  4934 raft_consensus.cc:2468] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:36.904510  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:36.904853  4973 leader_election.cc:304] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:36.905134  5005 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.906390  5318 raft_consensus.cc:2804] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:36.906870  5318 raft_consensus.cc:697] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:36.911361  5318 consensus_queue.cc:237] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:36.915395  4859 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.918303  4749 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:36.919353  5415 raft_consensus.cc:2804] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.920070  5415 raft_consensus.cc:697] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:36.920907  5415 consensus_queue.cc:237] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:36.925290  5062 tablet_bootstrap.cc:654] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.936153  5054 tablet_bootstrap.cc:654] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.940435  5056 tablet_bootstrap.cc:654] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:36.949090  4751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.4:34929, user_credentials={real_user=slave}} blocked reactor thread for 56401.4us
I20260709 13:12:36.976258  5054 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:36.976799  5054 ts_tablet_manager.cc:1403] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.022s
I20260709 13:12:36.974658  5056 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:36.977876  5056 ts_tablet_manager.cc:1403] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.001s
I20260709 13:12:36.980041  4684 catalog_manager.cc:5697] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.980525  5054 raft_consensus.cc:359] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.981510  5054 raft_consensus.cc:385] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.976702  5005 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:36.981882  5054 raft_consensus.cc:740] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.983037  5054 consensus_queue.cc:260] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:36.985455  5054 ts_tablet_manager.cc:1434] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:12:36.986356  4684 catalog_manager.cc:5697] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.989547  5054 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: Bootstrap starting.
I20260709 13:12:36.989305  4684 catalog_manager.cc:5697] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.001924  5056 raft_consensus.cc:359] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.002737  5056 raft_consensus.cc:385] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.003014  5056 raft_consensus.cc:740] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.009965  4682 catalog_manager.cc:5697] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.013409  5446 consensus_queue.cc:1048] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.023505  4934 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.029989  5056 consensus_queue.cc:260] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.037222  5062 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:37.037835  5062 ts_tablet_manager.cc:1403] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.010s
I20260709 13:12:37.047868  5413 consensus_queue.cc:1048] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.047211  5062 raft_consensus.cc:359] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:37.053375  5062 raft_consensus.cc:385] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.053650  5062 raft_consensus.cc:740] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.055927  5056 ts_tablet_manager.cc:1434] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.003s
I20260709 13:12:37.057667  5054 tablet_bootstrap.cc:654] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.054298  5062 consensus_queue.cc:260] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:37.061564  5056 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:37.070001  5062 ts_tablet_manager.cc:1434] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:12:37.075392  5062 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:37.084249  5446 consensus_queue.cc:1048] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.090505  5056 tablet_bootstrap.cc:654] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.101737  5062 tablet_bootstrap.cc:654] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.104077  5414 consensus_queue.cc:1048] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.123348  5056 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: No bootstrap required, opened a new log
I20260709 13:12:37.123904  5056 ts_tablet_manager.cc:1403] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.004s
I20260709 13:12:37.141887  5415 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.149838  5054 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: No bootstrap required, opened a new log
I20260709 13:12:37.153250  5062 tablet_bootstrap.cc:492] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:37.153443  5054 ts_tablet_manager.cc:1403] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.002s
I20260709 13:12:37.153808  5062 ts_tablet_manager.cc:1403] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:12:37.155975  5131 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.156479  5131 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.158406  5131 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:37.163368  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:37.164085  4932 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:37.166412  5056 raft_consensus.cc:359] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.167143  5056 raft_consensus.cc:385] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.167419  5056 raft_consensus.cc:740] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.168025  5056 consensus_queue.cc:260] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.170254  5056 ts_tablet_manager.cc:1434] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:12:37.171666  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:37.172369  4861 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:37.173967  5062 raft_consensus.cc:359] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:37.174484  5062 raft_consensus.cc:385] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.174733  5062 raft_consensus.cc:740] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.175377  5062 consensus_queue.cc:260] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:37.176748  5062 ts_tablet_manager.cc:1434] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:12:37.172005  4750 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:37.178625  5131 raft_consensus.cc:2804] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.179004  5131 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.179303  5131 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.177558  5062 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: Bootstrap starting.
I20260709 13:12:37.181020  5054 raft_consensus.cc:359] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.181720  5054 raft_consensus.cc:385] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.182003  5054 raft_consensus.cc:740] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.184973  5054 consensus_queue.cc:260] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.186866  5062 tablet_bootstrap.cc:654] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.188234  5054 ts_tablet_manager.cc:1434] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:12:37.190553  5318 raft_consensus.cc:493] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.191095  5318 raft_consensus.cc:515] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:37.192198  5062 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: No bootstrap required, opened a new log
I20260709 13:12:37.193177  5062 ts_tablet_manager.cc:1403] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:12:37.196523  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:37.197167  4859 raft_consensus.cc:2468] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:37.193096  5318 leader_election.cc:290] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:37.198967  4972 leader_election.cc:304] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:37.200376  5258 raft_consensus.cc:2804] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.200750  5258 raft_consensus.cc:493] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.201071  5258 raft_consensus.cc:3060] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.206527  5131 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.207422  5258 raft_consensus.cc:515] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:37.212112  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:37.212625  4859 raft_consensus.cc:3060] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.212648  5258 leader_election.cc:290] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:37.215492  5272 raft_consensus.cc:493] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.215394  5062 raft_consensus.cc:359] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.216024  5272 raft_consensus.cc:515] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.216061  5062 raft_consensus.cc:385] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.217360  5062 raft_consensus.cc:740] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.218019  5062 consensus_queue.cc:260] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.218511  5272 leader_election.cc:290] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:37.219045  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:37.219627  5007 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:37.220553  5062 ts_tablet_manager.cc:1434] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:12:37.220942  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:37.221549  4783 raft_consensus.cc:2468] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 0.
I20260709 13:12:37.222419  4751 leader_election.cc:304] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:37.223837  5272 raft_consensus.cc:2804] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.224260  5272 raft_consensus.cc:493] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.224548  5272 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.227041  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92327700b56842d580bb260af45dad1b" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:37.227645  4786 raft_consensus.cc:3060] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.232920  5272 raft_consensus.cc:515] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.234830  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:37.235518  4932 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 0.
I20260709 13:12:37.237061  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:37.237200  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:37.237596  4932 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.237946  5007 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.234455  4859 raft_consensus.cc:2468] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:37.240530  4972 leader_election.cc:304] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:37.234455  4786 raft_consensus.cc:2468] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:37.243033  5258 raft_consensus.cc:2804] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.243654  5258 raft_consensus.cc:697] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:37.244478  5258 consensus_queue.cc:237] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:37.243113  5272 leader_election.cc:290] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:37.247596  5007 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:37.247911  5445 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.248891  4751 leader_election.cc:304] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:37.249629  5445 raft_consensus.cc:2804] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.250089  5445 raft_consensus.cc:697] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:37.251041  5131 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:37.250952  5445 consensus_queue.cc:237] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.252208  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:37.252827  4934 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.260907  4934 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:37.265967  4750 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:37.266783  5131 raft_consensus.cc:2804] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.267241  5131 raft_consensus.cc:697] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:37.267928  5131 consensus_queue.cc:237] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.268729  5414 raft_consensus.cc:493] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.269277  5414 raft_consensus.cc:515] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:37.272439  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:37.273007  4858 raft_consensus.cc:2468] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:37.274269  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:37.274801  4858 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.275215  4898 leader_election.cc:304] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:37.273157  5414 leader_election.cc:290] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:37.276844  5414 raft_consensus.cc:2804] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.277184  5414 raft_consensus.cc:493] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.277496  5414 raft_consensus.cc:3060] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.280606  4932 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
W20260709 13:12:37.284307  4732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:37.284889  4858 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 1.
I20260709 13:12:37.288497  4680 catalog_manager.cc:5697] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 1 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.292130  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:37.292836  5009 raft_consensus.cc:2468] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 0.
I20260709 13:12:37.300920  5414 raft_consensus.cc:515] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:37.303061  5414 leader_election.cc:290] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:37.304754  4684 catalog_manager.cc:5697] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.309026  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:37.309695  4858 raft_consensus.cc:3060] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.313385  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9388dee194834b479a120a34a1460d47" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:37.314057  5009 raft_consensus.cc:3060] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.323192  4858 raft_consensus.cc:2468] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:37.324581  4786 raft_consensus.cc:3055] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.326009  4898 leader_election.cc:304] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:37.327483  5414 raft_consensus.cc:2804] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.327976  5414 raft_consensus.cc:697] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:37.324632  5009 raft_consensus.cc:2468] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:37.325029  4786 raft_consensus.cc:740] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:37.330155  4786 consensus_queue.cc:260] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:37.330545  5414 consensus_queue.cc:237] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:37.331230  4786 raft_consensus.cc:3060] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.331460  4684 catalog_manager.cc:5697] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.342495  4786 raft_consensus.cc:1275] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:12:37.342924  4786 pending_rounds.cc:85] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Aborting all ops after (but not including) 0
I20260709 13:12:37.343233  4786 pending_rounds.cc:107] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:37.343472  4786 raft_consensus.cc:2889] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:37.344877  5318 consensus_queue.cc:1048] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.344599  4684 catalog_manager.cc:5697] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.355187  4932 raft_consensus.cc:1275] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:37.356650  5318 consensus_queue.cc:1048] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.425231  5131 consensus_queue.cc:1048] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.430646  5263 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.431278  5263 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.433387  5263 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:37.435335  4786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:37.435936  4786 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:37.437058  4827 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:37.436961  5445 consensus_queue.cc:1048] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.439292  5263 raft_consensus.cc:2804] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:37.439826  5263 raft_consensus.cc:493] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.440255  5263 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.438928  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:37.445829  4932 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:37.452061  5263 raft_consensus.cc:515] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.456599  5263 leader_election.cc:290] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:37.458627  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:37.459323  4934 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.468663  4783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296e8f525bb74ec48853794077e3bddf" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:37.469353  4783 raft_consensus.cc:3060] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.470343  4934 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:37.472582  4825 leader_election.cc:304] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:37.473294  5119 raft_consensus.cc:2804] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.473793  5119 raft_consensus.cc:697] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:37.474619  5119 consensus_queue.cc:237] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:37.478129  4783 raft_consensus.cc:2468] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:37.488983  4684 catalog_manager.cc:5697] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.705263  5445 consensus_queue.cc:1048] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.720309  5414 consensus_queue.cc:1048] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.720403  5131 consensus_queue.cc:1048] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.742867  5301 consensus_queue.cc:1048] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.753381  5318 consensus_queue.cc:1048] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.764492  5318 consensus_queue.cc:1048] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.827504  5446 consensus_queue.cc:1048] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.840507  5446 consensus_queue.cc:1048] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.926560  4934 raft_consensus.cc:1275] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:37.928045  5119 consensus_queue.cc:1048] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.937518  4783 raft_consensus.cc:1275] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:37.939244  5482 consensus_queue.cc:1048] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.312745 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
I20260709 13:12:39.352144 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:39.353320 29280 tablet_replica.cc:333] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.354324 29280 raft_consensus.cc:2243] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.356139 29280 raft_consensus.cc:2272] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.358178 29280 tablet_replica.cc:333] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.358951 29280 raft_consensus.cc:2243] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.359848 29280 raft_consensus.cc:2272] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.362911 29280 tablet_replica.cc:333] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.363770 29280 raft_consensus.cc:2243] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.364297 29280 raft_consensus.cc:2272] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.368237 29280 tablet_replica.cc:333] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.369102 29280 raft_consensus.cc:2243] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.369593 29280 raft_consensus.cc:2272] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.371948 29280 tablet_replica.cc:333] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.372787 29280 raft_consensus.cc:2243] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.373284 29280 raft_consensus.cc:2272] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.376454 29280 tablet_replica.cc:333] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
W20260709 13:12:39.376480  4975 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:39.377429 29280 raft_consensus.cc:2243] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.378279 29280 raft_consensus.cc:2272] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.381369 29280 tablet_replica.cc:333] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.382172 29280 raft_consensus.cc:2243] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.382755 29280 raft_consensus.cc:2272] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.385030 29280 tablet_replica.cc:333] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.385928 29280 raft_consensus.cc:2243] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:39.386613  4975 consensus_peers.cc:597] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.386983 29280 raft_consensus.cc:2272] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.401216 29280 tablet_replica.cc:333] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.402151 29280 raft_consensus.cc:2243] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.407991 29280 raft_consensus.cc:2272] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:39.408051  4827 consensus_peers.cc:597] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.411034 29280 tablet_replica.cc:333] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.412071 29280 raft_consensus.cc:2243] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.413376 29280 raft_consensus.cc:2272] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.416368 29280 tablet_replica.cc:333] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.417273 29280 raft_consensus.cc:2243] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.417857 29280 raft_consensus.cc:2272] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.420670 29280 tablet_replica.cc:333] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.421572 29280 raft_consensus.cc:2243] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.422116 29280 raft_consensus.cc:2272] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:39.422358  4901 consensus_peers.cc:597] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.424566 29280 tablet_replica.cc:333] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.425470 29280 raft_consensus.cc:2243] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.425936 29280 raft_consensus.cc:2272] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.428059 29280 tablet_replica.cc:333] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.428730 29280 raft_consensus.cc:2243] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.429750 29280 raft_consensus.cc:2272] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.432168 29280 tablet_replica.cc:333] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.432977 29280 raft_consensus.cc:2243] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:39.433233  4827 consensus_peers.cc:597] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.433492 29280 raft_consensus.cc:2272] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.435755 29280 tablet_replica.cc:333] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.436391 29280 raft_consensus.cc:2243] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.436854 29280 raft_consensus.cc:2272] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.439779 29280 tablet_replica.cc:333] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.440625 29280 raft_consensus.cc:2243] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.441687 29280 raft_consensus.cc:2272] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.443902 29280 tablet_replica.cc:333] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.444646 29280 raft_consensus.cc:2243] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.445451 29280 raft_consensus.cc:2272] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.447558 29280 tablet_replica.cc:333] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.448258 29280 raft_consensus.cc:2243] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.449136 29280 raft_consensus.cc:2272] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.451658 29280 tablet_replica.cc:333] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.452464 29280 raft_consensus.cc:2243] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.454344 29280 raft_consensus.cc:2272] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.456753 29280 tablet_replica.cc:333] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.457365 29280 raft_consensus.cc:2243] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.457888 29280 raft_consensus.cc:2272] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.460302 29280 tablet_replica.cc:333] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.460954 29280 raft_consensus.cc:2243] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.461835 29280 raft_consensus.cc:2272] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.463853 29280 tablet_replica.cc:333] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.464480 29280 raft_consensus.cc:2243] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.464911 29280 raft_consensus.cc:2272] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.467372 29280 tablet_replica.cc:333] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
W20260709 13:12:39.467499  4827 consensus_peers.cc:597] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.468318 29280 raft_consensus.cc:2243] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.468897 29280 raft_consensus.cc:2272] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.471441 29280 tablet_replica.cc:333] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
W20260709 13:12:39.471992  4827 consensus_peers.cc:597] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.472319 29280 raft_consensus.cc:2243] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.472942 29280 raft_consensus.cc:2272] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.475248 29280 tablet_replica.cc:333] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.475879 29280 raft_consensus.cc:2243] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.476660 29280 raft_consensus.cc:2272] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.478848 29280 tablet_replica.cc:333] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.479491 29280 raft_consensus.cc:2243] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.479939 29280 raft_consensus.cc:2272] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.482506 29280 tablet_replica.cc:333] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.483378 29280 raft_consensus.cc:2243] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.483906 29280 raft_consensus.cc:2272] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:39.484514  4975 consensus_peers.cc:597] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.486104 29280 tablet_replica.cc:333] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.487061 29280 raft_consensus.cc:2243] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.487588 29280 raft_consensus.cc:2272] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.490170 29280 tablet_replica.cc:333] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.490885 29280 raft_consensus.cc:2243] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.491878 29280 raft_consensus.cc:2272] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.494328 29280 tablet_replica.cc:333] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.495153 29280 raft_consensus.cc:2243] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.495649 29280 raft_consensus.cc:2272] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.497933 29280 tablet_replica.cc:333] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.498768 29280 raft_consensus.cc:2243] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.499547 29280 raft_consensus.cc:2272] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.501296 29280 tablet_replica.cc:333] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.501927 29280 raft_consensus.cc:2243] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.502311 29280 raft_consensus.cc:2272] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.504261 29280 tablet_replica.cc:333] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.504892 29280 raft_consensus.cc:2243] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.505335 29280 raft_consensus.cc:2272] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.507740 29280 tablet_replica.cc:333] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.508585 29280 raft_consensus.cc:2243] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:39.508747  4975 consensus_peers.cc:597] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.509186 29280 raft_consensus.cc:2272] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.511287 29280 tablet_replica.cc:333] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.511920 29280 raft_consensus.cc:2243] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.512713 29280 raft_consensus.cc:2272] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.514626 29280 tablet_replica.cc:333] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.515219 29280 raft_consensus.cc:2243] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.515640 29280 raft_consensus.cc:2272] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.517699 29280 tablet_replica.cc:333] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.518345 29280 raft_consensus.cc:2243] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.519285 29280 raft_consensus.cc:2272] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:39.519624  4901 consensus_peers.cc:597] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.521533 29280 tablet_replica.cc:333] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.522126 29280 raft_consensus.cc:2243] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.522580 29280 raft_consensus.cc:2272] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.524646 29280 tablet_replica.cc:333] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.525295 29280 raft_consensus.cc:2243] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.525662 29280 raft_consensus.cc:2272] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.527611 29280 tablet_replica.cc:333] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.528134 29280 raft_consensus.cc:2243] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.528498 29280 raft_consensus.cc:2272] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.530504 29280 tablet_replica.cc:333] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.531261 29280 raft_consensus.cc:2243] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.531764 29280 raft_consensus.cc:2272] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.533708 29280 tablet_replica.cc:333] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.534250 29280 raft_consensus.cc:2243] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.535051 29280 raft_consensus.cc:2272] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.536993 29280 tablet_replica.cc:333] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.537631 29280 raft_consensus.cc:2243] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:39.538513 29280 raft_consensus.cc:2272] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:39.540959 29280 tablet_replica.cc:333] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: stopping tablet replica
I20260709 13:12:39.541618 29280 raft_consensus.cc:2243] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:39.542119 29280 raft_consensus.cc:2272] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:39.543946  4827 consensus_peers.cc:597] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.600347  4901 consensus_peers.cc:597] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.604662 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
W20260709 13:12:39.619298  4975 consensus_peers.cc:597] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.629431  4901 consensus_peers.cc:597] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.636498  4827 consensus_peers.cc:597] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.651274  4901 consensus_peers.cc:597] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.659106 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:39.665259  5493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.667186  5494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.668684  5496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.670755 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:39.678962 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:39.679234 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:39.679481 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602759679462 us; error 0 us; skew 500 ppm
I20260709 13:12:39.680200 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:39.683576 29280 webserver.cc:533] Webserver started at http://127.28.152.1:37825/ using document root <none> and password file <none>
I20260709 13:12:39.684119 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:39.684343 29280 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:12:39.688854  4901 consensus_peers.cc:597] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.691834 29280 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:12:39.694602  4901 consensus_peers.cc:597] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.698967  4827 consensus_peers.cc:597] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.702560  5501 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:12:39.702987  4975 consensus_peers.cc:597] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.703622 29280 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:12:39.704061 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "f6c95e5d9485488f9de4ffe24035c81d"
format_stamp: "Formatted at 2026-07-09 13:12:28 on dist-test-slave-x7j4"
I20260709 13:12:39.704484 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:39.723677 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:39.725155 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:39.726909 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:39.731895  5508 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:12:39.748196  4975 consensus_peers.cc:597] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.749531  4901 consensus_peers.cc:597] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.764009  4827 consensus_peers.cc:597] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.781813  4827 consensus_peers.cc:597] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.802899  4975 consensus_peers.cc:597] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.808611  4901 consensus_peers.cc:597] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.834770  4975 consensus_peers.cc:597] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:39.837267  4827 consensus_peers.cc:597] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.972134 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:39.972604 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.242s	user 0.008s	sys 0.000s
I20260709 13:12:39.972999 29280 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:39.978183  5508 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:39.990600  5508 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:39.991408  5508 tablet_bootstrap.cc:492] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:39.991941  5508 ts_tablet_manager.cc:1403] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:12:39.993817  5508 raft_consensus.cc:359] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:39.994307  5508 raft_consensus.cc:740] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.994976  5508 consensus_queue.cc:260] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:39.996986  5508 ts_tablet_manager.cc:1434] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:12:39.997641  5508 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.015889  5508 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.016640  5508 tablet_bootstrap.cc:492] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.017215  5508 ts_tablet_manager.cc:1403] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:12:40.019097  5508 raft_consensus.cc:359] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.019593  5508 raft_consensus.cc:740] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.020098  5508 consensus_queue.cc:260] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.021575  5508 ts_tablet_manager.cc:1434] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:12:40.022264  5508 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.042402  5508 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.043376  5508 tablet_bootstrap.cc:492] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.044037  5508 ts_tablet_manager.cc:1403] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:12:40.047397  5508 raft_consensus.cc:359] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.048264  5508 raft_consensus.cc:740] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.048942  5508 consensus_queue.cc:260] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.051002  5508 ts_tablet_manager.cc:1434] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:40.051854  5508 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.176873  5508 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.178447  5508 tablet_bootstrap.cc:492] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.179396  5508 ts_tablet_manager.cc:1403] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.012s
I20260709 13:12:40.183148  5508 raft_consensus.cc:359] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.184468  5508 raft_consensus.cc:740] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.195081  5508 consensus_queue.cc:260] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.198622  5508 ts_tablet_manager.cc:1434] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:40.199878  5508 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.268163  5508 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.269343  5508 tablet_bootstrap.cc:492] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.271306  5508 ts_tablet_manager.cc:1403] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.004s
I20260709 13:12:40.280369  5508 raft_consensus.cc:359] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.281090  5508 raft_consensus.cc:740] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.282210  5508 consensus_queue.cc:260] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.284478  5508 ts_tablet_manager.cc:1434] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:40.285434  5508 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.338955  5508 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.339912  5508 tablet_bootstrap.cc:492] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.340503  5508 ts_tablet_manager.cc:1403] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.007s
I20260709 13:12:40.342775  5508 raft_consensus.cc:359] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.343310  5508 raft_consensus.cc:740] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.343921  5508 consensus_queue.cc:260] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.345436  5508 ts_tablet_manager.cc:1434] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:40.346179  5508 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.370877  5508 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.371883  5508 tablet_bootstrap.cc:492] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.372399  5508 ts_tablet_manager.cc:1403] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:12:40.375032  5508 raft_consensus.cc:359] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.375509  5508 raft_consensus.cc:740] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.376178  5508 consensus_queue.cc:260] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.377789  5508 ts_tablet_manager.cc:1434] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:12:40.378448  5508 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.397516  5522 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.398386  5522 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.401656  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.406769  5522 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:40.408980  4901 leader_election.cc:336] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.409582  4901 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.411031  5520 raft_consensus.cc:2749] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.421113  5508 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.423026  5508 tablet_bootstrap.cc:492] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.423826  5508 ts_tablet_manager.cc:1403] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.012s
I20260709 13:12:40.426776  5508 raft_consensus.cc:359] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.427520  5508 raft_consensus.cc:740] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.428767  5508 consensus_queue.cc:260] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.431275  5508 ts_tablet_manager.cc:1434] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:12:40.432302  5508 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.440984  5263 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.441797  5522 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.441699  5263 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.442806 29280 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:40.442386  5522 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.443210 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.470s	user 0.235s	sys 0.039s
I20260709 13:12:40.444958  5522 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.445232  5263 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.448101  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
W20260709 13:12:40.452384  4901 leader_election.cc:336] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.454409  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.455324  5508 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.456377  5508 tablet_bootstrap.cc:492] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.457083  5508 ts_tablet_manager.cc:1403] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:12:40.460165  5508 raft_consensus.cc:359] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.461258  5508 raft_consensus.cc:740] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.462759  4898 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.462441  5508 consensus_queue.cc:260] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.463919  5522 raft_consensus.cc:2749] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.465018  4827 leader_election.cc:336] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.465543  4827 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.465898  5508 ts_tablet_manager.cc:1434] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:12:40.466296  5263 raft_consensus.cc:2749] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.467106  5508 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.505157  5508 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.506214  5508 tablet_bootstrap.cc:492] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.506922  5508 ts_tablet_manager.cc:1403] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.002s
I20260709 13:12:40.510998  5508 raft_consensus.cc:359] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.511729  5508 raft_consensus.cc:740] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.512933  5511 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.513525  5511 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.516004  5511 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.520277  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:40.523627  4975 leader_election.cc:336] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.512583  5508 consensus_queue.cc:260] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.530283  5508 ts_tablet_manager.cc:1434] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 13:12:40.531162  5508 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.532667  4972 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.533793  5511 raft_consensus.cc:2749] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.534997  5511 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.535496  5511 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.538517  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.538744  5511 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.539125  5318 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.539829  5318 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.542513  5318 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.544268  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
W20260709 13:12:40.545275  4975 leader_election.cc:336] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.545753  4975 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.547170  5318 raft_consensus.cc:2749] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.549209  4975 leader_election.cc:336] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.549650  4975 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.550376  5318 raft_consensus.cc:2749] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.562891  5520 raft_consensus.cc:493] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.563746  5520 raft_consensus.cc:515] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.566406  5520 leader_election.cc:290] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.566944  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.573020  5508 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:40.572935  5509 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.574188  5508 tablet_bootstrap.cc:492] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:40.573884  5509 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.574939  5508 ts_tablet_manager.cc:1403] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:12:40.577235  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.577651  5509 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:40.578799  4901 leader_election.cc:336] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.578613  5508 raft_consensus.cc:359] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.579521  5508 raft_consensus.cc:740] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.580454  5508 consensus_queue.cc:260] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.582018  5508 ts_tablet_manager.cc:1434] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:40.579458  4901 leader_election.cc:304] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.582911  5508 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:40.582880  5520 raft_consensus.cc:2749] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.583501  4827 leader_election.cc:336] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.583943  4827 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.584996  5509 raft_consensus.cc:2749] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.586807  5509 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.587342  5509 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.588267  5511 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.588959  5511 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.589615  5509 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.590950  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.593477  5522 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.596787  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.594161  5522 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.599666  5511 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.600626  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.601205  5005 raft_consensus.cc:2468] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:40.602411  4900 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:40.603196  5520 raft_consensus.cc:2804] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.603546  5520 raft_consensus.cc:493] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.603904  5520 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.605837  5522 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:40.606426  4827 leader_election.cc:336] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
W20260709 13:12:40.606628  4975 leader_election.cc:336] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.606916  4827 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.607143  4975 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.607806  5509 raft_consensus.cc:2749] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:40.608062  5511 raft_consensus.cc:2749] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.612562  4901 leader_election.cc:336] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.621483  5511 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.622126  5511 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.625145  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.625770  4934 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:40.627174  4973 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:40.628290  5318 raft_consensus.cc:2804] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.628729  5318 raft_consensus.cc:493] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.629142  5318 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.634001  5522 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.634835  5522 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.639832  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.640417  4861 raft_consensus.cc:2468] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
W20260709 13:12:40.641891  4901 leader_election.cc:336] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.643388  4898 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.644891  5414 raft_consensus.cc:2804] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.645318  5414 raft_consensus.cc:493] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.645717  5414 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.647082  5484 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.647819  5484 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.650660  5484 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
W20260709 13:12:40.653221  4975 leader_election.cc:336] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.626215  5511 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.656649  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.657481  4861 raft_consensus.cc:2468] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:40.659279  4972 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:40.665959  5522 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.662662  5511 raft_consensus.cc:2804] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.673779  5484 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.676514  5484 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.678894  5522 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.679725  5522 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
W20260709 13:12:40.691571  4901 leader_election.cc:336] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.693745  5414 raft_consensus.cc:515] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.697844  5414 leader_election.cc:290] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.695699  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.698958  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.705508  4898 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.707180  5414 raft_consensus.cc:2749] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.707289  4901 leader_election.cc:336] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.713201  5263 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.714008  5263 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.717260  5263 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.723698  5263 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.724308  5263 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.727268  5263 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:40.728618  4827 leader_election.cc:336] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.732640  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.733636  4934 raft_consensus.cc:2468] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:40.735325 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:33395
I20260709 13:12:40.735534  5588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:33395 every 8 connection(s)
W20260709 13:12:40.740913  4827 leader_election.cc:336] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.747953  4825 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.749631  5263 raft_consensus.cc:2804] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:40.750118  5263 raft_consensus.cc:493] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.750515  5263 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.758914  5509 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.759910  5509 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.699064  5484 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.771287  5509 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.700340  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e66b31d7944054bde6909f874d9531" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:40.772017  4861 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.694258  5522 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
W20260709 13:12:40.780851  4975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.1:33395, user_credentials={real_user=slave}} blocked reactor thread for 58166.6us
W20260709 13:12:40.781739  4975 leader_election.cc:336] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
I20260709 13:12:40.783893  4861 raft_consensus.cc:2468] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 2.
I20260709 13:12:40.785668  4898 leader_election.cc:304] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.668043  5511 raft_consensus.cc:493] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.786932  5511 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:40.793004  4972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:43901, user_credentials={real_user=slave}} blocked reactor thread for 100189us
I20260709 13:12:40.804252  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.805269  5009 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:40.804356  5511 raft_consensus.cc:515] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.811800  5511 leader_election.cc:290] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.813342  5522 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.814924  5522 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.815999  5414 raft_consensus.cc:2804] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:40.816674  5414 raft_consensus.cc:697] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:40.818054  5509 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.818670  5509 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.819003  5523 raft_consensus.cc:493] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.819779  5523 raft_consensus.cc:515] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.821487  5509 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.823458  5522 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.822446  5523 leader_election.cc:290] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.817866  5414 consensus_queue.cc:237] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.832444  5509 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.833084  5509 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.835100  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.836289  5511 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.836614  5119 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.847507  5119 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.851176  5119 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.838392  5521 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.853772  5521 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.855649  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:40.845903  5511 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:40.859153  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:40.840991  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.844033  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.851709  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:40.840595  5489 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.840293  5509 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.857075  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:40.860703  5561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:40.858093  5560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:40.859546  5594 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.896607  5009 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:40.837076  5523 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.864130  5318 raft_consensus.cc:515] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.848163  5520 raft_consensus.cc:515] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:40.862973  4827 leader_election.cc:343] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.866570  4934 raft_consensus.cc:2468] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:40.884603  4861 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:40.886031  5007 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:40.874082  5119 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.865103  5263 raft_consensus.cc:515] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:40.938060  5414 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:40.938361  5318 leader_election.cc:290] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:40.867097  5521 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.904436  5511 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:40.944403  5263 leader_election.cc:290] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:40.951660  5414 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:40.956477  5119 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:40.971419  4827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33395, user_credentials={real_user=slave}} blocked reactor thread for 66002.1us
W20260709 13:12:40.972589  4827 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:40.973609  4827 leader_election.cc:343] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:40.975653  4825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 77991us
I20260709 13:12:40.980429  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:40.981164  4858 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:40.981258  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:40.990325  4861 raft_consensus.cc:2468] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:40.900789  5489 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.003854  4825 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:40.948210  5594 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.019757  5414 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.020949  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:41.021730  5007 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:40.965698  5523 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.024277  5119 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.028996  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:41.033538  4861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:41.029897  5009 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:41.034350  4861 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:41.012229  5522 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.038429  4935 raft_consensus.cc:2468] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
W20260709 13:12:41.039813  4827 leader_election.cc:343] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.044076  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.044195  5522 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.044773  4932 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.046057  4826 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.046833  5601 raft_consensus.cc:2804] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.047262  5601 raft_consensus.cc:493] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.047649  5601 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.048261  5489 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:41.049080  5561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a97f5da08f0457389cd2720c8c64d6d" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.049912  5561 raft_consensus.cc:3060] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.052119  5594 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.053092  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.054883  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.055087  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.055513  5562 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 1.
I20260709 13:12:41.056382  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.058779  5520 leader_election.cc:290] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.062237  4932 raft_consensus.cc:2468] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
W20260709 13:12:41.064612  4826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.4:34929, user_credentials={real_user=slave}} blocked reactor thread for 66863.4us
I20260709 13:12:41.064599  5119 raft_consensus.cc:2804] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.065402  5119 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.065821  5119 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.065835  4826 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.067605  5523 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:41.068056  5608 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.068322  4826 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.068496  5608 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.069212  5608 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.041422  5511 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.075172  5509 raft_consensus.cc:2804] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.075647  5509 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.075754  5561 raft_consensus.cc:2468] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.076058  5509 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.078570  5508 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.079082  5511 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.079640  5508 tablet_bootstrap.cc:492] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:41.080461  5508 ts_tablet_manager.cc:1403] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.498s	user 0.105s	sys 0.175s
I20260709 13:12:41.081293  5511 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:41.059443  5599 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.082214  5599 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.083099  5509 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.084381  5599 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.085093  5509 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.087119  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.092849  5522 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:41.094213  4972 leader_election.cc:304] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.094815  4827 leader_election.cc:304] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:41.097183  4972 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.098517  5603 raft_consensus.cc:2804] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.099205  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.099555  5607 raft_consensus.cc:2804] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.099851  4934 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.100144  5607 raft_consensus.cc:697] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.100903  4681 catalog_manager.cc:5697] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.101204  5607 consensus_queue.cc:237] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.101524  4930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:41.105288  4930 raft_consensus.cc:2468] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:41.108583  4898 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.109517  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.110134  5006 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.110456  5523 raft_consensus.cc:2804] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.110908  5523 raft_consensus.cc:493] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.111261  5523 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.113595  5484 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.114078  5484 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.114442  5484 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.108541  4900 leader_election.cc:304] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.099229  5603 raft_consensus.cc:697] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:41.116127  5520 raft_consensus.cc:2804] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.116528  5520 raft_consensus.cc:493] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.116940  5520 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.116776  5603 consensus_queue.cc:237] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.117930  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:41.118517  5009 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:41.122954  5006 raft_consensus.cc:2468] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 2.
I20260709 13:12:41.132869  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.123479  4900 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.133868  5556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.134017  5601 raft_consensus.cc:515] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.134649  5556 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:41.134580  5521 raft_consensus.cc:2804] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.136406  5589 heartbeater.cc:344] Connected to a master server at 127.28.152.62:37459
I20260709 13:12:41.142812  5589 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:41.124966  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.126410  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:41.144053  4935 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
W20260709 13:12:41.124347  4827 leader_election.cc:343] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.126994  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.129400  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" is_pre_election: true
I20260709 13:12:41.131330  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.132377  4826 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.142657  5521 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.148229  5009 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.126245  5555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90059dfb0354efcbdf13a0b245cefb3" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
W20260709 13:12:41.128621  4901 leader_election.cc:343] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.151302  4901 leader_election.cc:343] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.152067  4901 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.128613  4934 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:41.154304  5119 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.148823  5263 raft_consensus.cc:2804] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.147742  5007 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 1.
I20260709 13:12:41.163007  5263 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.163429  5263 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.164865  5414 raft_consensus.cc:2749] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:41.165824  4901 leader_election.cc:343] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.174957  5521 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.178126  5601 leader_election.cc:290] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
W20260709 13:12:41.180094  4973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 44788.2us
I20260709 13:12:41.180944  4973 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.181844  4973 leader_election.cc:304] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.183923  5589 heartbeater.cc:507] Master 127.28.152.62:37459 requested a full tablet report, sending...
I20260709 13:12:41.184105  5604 raft_consensus.cc:2804] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.184628  5604 raft_consensus.cc:493] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.185006  5604 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.183915  4900 leader_election.cc:304] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.186990  5580 raft_consensus.cc:2804] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.186869  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.187543  5580 raft_consensus.cc:697] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:41.187688  4935 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.188560  5520 raft_consensus.cc:515] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.181243  5263 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:41.196568  4901 leader_election.cc:343] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.196555  5009 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.196805  5119 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.198472  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.199187  5006 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.205665  5006 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.196359  4825 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.211094  5263 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:41.211968  4901 leader_election.cc:343] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.219661  5510 raft_consensus.cc:2804] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.220355  5510 raft_consensus.cc:697] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
W20260709 13:12:41.221490  4827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33395, user_credentials={real_user=slave}} blocked reactor thread for 47600.8us
I20260709 13:12:41.221359  5510 consensus_queue.cc:237] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:41.222151  4827 leader_election.cc:343] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.222824  4827 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:41.224572  5594 raft_consensus.cc:493] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.225174  5594 raft_consensus.cc:515] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.188524  5580 consensus_queue.cc:237] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.229166  5520 leader_election.cc:290] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.230827  5484 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.235692  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.236230  5009 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.239023  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.239605  5007 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.241072  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56552e1ca874e52bfef190ac96a1740" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.241647  5557 raft_consensus.cc:3060] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.243769  5560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.243697  5508 raft_consensus.cc:359] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.244031  5554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3bb45754e1f48068c332ed71e97ad32" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.244556  5508 raft_consensus.cc:740] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.244788  5554 raft_consensus.cc:3060] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.245110  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.245360  5508 consensus_queue.cc:260] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:41.246150  4901 leader_election.cc:343] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.247609  5119 raft_consensus.cc:2804] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.248003  5119 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.248342  5119 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.249547  4935 raft_consensus.cc:2468] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.251224  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:41.251997  4934 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:41.233398  5509 raft_consensus.cc:2804] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.213714  5561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.255824  5556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.235345  5484 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:41.258205  4826 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.247319  5594 leader_election.cc:290] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.266360  5263 raft_consensus.cc:2804] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.251377  5523 raft_consensus.cc:515] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.270439  5523 leader_election.cc:290] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:41.258844  5509 raft_consensus.cc:493] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.270982  5509 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.273787  5521 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.276554  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.276993  5552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.282958  5007 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 2.
I20260709 13:12:41.265535  5556 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 1.
I20260709 13:12:41.289649  5263 raft_consensus.cc:697] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.290585  5263 consensus_queue.cc:237] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.295496  4826 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.298679  5552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.299584  5556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.300200  5562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.300341  4973 leader_election.cc:304] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
W20260709 13:12:41.300845  4901 leader_election.cc:343] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.301265  4975 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.301242  5594 raft_consensus.cc:2804] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.301645  5608 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.302135  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf96d3b028bf425fa8ef6948ef4d699a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.302440  5594 raft_consensus.cc:493] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.302901  5594 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.308763  5554 raft_consensus.cc:2468] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:41.311395  4684 catalog_manager.cc:5697] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.314675  5552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:41.313514  5509 raft_consensus.cc:515] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.317018  5509 leader_election.cc:290] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:41.311985  5617 raft_consensus.cc:493] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.318524  5009 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.319803  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:41.320530  4858 raft_consensus.cc:2393] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 2: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:41.322131  5557 raft_consensus.cc:2468] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:41.322520  5599 raft_consensus.cc:2804] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.323180  5599 raft_consensus.cc:697] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.325690  5599 consensus_queue.cc:237] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.326227  4900 leader_election.cc:304] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.327173  5522 raft_consensus.cc:2804] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.327322  4975 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:41.327661  5522 raft_consensus.cc:697] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:41.328634  5484 raft_consensus.cc:2804] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.330399  5484 raft_consensus.cc:493] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.328557  5522 consensus_queue.cc:237] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.330858  5484 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.329527  5617 raft_consensus.cc:515] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.330868  5604 raft_consensus.cc:515] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.336673  5119 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
W20260709 13:12:41.339867  4825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 143024us
I20260709 13:12:41.338441  4826 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.342782  4825 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.346339  5489 raft_consensus.cc:2804] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.346899  5489 raft_consensus.cc:697] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.347703  5616 raft_consensus.cc:2804] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.348177  5616 raft_consensus.cc:493] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:41.347892  5489 consensus_queue.cc:237] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.348584  5616 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.350941  5594 raft_consensus.cc:515] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.352011  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.355612  4935 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.357324  5594 leader_election.cc:290] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.352639  5608 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:41.363106  4975 leader_election.cc:343] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.365067  4935 raft_consensus.cc:2468] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:41.366430  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.369876  4934 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.371616  5119 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.371716  5508 ts_tablet_manager.cc:1434] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.291s	user 0.008s	sys 0.009s
I20260709 13:12:41.372342  4973 leader_election.cc:304] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.373344  5508 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:41.374040  5318 raft_consensus.cc:2804] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.370522  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.366278  4825 leader_election.cc:304] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.379871  5318 raft_consensus.cc:697] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:41.380703  5318 consensus_queue.cc:237] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.383033  4930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.383512  4930 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.399626  4860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:41.399854  4859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:41.391661  5617 leader_election.cc:290] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:41.400496  4860 raft_consensus.cc:2393] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 2: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:41.397524  4858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:41.407305  4855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:41.407785  4858 raft_consensus.cc:2393] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 2: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:41.408007  4855 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.411736  4853 raft_consensus.cc:1275] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.412636  5555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa38c5ee7284bf6a4390de9a0f8ea74" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.394433  5604 leader_election.cc:290] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
W20260709 13:12:41.414009  4975 leader_election.cc:343] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.397439  5521 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.414497  4975 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.387179  5608 raft_consensus.cc:2804] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:41.415745  4975 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.417613  4827 leader_election.cc:343] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.420316  4827 leader_election.cc:343] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.420564  4972 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
W20260709 13:12:41.421066  4827 leader_election.cc:343] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.421033  4975 leader_election.cc:343] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.422552  4827 leader_election.cc:343] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.428009  4898 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.414021  5555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.435760  4934 raft_consensus.cc:2468] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:41.425657  5604 raft_consensus.cc:2749] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.440348  4973 leader_election.cc:304] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.430629  5608 raft_consensus.cc:697] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
W20260709 13:12:41.444835  4901 leader_election.cc:343] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.437600  5594 raft_consensus.cc:2749] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.441138  5555 raft_consensus.cc:3060] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.455897  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc863e914714666afa0468d30e21e3a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.457219  5600 raft_consensus.cc:2804] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.457789  5600 raft_consensus.cc:697] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:41.458731  5600 consensus_queue.cc:237] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.459844  5552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e325c8dae3b241c0b43a7b965cac7191" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.461751  5608 consensus_queue.cc:237] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.486225  4930 raft_consensus.cc:2468] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.439306  5510 consensus_queue.cc:1048] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:12:41.487780  4680 catalog_manager.cc:5697] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.489018  5616 raft_consensus.cc:515] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.496889  5616 leader_election.cc:290] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:41.497763  4859 raft_consensus.cc:2393] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 2: Already voted for candidate 7d069c6c6db44e9882ec432292c00563 in this term.
I20260709 13:12:41.499404  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.500214  5009 raft_consensus.cc:2393] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d069c6c6db44e9882ec432292c00563 in current term 2: Already voted for candidate e3b9d92f86c74ea0b6537c30a8846eab in this term.
I20260709 13:12:41.503643  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:41.504272  5009 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.506081  4901 consensus_peers.cc:597] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.489480  4855 raft_consensus.cc:2468] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 2.
I20260709 13:12:41.526899  4825 leader_election.cc:304] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.528283  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.528652  5263 raft_consensus.cc:2804] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.528954  4934 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.536883  5263 raft_consensus.cc:697] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
W20260709 13:12:41.538810  4898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.2:43901, user_credentials={real_user=slave}} blocked reactor thread for 101806us
I20260709 13:12:41.541056  5605 raft_consensus.cc:2749] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.550450  4934 raft_consensus.cc:2468] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.552052  4825 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:41.553205  5119 raft_consensus.cc:2804] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.553809  5119 raft_consensus.cc:697] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.555173  5009 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:41.560071  4898 leader_election.cc:304] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.517377  5484 raft_consensus.cc:515] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.556624  4826 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:41.562903  4898 leader_election.cc:304] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.565231  5484 leader_election.cc:290] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.566061  5006 raft_consensus.cc:2393] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f0ebe0c3053f48d6852e07257efbf0f9 in current term 2: Already voted for candidate e3b9d92f86c74ea0b6537c30a8846eab in this term.
I20260709 13:12:41.566905  5521 raft_consensus.cc:2749] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.569839  5598 raft_consensus.cc:2804] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.570416  5598 raft_consensus.cc:697] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:41.570961  5614 raft_consensus.cc:2804] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.571524  5614 raft_consensus.cc:697] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:41.571372  5598 consensus_queue.cc:237] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:41.558995  5119 consensus_queue.cc:237] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.557317  5263 consensus_queue.cc:237] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.579738  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:41.580787  4934 raft_consensus.cc:2393] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b9d92f86c74ea0b6537c30a8846eab in current term 2: Already voted for candidate f0ebe0c3053f48d6852e07257efbf0f9 in this term.
W20260709 13:12:41.586468  4975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33395, user_credentials={real_user=slave}} blocked reactor thread for 155813us
I20260709 13:12:41.587553  4861 raft_consensus.cc:1275] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:41.590677  4975 leader_election.cc:343] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.596416  4975 leader_election.cc:343] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.595881  5556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a86b4bab4f4187a53108485c2ad257" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.597941  5557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb1376921f9451bbafdf0355341d793" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.577679  5555 raft_consensus.cc:2468] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ebe0c3053f48d6852e07257efbf0f9 in term 2.
I20260709 13:12:41.599436  4975 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.572525  5614 consensus_queue.cc:237] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:41.600838  5553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30ffeaaf1e8242629b324e7fda7bb872" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.602521  4901 leader_election.cc:304] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:41.603520  5318 raft_consensus.cc:2749] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:41.642618  4827 leader_election.cc:343] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.644384  4933 raft_consensus.cc:1275] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:41.654088  4827 leader_election.cc:343] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.654608  5602 consensus_queue.cc:1048] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:12:41.648003  5613 raft_consensus.cc:2804] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.675362  5613 raft_consensus.cc:697] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Leader. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:41.676580  5613 consensus_queue.cc:237] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.686743  5508 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:41.691985  5318 consensus_queue.cc:1048] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:12:41.743333  5508 tablet_bootstrap.cc:492] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:41.750450  5508 ts_tablet_manager.cc:1403] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.378s	user 0.022s	sys 0.009s
I20260709 13:12:41.819005  5508 raft_consensus.cc:359] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.819721  5508 raft_consensus.cc:740] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.820438  5508 consensus_queue.cc:260] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:41.825037  5005 raft_consensus.cc:1275] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:41.825836  4827 consensus_peers.cc:597] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.829141  4827 consensus_peers.cc:597] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:41.830821  4901 consensus_peers.cc:597] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.832770  4901 consensus_peers.cc:597] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.834237  5561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
W20260709 13:12:41.836455  4827 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.836900  4827 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563; no voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:41.840610  5561 raft_consensus.cc:1275] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.844303  5508 ts_tablet_manager.cc:1434] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:12:41.845532  5508 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:41.846613  5509 raft_consensus.cc:2749] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.856307  5635 consensus_queue.cc:1048] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:12:41.903674  4825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 51531.5us
I20260709 13:12:41.905997  5007 raft_consensus.cc:1275] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.913981  4682 ts_manager.cc:194] Re-registered known tserver with Master: f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395)
I20260709 13:12:41.921926  5556 raft_consensus.cc:1275] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.923316  5645 consensus_queue.cc:1048] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:41.927074  5554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:41.927802  5554 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.933568  5635 consensus_queue.cc:1048] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.936435  5414 consensus_queue.cc:1048] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.939042  4930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" is_pre_election: true
I20260709 13:12:41.940780  5009 raft_consensus.cc:1275] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:41.947383  4975 consensus_peers.cc:597] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:41.964984  4934 raft_consensus.cc:1275] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:41.975970  5263 consensus_queue.cc:1048] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.977324  5318 consensus_queue.cc:1048] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.981546  4935 raft_consensus.cc:1275] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:41.995775  4827 consensus_peers.cc:597] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:41.998728  5005 raft_consensus.cc:1275] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.001206  4855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15cbb1e0264e3fae50d98caeaed84a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:42.049419  4932 raft_consensus.cc:1275] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.057471  5651 consensus_queue.cc:1048] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:12:42.087927  5008 raft_consensus.cc:1275] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.092525  5599 consensus_queue.cc:1048] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.093729  5555 raft_consensus.cc:1275] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.044898  5608 consensus_queue.cc:1048] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:12:42.127241  5502 leader_election.cc:304] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6c95e5d9485488f9de4ffe24035c81d; no voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9
I20260709 13:12:42.130375  5617 raft_consensus.cc:2749] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:42.114817  5598 consensus_queue.cc:1048] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:12:42.132894  5554 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
W20260709 13:12:42.180794  4973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:41787, user_credentials={real_user=slave}} blocked reactor thread for 85176.1us
W20260709 13:12:42.229902  5660 log.cc:927] Time spent T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:12:42.250650  4860 raft_consensus.cc:1275] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.260818  4933 raft_consensus.cc:1275] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.266346  5003 raft_consensus.cc:1275] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.276407  5119 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:42.278975  4827 consensus_peers.cc:597] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.280535  5119 consensus_queue.cc:1048] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:42.289053  4935 raft_consensus.cc:1275] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:42.296942  4975 consensus_peers.cc:597] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.302853  5614 consensus_queue.cc:1048] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.317595  5675 consensus_queue.cc:1048] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:42.317935  5659 log.cc:927] Time spent T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:42.332458  5556 raft_consensus.cc:3060] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.335793  5508 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:42.336182  4975 consensus_peers.cc:597] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.360407  4975 consensus_peers.cc:597] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.380987  5508 tablet_bootstrap.cc:492] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.381680  5508 ts_tablet_manager.cc:1403] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.536s	user 0.020s	sys 0.008s
I20260709 13:12:42.374064  4684 catalog_manager.cc:5697] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } }
I20260709 13:12:42.373054  4680 catalog_manager.cc:5697] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:42.383464  4827 consensus_peers.cc:597] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.400369  4680 catalog_manager.cc:5697] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.402278  4684 catalog_manager.cc:5697] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:42.403033  4827 consensus_peers.cc:597] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.407012  4930 raft_consensus.cc:1275] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:42.409531  4827 consensus_peers.cc:597] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.387588  5608 consensus_queue.cc:1048] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:42.417517  5559 raft_consensus.cc:1275] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.425585  5005 raft_consensus.cc:1275] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:42.428359  4827 consensus_peers.cc:597] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.429050  4827 consensus_peers.cc:597] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.434181  4684 catalog_manager.cc:5697] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.434224  4680 catalog_manager.cc:5697] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.441073  4684 catalog_manager.cc:5697] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.447755  4680 catalog_manager.cc:5697] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.484756  5508 raft_consensus.cc:359] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.463375  5510 consensus_queue.cc:1048] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:12:42.485646  5508 raft_consensus.cc:740] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.493440  5608 consensus_queue.cc:1048] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:42.501325  5679 log.cc:927] Time spent T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:12:42.504791  4827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:33395, user_credentials={real_user=slave}} blocked reactor thread for 70586.4us
I20260709 13:12:42.504362  4680 catalog_manager.cc:5697] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.486563  5508 consensus_queue.cc:260] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.528439  5508 ts_tablet_manager.cc:1434] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.146s	user 0.008s	sys 0.000s
I20260709 13:12:42.529314  5508 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.531418  5556 raft_consensus.cc:1275] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.539251  5553 raft_consensus.cc:1275] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Refusing update from remote peer f0ebe0c3053f48d6852e07257efbf0f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:42.541054  4901 consensus_peers.cc:597] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.541733  4901 consensus_peers.cc:597] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.542390  4975 consensus_peers.cc:597] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.544009  4901 consensus_peers.cc:597] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.545519  4901 consensus_peers.cc:597] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.546123  4901 consensus_peers.cc:597] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.546782  4901 consensus_peers.cc:597] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.547219  5615 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:42.548826  4827 consensus_peers.cc:597] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.567730  4680 catalog_manager.cc:5697] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:42.574733  4901 consensus_peers.cc:597] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.575587  4901 consensus_peers.cc:597] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.576264  4901 consensus_peers.cc:597] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.580412  4975 consensus_peers.cc:597] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.582993  5511 consensus_queue.cc:1048] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:42.593067  5614 consensus_queue.cc:1048] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.570286  4680 catalog_manager.cc:5697] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:42.672480  4975 consensus_peers.cc:597] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.673472  4682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41008
I20260709 13:12:42.685395  4682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41008 (request call id 1) took 1121 ms. Trace:
I20260709 13:12:42.689235  4682 rpcz_store.cc:276] 0709 13:12:41.564081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.564309 (+   228us) service_pool.cc:224] Handling call
0709 13:12:41.905111 (+340802us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54007c01d4. stack: 00007fa041f8a343 00007fa041f8a240 00007fa0419191d4 00007fa04b657304 00007fa04b657299 00007fa045013090 00007fa0450b1f3a 00007fa04ae681cc 00007fa04af6637e 00007fa0494272a4 00007fa049427232 00007fa049427161 00007fa0494270dc 00007fa049426392 00007fa0433e448c 00007fa0433e38c6
0709 13:12:42.685313 (+780202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28629,"reported_tablets":45,"spinlock_wait_cycles":379611904}
W20260709 13:12:42.695963  4827 consensus_peers.cc:597] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:42.696359  5589 heartbeater.cc:499] Master 127.28.152.62:37459 was elected leader, sending a full tablet report...
I20260709 13:12:42.697310  5508 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.702086  5508 tablet_bootstrap.cc:492] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.696448  4681 catalog_manager.cc:5697] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.702736  5508 ts_tablet_manager.cc:1403] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.000s
I20260709 13:12:42.703809  4681 catalog_manager.cc:5697] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.706284  5508 raft_consensus.cc:359] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.707456  4681 catalog_manager.cc:5697] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 reported cstate change: term changed from 1 to 2, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3). New cstate: current_term: 2 leader_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.707006  5508 raft_consensus.cc:740] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.713487  5508 consensus_queue.cc:260] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.715370  5508 ts_tablet_manager.cc:1434] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:12:42.716140  5508 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.766461  5508 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.767431  5508 tablet_bootstrap.cc:492] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.768105  5508 ts_tablet_manager.cc:1403] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.002s
I20260709 13:12:42.772946  5508 raft_consensus.cc:359] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.773602  5508 raft_consensus.cc:740] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.774315  5508 consensus_queue.cc:260] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.776615  5508 ts_tablet_manager.cc:1434] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:42.777343  5508 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.798123  5508 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.799070  5508 tablet_bootstrap.cc:492] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.799679  5508 ts_tablet_manager.cc:1403] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:12:42.801755  5508 raft_consensus.cc:359] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:42.802394  5508 raft_consensus.cc:740] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.803215  5508 consensus_queue.cc:260] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:42.806353  5508 ts_tablet_manager.cc:1434] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:12:42.807348  5508 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.831363  5508 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.832265  5508 tablet_bootstrap.cc:492] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.832883  5508 ts_tablet_manager.cc:1403] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 13:12:42.835813  5508 raft_consensus.cc:359] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.836460  5508 raft_consensus.cc:740] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.837133  5508 consensus_queue.cc:260] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.839190  5508 ts_tablet_manager.cc:1434] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:12:42.839968  5508 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.877970  5553 raft_consensus.cc:3060] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.879841  5508 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.880831  5508 tablet_bootstrap.cc:492] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.881405  5508 ts_tablet_manager.cc:1403] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.023s
I20260709 13:12:42.883522  5508 raft_consensus.cc:359] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.884155  5508 raft_consensus.cc:740] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.884806  5508 consensus_queue.cc:260] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:42.887781  5508 ts_tablet_manager.cc:1434] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:12:42.888876  5508 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.902595  5508 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.903517  5508 tablet_bootstrap.cc:492] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.904138  5508 ts_tablet_manager.cc:1403] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:12:42.906306  5508 raft_consensus.cc:359] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.906915  5508 raft_consensus.cc:740] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.907423  5508 consensus_queue.cc:260] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.908784  5508 ts_tablet_manager.cc:1434] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:42.910115  5508 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.938390  5508 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.939181  5508 tablet_bootstrap.cc:492] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.939724  5508 ts_tablet_manager.cc:1403] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.005s
I20260709 13:12:42.941645  5508 raft_consensus.cc:359] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.942164  5508 raft_consensus.cc:740] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.942783  5508 consensus_queue.cc:260] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.944556  5508 ts_tablet_manager.cc:1434] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:42.945693  5508 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.963016  5508 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.963961  5508 tablet_bootstrap.cc:492] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.964522  5508 ts_tablet_manager.cc:1403] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:12:42.966851  5508 raft_consensus.cc:359] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:42.967321  5508 raft_consensus.cc:740] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.968075  5508 consensus_queue.cc:260] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:42.969990  5508 ts_tablet_manager.cc:1434] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:12:42.971184  5508 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:42.983038  5508 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:42.983791  5508 tablet_bootstrap.cc:492] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:42.984431  5508 ts_tablet_manager.cc:1403] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:12:42.986891  5508 raft_consensus.cc:359] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.987550  5508 raft_consensus.cc:740] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.987845  5553 raft_consensus.cc:3060] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:42.988212  5508 consensus_queue.cc:260] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:42.990243  5508 ts_tablet_manager.cc:1434] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:42.991215  5508 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.013010  5508 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.013944  5508 tablet_bootstrap.cc:492] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.014601  5508 ts_tablet_manager.cc:1403] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:12:43.017544  5508 raft_consensus.cc:359] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.018301  5508 raft_consensus.cc:740] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.018972  5508 consensus_queue.cc:260] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.020959  5508 ts_tablet_manager.cc:1434] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:43.021735  5508 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.037863  5508 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.038655  5508 tablet_bootstrap.cc:492] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.039269  5508 ts_tablet_manager.cc:1403] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:12:43.041196  5508 raft_consensus.cc:359] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.041697  5508 raft_consensus.cc:740] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.042249  5508 consensus_queue.cc:260] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.044116  5508 ts_tablet_manager.cc:1434] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:43.045272  5508 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.053123  5662 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.053637  5662 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.055737  5662 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:43.057143  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d" is_pre_election: true
I20260709 13:12:43.057189  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563" is_pre_election: true
I20260709 13:12:43.058979  4853 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
W20260709 13:12:43.060106  4975 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.060678  4972 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:43.061316  5318 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:43.061663  5318 raft_consensus.cc:493] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.061910  5508 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.061962  5318 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.062891  5508 tablet_bootstrap.cc:492] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.063534  5508 ts_tablet_manager.cc:1403] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:12:43.067512  5318 raft_consensus.cc:515] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.068041  5508 raft_consensus.cc:359] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.068789  5508 raft_consensus.cc:740] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.069090  5318 leader_election.cc:290] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 election: Requested vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:43.069453  5508 consensus_queue.cc:260] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.070819  5559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
I20260709 13:12:43.070914  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7281a21402c24e61b74acfc1564a4c8a" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:43.071508  5508 ts_tablet_manager.cc:1434] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:43.071590  4853 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:43.072382  4975 leader_election.cc:343] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.072367  5508 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.096534  5508 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.097596  5508 tablet_bootstrap.cc:492] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.098287  5508 ts_tablet_manager.cc:1403] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:12:43.098497  4853 raft_consensus.cc:2468] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 3.
I20260709 13:12:43.099735  4972 leader_election.cc:304] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:43.100435  5318 raft_consensus.cc:2804] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.100868  5318 raft_consensus.cc:697] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:43.101344  5508 raft_consensus.cc:359] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.102080  5508 raft_consensus.cc:740] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.102169  5318 consensus_queue.cc:237] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.102921  5508 consensus_queue.cc:260] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.105023  5508 ts_tablet_manager.cc:1434] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:43.105773  5508 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.122177  5508 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.123142  5508 tablet_bootstrap.cc:492] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.123986  5508 ts_tablet_manager.cc:1403] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:12:43.123080  4684 catalog_manager.cc:5697] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 3, leader changed from f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 3 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.126593  5508 raft_consensus.cc:359] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.127297  5508 raft_consensus.cc:740] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.127983  5508 consensus_queue.cc:260] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.130481  5508 ts_tablet_manager.cc:1434] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:43.132234  5508 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.161566  5508 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.162235  5508 tablet_bootstrap.cc:492] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.162752  5508 ts_tablet_manager.cc:1403] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.002s
I20260709 13:12:43.164472  5508 raft_consensus.cc:359] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.164925  5508 raft_consensus.cc:740] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.165549  5508 consensus_queue.cc:260] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.167105  5508 ts_tablet_manager.cc:1434] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:43.167912  5508 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.181020  5508 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.181881  5508 tablet_bootstrap.cc:492] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.182605  5508 ts_tablet_manager.cc:1403] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:12:43.185253  5508 raft_consensus.cc:359] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.185864  5508 raft_consensus.cc:740] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.186561  5508 consensus_queue.cc:260] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.188545  5508 ts_tablet_manager.cc:1434] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:43.189502  5508 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.209465  5508 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.210186  5508 tablet_bootstrap.cc:492] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.210822  5508 ts_tablet_manager.cc:1403] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:12:43.212576  5508 raft_consensus.cc:359] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.213025  5508 raft_consensus.cc:740] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.213487  5508 consensus_queue.cc:260] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.215201  5508 ts_tablet_manager.cc:1434] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:43.216508  5508 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.244562  5508 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.245399  5508 tablet_bootstrap.cc:492] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.246021  5508 ts_tablet_manager.cc:1403] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.008s
I20260709 13:12:43.248526  5508 raft_consensus.cc:359] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.249168  5508 raft_consensus.cc:740] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.249848  5508 consensus_queue.cc:260] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.251552  5508 ts_tablet_manager.cc:1434] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:43.252449  5508 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.267124  5508 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.267894  5508 tablet_bootstrap.cc:492] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.268568  5508 ts_tablet_manager.cc:1403] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:12:43.271102  5508 raft_consensus.cc:359] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.271782  5508 raft_consensus.cc:740] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.272429  5508 consensus_queue.cc:260] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.274399  5508 ts_tablet_manager.cc:1434] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:43.275189  5508 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.290567  5553 raft_consensus.cc:3060] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.291281  5508 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=1 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.292150  5508 tablet_bootstrap.cc:492] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.292797  5508 ts_tablet_manager.cc:1403] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:12:43.294937  5508 raft_consensus.cc:359] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.295583  5508 raft_consensus.cc:740] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.296247  5508 consensus_queue.cc:260] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.297955  5508 ts_tablet_manager.cc:1434] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:43.298640  5508 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.302944  5555 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.315069  5508 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.315934  5508 tablet_bootstrap.cc:492] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.316991  5508 ts_tablet_manager.cc:1403] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:43.319532  5508 raft_consensus.cc:359] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.320063  5508 raft_consensus.cc:740] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.320719  5508 consensus_queue.cc:260] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.322618  5508 ts_tablet_manager.cc:1434] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:12:43.323439  5508 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.337741  5508 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.338639  5508 tablet_bootstrap.cc:492] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.339356  5508 ts_tablet_manager.cc:1403] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:12:43.341789  5508 raft_consensus.cc:359] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.342464  5508 raft_consensus.cc:740] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.343241  5508 consensus_queue.cc:260] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.345310  5508 ts_tablet_manager.cc:1434] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:43.346089  5508 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.361393  5508 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.362341  5508 tablet_bootstrap.cc:492] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.363240  5508 ts_tablet_manager.cc:1403] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.003s
I20260709 13:12:43.364825  5555 raft_consensus.cc:3060] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.365978  5508 raft_consensus.cc:359] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.366762  5508 raft_consensus.cc:740] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.367451  5508 consensus_queue.cc:260] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.369686  5508 ts_tablet_manager.cc:1434] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:43.370905  5508 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.399281  5508 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.400305  5508 tablet_bootstrap.cc:492] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.401834  5508 ts_tablet_manager.cc:1403] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:12:43.404726  5508 raft_consensus.cc:359] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.405443  5508 raft_consensus.cc:740] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.406119  5508 consensus_queue.cc:260] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.407847  5508 ts_tablet_manager.cc:1434] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:12:43.408727  5508 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.444664  5555 raft_consensus.cc:3060] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.482208  5508 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.483527  5508 tablet_bootstrap.cc:492] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.484417  5508 ts_tablet_manager.cc:1403] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.032s
I20260709 13:12:43.487056  5508 raft_consensus.cc:359] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.487703  5508 raft_consensus.cc:740] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.488361  5508 consensus_queue.cc:260] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.490391  5508 ts_tablet_manager.cc:1434] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:43.491314  5508 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.507885  5508 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.508813  5508 tablet_bootstrap.cc:492] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.509455  5508 ts_tablet_manager.cc:1403] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:12:43.512035  5508 raft_consensus.cc:359] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.512689  5508 raft_consensus.cc:740] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.513336  5508 consensus_queue.cc:260] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.515480  5508 ts_tablet_manager.cc:1434] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:43.516103  4853 raft_consensus.cc:1275] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:43.516770  5508 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.517308  5662 consensus_queue.cc:1048] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:43.548251  5508 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.549518  5508 tablet_bootstrap.cc:492] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.550329  5508 ts_tablet_manager.cc:1403] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 13:12:43.552940  5508 raft_consensus.cc:359] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.553622  5508 raft_consensus.cc:740] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.554282  5508 consensus_queue.cc:260] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
W20260709 13:12:43.555100  4975 consensus_peers.cc:597] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.563741  5508 ts_tablet_manager.cc:1434] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:43.564673  5508 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.580142  5508 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.581017  5508 tablet_bootstrap.cc:492] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.581640  5508 ts_tablet_manager.cc:1403] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 13:12:43.584069  5508 raft_consensus.cc:359] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.584532  5508 raft_consensus.cc:740] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.585120  5508 consensus_queue.cc:260] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:43.586894  5508 ts_tablet_manager.cc:1434] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:43.587821  5508 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.600829  5508 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.601545  5508 tablet_bootstrap.cc:492] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.602087  5508 ts_tablet_manager.cc:1403] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:12:43.604177  5508 raft_consensus.cc:359] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.604851  5508 raft_consensus.cc:740] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.605459  5508 consensus_queue.cc:260] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.607894  5508 ts_tablet_manager.cc:1434] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:43.608664  5508 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.631851  5508 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.632786  5508 tablet_bootstrap.cc:492] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.633383  5508 ts_tablet_manager.cc:1403] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:12:43.635857  5508 raft_consensus.cc:359] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.636346  5508 raft_consensus.cc:740] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.636863  5508 consensus_queue.cc:260] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:43.638612  5508 ts_tablet_manager.cc:1434] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260709 13:12:43.639782  5508 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap starting.
I20260709 13:12:43.654019  5508 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.655441  5508 tablet_bootstrap.cc:492] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Bootstrap complete.
I20260709 13:12:43.656196  5508 ts_tablet_manager.cc:1403] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:12:43.658962  5508 raft_consensus.cc:359] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.659723  5508 raft_consensus.cc:740] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.660818  5508 consensus_queue.cc:260] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:43.662894  5508 ts_tablet_manager.cc:1434] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:43.702813  5555 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.769712  5555 raft_consensus.cc:3060] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.864594  5555 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:43.904393  5559 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.120378  5559 raft_consensus.cc:3060] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.139675  5559 raft_consensus.cc:3060] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.763419 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.819075  4857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:50.820091  4857 raft_consensus.cc:606] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:50.823861  4857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f58579d1984a7490486826d572a5c8"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:50.824442  4857 raft_consensus.cc:606] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:50.845597  4931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51025d71068843cfb90078f0d937070d"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:50.846202  4931 raft_consensus.cc:606] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Received request to transfer leadership to TS e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:50.850970  4857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:50.851552  4857 raft_consensus.cc:606] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:50.854468  4857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:50.855014  4857 raft_consensus.cc:606] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS e3b9d92f86c74ea0b6537c30a8846eab
I20260709 13:12:50.857491  4857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:50.858036  4857 raft_consensus.cc:606] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:50.859198 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:50.860868 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:50.887531  5765 raft_consensus.cc:993] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:50.888245  5762 raft_consensus.cc:1081] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:50.889778  5559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:50.890282  5559 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.890638  5559 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.898073  5559 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:50.900187  5559 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:50.901350  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:50.902164  4857 raft_consensus.cc:3055] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:50.902462  4857 raft_consensus.cc:740] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:50.903589  4857 consensus_queue.cc:260] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:50.904773  4857 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.909627  5765 raft_consensus.cc:993] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower e3b9d92f86c74ea0b6537c30a8846eab to start an election
I20260709 13:12:50.910171  5765 raft_consensus.cc:1081] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer e3b9d92f86c74ea0b6537c30a8846eab to start an election
I20260709 13:12:50.912148  5003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8"
dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
 from {username='slave'} at 127.0.0.1:43282
I20260709 13:12:50.912519  4857 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:50.912706  5003 raft_consensus.cc:493] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.913269  5003 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.913188  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103e2af53ccd444cac711b88eb93573f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:50.913940  5004 raft_consensus.cc:3060] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.914007  5502 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:50.915915  5769 raft_consensus.cc:2804] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:50.921926  5004 raft_consensus.cc:2468] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:50.921912  5003 raft_consensus.cc:515] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:50.925045  5003 leader_election.cc:290] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:50.926076  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:50.926762  4857 raft_consensus.cc:3055] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.927117  4857 raft_consensus.cc:740] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:50.927986  4857 consensus_queue.cc:260] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:50.929162  4857 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.935369  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2cac51497e440e9a975e6e0bd8efa8" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:50.935917  5769 raft_consensus.cc:697] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:50.936576  4857 raft_consensus.cc:2468] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:50.936065  4929 raft_consensus.cc:3060] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.937508  5769 consensus_queue.cc:237] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:50.937891  4972 leader_election.cc:304] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:50.939054  5758 raft_consensus.cc:2804] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.939539  5758 raft_consensus.cc:697] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:50.940544  5758 consensus_queue.cc:237] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:50.942256  4929 raft_consensus.cc:2468] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:50.954981  4680 catalog_manager.cc:5697] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.957803  4684 catalog_manager.cc:5697] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 2 to 3, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 3 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.029024  5760 raft_consensus.cc:993] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower e3b9d92f86c74ea0b6537c30a8846eab to start an election
I20260709 13:12:51.029620  5753 raft_consensus.cc:1081] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Signalling peer e3b9d92f86c74ea0b6537c30a8846eab to start an election
I20260709 13:12:51.031104  5004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51025d71068843cfb90078f0d937070d"
dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
 from {username='slave'} at 127.0.0.1:43284
I20260709 13:12:51.031567  5004 raft_consensus.cc:493] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.031859  5004 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.036633  5004 raft_consensus.cc:515] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:51.038375  5004 leader_election.cc:290] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:51.039094  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:51.039376  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:51.039744  4857 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.040004  4929 raft_consensus.cc:3055] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.040640  4929 raft_consensus.cc:740] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:51.041528  4929 consensus_queue.cc:260] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:51.043869  4929 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.048987  4857 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:51.052879  4972 leader_election.cc:304] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:51.053815  5758 raft_consensus.cc:2804] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.054347  5758 raft_consensus.cc:697] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Leader. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:51.055909  4929 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9d92f86c74ea0b6537c30a8846eab in term 2.
I20260709 13:12:51.057512  5758 consensus_queue.cc:237] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:51.060402  5765 raft_consensus.cc:993] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.061041  5762 raft_consensus.cc:1081] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.062733  5559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:51.063426  5559 raft_consensus.cc:493] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.064073  5559 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.072572  4684 catalog_manager.cc:5697] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab reported cstate change: term changed from 1 to 2, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4). New cstate: current_term: 2 leader_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.079412  5559 raft_consensus.cc:515] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.082501  5559 leader_election.cc:290] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:51.083575  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:51.084136  4857 raft_consensus.cc:3055] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.084471  4857 raft_consensus.cc:740] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:51.085273  4857 consensus_queue.cc:260] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.086354  4857 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.087947  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d44c39b62f14dfeb860991634e29c03" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:51.089027  5004 raft_consensus.cc:3060] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.097075  4857 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:51.098673  5502 leader_election.cc:304] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:51.102907  5769 raft_consensus.cc:2804] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.103399  5769 raft_consensus.cc:697] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:51.104266  5769 consensus_queue.cc:237] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.105712  5004 raft_consensus.cc:2468] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:51.120044  4684 catalog_manager.cc:5697] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.222527  5754 raft_consensus.cc:993] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.223064  5765 raft_consensus.cc:1081] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.224473  5559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f58579d1984a7490486826d572a5c8"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:51.224933  5559 raft_consensus.cc:493] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.225219  5559 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.230157  5559 raft_consensus.cc:515] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.232409  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:51.232849  5559 leader_election.cc:290] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:51.232978  5004 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.234503  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f58579d1984a7490486826d572a5c8" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:51.235100  4853 raft_consensus.cc:3055] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:51.235309  4853 raft_consensus.cc:740] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:51.236039  4853 consensus_queue.cc:260] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.236984  4853 raft_consensus.cc:3060] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.238914  5004 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:51.240092  5504 leader_election.cc:304] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:51.240964  5769 raft_consensus.cc:2804] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:51.241439  5769 raft_consensus.cc:697] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:51.242296  5769 consensus_queue.cc:237] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:51.242981  4853 raft_consensus.cc:2468] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:51.254307  4684 catalog_manager.cc:5697] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 2 to 3, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 3 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.281183  5762 raft_consensus.cc:993] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.281677  5765 raft_consensus.cc:1081] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:51.283185  5555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:51.283713  5555 raft_consensus.cc:493] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.284036  5555 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.291007  5555 raft_consensus.cc:515] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:51.292842  5555 leader_election.cc:290] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:51.294024  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:51.294054  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfd7218c035c4f08a2f3c9ae35ee1279" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:51.294793  4853 raft_consensus.cc:3055] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.294853  4929 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.295131  4853 raft_consensus.cc:740] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:51.295907  4853 consensus_queue.cc:260] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:51.296852  4853 raft_consensus.cc:3060] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.300025  4929 raft_consensus.cc:2468] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:51.301345  5503 leader_election.cc:304] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:51.302068  5769 raft_consensus.cc:2804] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.302202  4853 raft_consensus.cc:2468] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:51.302661  5769 raft_consensus.cc:697] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:51.304348  5769 consensus_queue.cc:237] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:51.313598  4684 catalog_manager.cc:5697] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.384790  4853 raft_consensus.cc:1275] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.386212  5769 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:51.401559  5004 raft_consensus.cc:1275] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.404888  5770 consensus_queue.cc:1048] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:51.424876  4929 raft_consensus.cc:1275] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.426349  5758 consensus_queue.cc:1048] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.444212  4931 raft_consensus.cc:1275] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.446123  5758 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.455765  4853 raft_consensus.cc:1275] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.457326  5758 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:51.461963  4853 raft_consensus.cc:1275] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer e3b9d92f86c74ea0b6537c30a8846eab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.464589  5755 consensus_queue.cc:1048] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:51.488667  4857 raft_consensus.cc:1275] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.490935  5769 consensus_queue.cc:1048] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.521049  5004 raft_consensus.cc:1275] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.522485  5769 consensus_queue.cc:1048] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.625553  4853 raft_consensus.cc:1275] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.626904  5769 consensus_queue.cc:1048] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:51.636061  5004 raft_consensus.cc:1275] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:51.637919  5769 consensus_queue.cc:1048] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:51.763749  4929 raft_consensus.cc:1275] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.764878  5769 consensus_queue.cc:1048] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.774549  4853 raft_consensus.cc:1275] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.776016  5770 consensus_queue.cc:1048] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.862032 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:51.904911 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:51.977486  5003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51025d71068843cfb90078f0d937070d"
dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
mode: GRACEFUL
new_leader_uuid: "7d069c6c6db44e9882ec432292c00563"
 from {username='slave'} at 127.0.0.1:52482
I20260709 13:12:51.978078  5003 raft_consensus.cc:606] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Received request to transfer leadership to TS 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:51.983511  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:51.984081  4853 raft_consensus.cc:606] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:51.986480  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:51.986959  4853 raft_consensus.cc:606] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:51.989019  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:51.989430  4853 raft_consensus.cc:606] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:51.991736  4929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:51.992261  4929 raft_consensus.cc:606] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:51.994597  5004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5"
dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52482
I20260709 13:12:51.995059  5004 raft_consensus.cc:606] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:51.996026 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:51.997342 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:52.002879  5765 raft_consensus.cc:993] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.003422  5754 raft_consensus.cc:1081] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.005017  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:52.005438  5553 raft_consensus.cc:493] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.005769  5553 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.017469  5553 raft_consensus.cc:515] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.020493  5788 raft_consensus.cc:993] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.020764  5553 leader_election.cc:290] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:52.021087  5795 raft_consensus.cc:1081] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.021713  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:52.022483  5004 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.022596  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:12:52.023166  5553 raft_consensus.cc:493] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.023737  5553 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.021878  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dde9a121e3b41e3afb39390e431154f" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:52.024932  4853 raft_consensus.cc:3055] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.025200  4853 raft_consensus.cc:740] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:52.025909  4853 consensus_queue.cc:260] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.026897  4853 raft_consensus.cc:3060] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.028627  5553 raft_consensus.cc:515] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.031070  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:52.031193  5553 leader_election.cc:290] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:52.031615  5003 raft_consensus.cc:3055] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.031772  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8903177763274513a4ded75b98ac1ea5" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:52.031957  5003 raft_consensus.cc:740] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:52.032320  4857 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.032866  5003 consensus_queue.cc:260] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.033762  5004 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.034186  5003 raft_consensus.cc:3060] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.034835  5504 leader_election.cc:304] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:52.035471  4853 raft_consensus.cc:2468] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.035720  5770 raft_consensus.cc:2804] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.036262  5770 raft_consensus.cc:697] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:52.037082  5770 consensus_queue.cc:237] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.038837  4857 raft_consensus.cc:2468] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:52.039950  5003 raft_consensus.cc:2468] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:52.040704  5502 leader_election.cc:304] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:52.041714  5769 raft_consensus.cc:2804] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.042225  5769 raft_consensus.cc:697] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:52.043303  5769 consensus_queue.cc:237] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.050487  4684 catalog_manager.cc:5697] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 2 to 3, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 3 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.067243  4684 catalog_manager.cc:5697] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.231487  5753 raft_consensus.cc:993] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.232028  5810 raft_consensus.cc:1081] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.234102  5555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52084
I20260709 13:12:52.234724  5555 raft_consensus.cc:493] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.235054  5555 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.239696  5555 raft_consensus.cc:515] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:52.241242  5555 leader_election.cc:290] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:52.241935  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:52.242578  4929 raft_consensus.cc:3055] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.242440  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c2fbed84cd431a80e4b6875377505a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:52.242954  4929 raft_consensus.cc:740] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:52.243132  5004 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.243757  4929 consensus_queue.cc:260] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:52.245026  4929 raft_consensus.cc:3060] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.251456  4929 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.251641  5004 raft_consensus.cc:2468] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.252678  5503 leader_election.cc:304] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:52.253582  5797 raft_consensus.cc:2804] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.254133  5797 raft_consensus.cc:697] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:52.255141  5797 consensus_queue.cc:237] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:52.264645  4684 catalog_manager.cc:5697] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 2 to 3, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 3 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.368822  5754 raft_consensus.cc:993] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.369270  5765 raft_consensus.cc:1081] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.370597  5555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:52.371002  5555 raft_consensus.cc:493] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.371230  5555 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.377547  5555 raft_consensus.cc:515] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:52.379750  5555 leader_election.cc:290] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:52.379959  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:52.380259  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c87c0a10ce45b48f3527e14aed165a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:52.380604  4857 raft_consensus.cc:3055] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.380872  4931 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.380966  4857 raft_consensus.cc:740] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:52.381835  4857 consensus_queue.cc:260] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:52.383059  4857 raft_consensus.cc:3060] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.386178  4931 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:52.387199  5503 leader_election.cc:304] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:52.387806  4857 raft_consensus.cc:2468] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:52.387856  5797 raft_consensus.cc:2804] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.388469  5797 raft_consensus.cc:697] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:52.389259  5797 consensus_queue.cc:237] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:52.397639  4684 catalog_manager.cc:5697] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.441586  5765 raft_consensus.cc:993] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.442368  5754 raft_consensus.cc:1081] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:52.445825  5555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:52.446345  5555 raft_consensus.cc:493] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.446636  5555 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.452013  5555 raft_consensus.cc:515] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.454170  5555 leader_election.cc:290] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:52.454723  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:52.455099  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e7df4527b14d3e9e9d026dca65d9b6" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:52.455456  5003 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.455756  4857 raft_consensus.cc:3055] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.456498  4857 raft_consensus.cc:740] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:52.457264  4857 consensus_queue.cc:260] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.458356  4857 raft_consensus.cc:3060] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.462158  5003 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.463255  5504 leader_election.cc:304] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:52.464067  4857 raft_consensus.cc:2468] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 3.
I20260709 13:12:52.464493  5797 raft_consensus.cc:2804] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.466857  5797 raft_consensus.cc:697] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:52.469237  5797 consensus_queue.cc:237] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:52.478209  4684 catalog_manager.cc:5697] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 2 to 3, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 3 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.496115  5795 raft_consensus.cc:993] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: : Instructing follower 7d069c6c6db44e9882ec432292c00563 to start an election
I20260709 13:12:52.496618  5788 raft_consensus.cc:1081] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Signalling peer 7d069c6c6db44e9882ec432292c00563 to start an election
I20260709 13:12:52.498034  4857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51025d71068843cfb90078f0d937070d"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
 from {username='slave'} at 127.0.0.1:42746
I20260709 13:12:52.498471  4857 raft_consensus.cc:493] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.498776  4857 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.503456  4857 raft_consensus.cc:515] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:52.505893  4857 leader_election.cc:290] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 3 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:52.506520  4929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:52.507004  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51025d71068843cfb90078f0d937070d" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:52.507143  4929 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.507586  5003 raft_consensus.cc:3055] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.507912  5003 raft_consensus.cc:740] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3b9d92f86c74ea0b6537c30a8846eab, State: Running, Role: LEADER
I20260709 13:12:52.508615  5003 consensus_queue.cc:260] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:52.509913  5003 raft_consensus.cc:3060] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.513718  4929 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 3.
I20260709 13:12:52.514917  4825 leader_election.cc:304] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, f0ebe0c3053f48d6852e07257efbf0f9; no voters: 
I20260709 13:12:52.515846  5003 raft_consensus.cc:2468] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 3.
I20260709 13:12:52.515936  5813 raft_consensus.cc:2804] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.516718  5813 raft_consensus.cc:697] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 3 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:52.517570  5813 consensus_queue.cc:237] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:52.527527  4684 catalog_manager.cc:5697] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 2 to 3, leader changed from e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 3 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.627004  4857 raft_consensus.cc:1275] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.628281  5797 consensus_queue.cc:1048] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.642925  5003 raft_consensus.cc:1275] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.647485  5818 consensus_queue.cc:1048] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:52.648321  4853 raft_consensus.cc:1275] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.648335  5003 raft_consensus.cc:1275] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.649682  5769 consensus_queue.cc:1048] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.652381  5769 consensus_queue.cc:1048] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:52.738457  5001 raft_consensus.cc:1275] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.739750  5769 consensus_queue.cc:1048] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.749253  4931 raft_consensus.cc:1275] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.750808  5797 consensus_queue.cc:1048] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.904006  5001 raft_consensus.cc:1275] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.905354  5797 consensus_queue.cc:1048] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.914660  4857 raft_consensus.cc:1275] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.916340  5818 consensus_queue.cc:1048] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.923344  4853 raft_consensus.cc:1275] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.925014  5818 consensus_queue.cc:1048] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.944262  4931 raft_consensus.cc:1275] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.945677  5818 consensus_queue.cc:1048] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.998826 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:53.051980  4931 raft_consensus.cc:1275] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:53.053561 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:53.056090  5754 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.075771  5001 raft_consensus.cc:1275] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:53.078969  5754 consensus_queue.cc:1048] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:53.108171  4931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44e3e883f43749a59653968b3183850e"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:53.108685  4931 raft_consensus.cc:606] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:53.111305  4853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:53.111867  4853 raft_consensus.cc:606] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:53.114506  4931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "7d069c6c6db44e9882ec432292c00563"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:53.115006  4931 raft_consensus.cc:606] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Received request to transfer leadership to TS 7d069c6c6db44e9882ec432292c00563
I20260709 13:12:53.117161  4931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:53.117586  4931 raft_consensus.cc:606] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:53.121701  4931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb"
dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:36416
I20260709 13:12:53.122344  4931 raft_consensus.cc:606] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:53.123562 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:53.125046 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:53.143784  5810 raft_consensus.cc:993] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.144294  5760 raft_consensus.cc:1081] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.145571  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52084
I20260709 13:12:53.145962  5553 raft_consensus.cc:493] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.146176  5553 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.152165  5553 raft_consensus.cc:515] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.153789  5553 leader_election.cc:290] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:53.154835  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:53.155535  5001 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.158490  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd270a9c7b814d829f34285ded0099eb" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:53.161273  5001 raft_consensus.cc:2468] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.161760  4931 raft_consensus.cc:3055] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.162168  4931 raft_consensus.cc:740] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:53.162494  5504 leader_election.cc:304] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:53.163123  4931 consensus_queue.cc:260] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.163468  5818 raft_consensus.cc:2804] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.164093  5818 raft_consensus.cc:697] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:53.164448  4931 raft_consensus.cc:3060] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.164922  5818 consensus_queue.cc:237] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.169934  4931 raft_consensus.cc:2468] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.173950  4681 catalog_manager.cc:5697] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.205138  5810 raft_consensus.cc:993] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower 7d069c6c6db44e9882ec432292c00563 to start an election
I20260709 13:12:53.205662  5760 raft_consensus.cc:1081] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Signalling peer 7d069c6c6db44e9882ec432292c00563 to start an election
I20260709 13:12:53.207017  4853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
 from {username='slave'} at 127.0.0.1:42716
I20260709 13:12:53.207511  4853 raft_consensus.cc:493] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.207849  4853 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.213394  4853 raft_consensus.cc:515] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:53.214774  4853 leader_election.cc:290] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:53.215519  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:53.215559  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ea7c05d7854df3bd11f18d32aed4e0" candidate_uuid: "7d069c6c6db44e9882ec432292c00563" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:53.216068  4931 raft_consensus.cc:3055] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.216212  5001 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.216360  4931 raft_consensus.cc:740] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:53.217409  4931 consensus_queue.cc:260] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:53.218724  4931 raft_consensus.cc:3060] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.222867  5001 raft_consensus.cc:2468] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:53.223973  4931 raft_consensus.cc:2468] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d069c6c6db44e9882ec432292c00563 in term 2.
I20260709 13:12:53.224021  4826 leader_election.cc:304] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d069c6c6db44e9882ec432292c00563, e3b9d92f86c74ea0b6537c30a8846eab; no voters: 
I20260709 13:12:53.225134  5765 raft_consensus.cc:2804] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.225564  5765 raft_consensus.cc:697] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Becoming Leader. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:53.226308  5765 consensus_queue.cc:237] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } }
I20260709 13:12:53.235567  4681 catalog_manager.cc:5697] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 reported cstate change: term changed from 1 to 2, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to 7d069c6c6db44e9882ec432292c00563 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "7d069c6c6db44e9882ec432292c00563" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.295059  5765 raft_consensus.cc:993] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.295553  5754 raft_consensus.cc:1081] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.297435  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:53.297931  5553 raft_consensus.cc:493] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.298223  5553 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.303021  5553 raft_consensus.cc:515] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:53.304718  5553 leader_election.cc:290] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:53.305986  4853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:53.306573  4853 raft_consensus.cc:3055] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.306902  4853 raft_consensus.cc:740] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:53.307077  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52544a98965242fcad8616ff2cc4dc8a" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:53.307723  5001 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.307619  4853 consensus_queue.cc:260] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:53.308961  4853 raft_consensus.cc:3060] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.313139  5001 raft_consensus.cc:2468] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.313654  4853 raft_consensus.cc:2468] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.314250  5504 leader_election.cc:304] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:53.315188  5818 raft_consensus.cc:2804] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.315665  5818 raft_consensus.cc:697] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:53.316506  5818 consensus_queue.cc:237] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:53.326807  4681 catalog_manager.cc:5697] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.476779  5760 raft_consensus.cc:993] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.477240  5810 raft_consensus.cc:1081] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.478775  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52084
I20260709 13:12:53.479194  5553 raft_consensus.cc:493] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.479416  5553 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.484194  5553 raft_consensus.cc:515] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.485769  5553 leader_election.cc:290] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:53.486454  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:53.487097  4935 raft_consensus.cc:3055] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.487140  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd842ad26db48e1aa55713f47a1fe66" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:53.487478  4935 raft_consensus.cc:740] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:53.487833  5003 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.488250  4935 consensus_queue.cc:260] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.489584  4935 raft_consensus.cc:3060] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.494398  5760 raft_consensus.cc:993] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.494916  5760 raft_consensus.cc:1081] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:53.495922  4935 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.496405  5553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44e3e883f43749a59653968b3183850e"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52084
I20260709 13:12:53.496959  5553 raft_consensus.cc:493] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.497385  5553 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.497331  5503 leader_election.cc:304] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:53.497288  5003 raft_consensus.cc:2468] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.499437  5769 raft_consensus.cc:2804] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.499938  5769 raft_consensus.cc:697] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:53.500768  5769 consensus_queue.cc:237] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.503933  5553 raft_consensus.cc:515] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.505913  5553 leader_election.cc:290] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787), e3b9d92f86c74ea0b6537c30a8846eab (127.28.152.4:34929)
I20260709 13:12:53.508991  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:53.509625  4931 raft_consensus.cc:3055] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.509716  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3e883f43749a59653968b3183850e" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3b9d92f86c74ea0b6537c30a8846eab"
I20260709 13:12:53.509956  4931 raft_consensus.cc:740] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0ebe0c3053f48d6852e07257efbf0f9, State: Running, Role: LEADER
I20260709 13:12:53.510409  5001 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.510980  4931 consensus_queue.cc:260] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.512310  4931 raft_consensus.cc:3060] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.517575  5001 raft_consensus.cc:2468] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.518056  4931 raft_consensus.cc:2468] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:53.518955  5504 leader_election.cc:304] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:53.520128  5769 raft_consensus.cc:2804] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.520733  5769 raft_consensus.cc:697] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:53.520159  4681 catalog_manager.cc:5697] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.521872  5769 consensus_queue.cc:237] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } }
I20260709 13:12:53.537164  4681 catalog_manager.cc:5697] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.658250  5003 raft_consensus.cc:1275] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.659767  5769 consensus_queue.cc:1048] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.671926  4931 raft_consensus.cc:1275] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.673583  5797 consensus_queue.cc:1048] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.709517  4861 raft_consensus.cc:1275] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.710629  5769 consensus_queue.cc:1048] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.712608  5003 raft_consensus.cc:1275] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.713868  5765 consensus_queue.cc:1048] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:53.735301  4931 raft_consensus.cc:1275] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer 7d069c6c6db44e9882ec432292c00563: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.735853  5003 raft_consensus.cc:1275] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.737002  5754 consensus_queue.cc:1048] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.738768  5818 consensus_queue.cc:1048] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:53.910856  5004 raft_consensus.cc:1275] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.912235  5818 consensus_queue.cc:1048] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.925557  4931 raft_consensus.cc:1275] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.927285  5854 consensus_queue.cc:1048] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.036502  4929 raft_consensus.cc:1275] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.037801  5854 consensus_queue.cc:1048] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.053407  5003 raft_consensus.cc:1275] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.059979  5818 consensus_queue.cc:1048] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.125923 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:54.167208 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:54.202185  4861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34"
dest_uuid: "7d069c6c6db44e9882ec432292c00563"
mode: GRACEFUL
new_leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:48464
I20260709 13:12:54.202741  4861 raft_consensus.cc:606] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Received request to transfer leadership to TS f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:54.203926 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:12:54.205160 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:54.290138  5754 raft_consensus.cc:993] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: : Instructing follower f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:54.290706  5832 raft_consensus.cc:1081] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Signalling peer f6c95e5d9485488f9de4ffe24035c81d to start an election
I20260709 13:12:54.292109  5555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34"
dest_uuid: "f6c95e5d9485488f9de4ffe24035c81d"
 from {username='slave'} at 127.0.0.1:52074
I20260709 13:12:54.292562  5555 raft_consensus.cc:493] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.292876  5555 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.297643  5555 raft_consensus.cc:515] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:54.299075  5555 leader_election.cc:290] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Requested vote from peers 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901), f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787)
I20260709 13:12:54.299868  4857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d069c6c6db44e9882ec432292c00563"
I20260709 13:12:54.300021  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed486b7fc9ef4feca3baf9633a218b34" candidate_uuid: "f6c95e5d9485488f9de4ffe24035c81d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0ebe0c3053f48d6852e07257efbf0f9"
I20260709 13:12:54.300457  4857 raft_consensus.cc:3055] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:54.300669  4931 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.300815  4857 raft_consensus.cc:740] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d069c6c6db44e9882ec432292c00563, State: Running, Role: LEADER
I20260709 13:12:54.301712  4857 consensus_queue.cc:260] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:54.302520  4857 raft_consensus.cc:3060] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.307482  4931 raft_consensus.cc:2468] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:54.309036  5503 leader_election.cc:304] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0ebe0c3053f48d6852e07257efbf0f9, f6c95e5d9485488f9de4ffe24035c81d; no voters: 
I20260709 13:12:54.309851  5854 raft_consensus.cc:2804] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:54.310336  5854 raft_consensus.cc:697] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Becoming Leader. State: Replica: f6c95e5d9485488f9de4ffe24035c81d, State: Running, Role: LEADER
I20260709 13:12:54.311440  5854 consensus_queue.cc:237] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } }
I20260709 13:12:54.311996  4857 raft_consensus.cc:2468] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c95e5d9485488f9de4ffe24035c81d in term 2.
I20260709 13:12:54.321383  4684 catalog_manager.cc:5697] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d reported cstate change: term changed from 1 to 2, leader changed from 7d069c6c6db44e9882ec432292c00563 (127.28.152.2) to f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "f6c95e5d9485488f9de4ffe24035c81d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.869282  4857 raft_consensus.cc:1275] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.870466  5854 consensus_queue.cc:1048] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.891156  4931 raft_consensus.cc:1275] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Refusing update from remote peer f6c95e5d9485488f9de4ffe24035c81d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.896059  5854 consensus_queue.cc:1048] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ebe0c3053f48d6852e07257efbf0f9" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:55.206079 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:55.243814 29280 tablet_server.cc:179] TabletServer@127.28.152.1:33395 shutting down...
W20260709 13:12:55.248531  4901 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 91 similar messages]
W20260709 13:12:55.253705  4901 consensus_peers.cc:597] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.286206  4827 consensus_peers.cc:597] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.292179 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:55.292951 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.293619 29280 raft_consensus.cc:2243] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.294232 29280 raft_consensus.cc:2272] T b4e66b31d7944054bde6909f874d9531 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.297359 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.298332 29280 raft_consensus.cc:2243] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:12:55.298578  4827 consensus_peers.cc:597] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.299377 29280 raft_consensus.cc:2272] T 81c2fbed84cd431a80e4b6875377505a P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.302392 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.303380 29280 raft_consensus.cc:2243] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.303925 29280 raft_consensus.cc:2272] T e90059dfb0354efcbdf13a0b245cefb3 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.306203 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.306902 29280 raft_consensus.cc:2243] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.307448 29280 raft_consensus.cc:2272] T 7281a21402c24e61b74acfc1564a4c8a P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.309506  4975 consensus_peers.cc:597] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.310171 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.310976 29280 raft_consensus.cc:2243] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.311335 29280 raft_consensus.cc:2272] T 0b5a1385cb5e4ceea7a319f6861603a7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.313398 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.313941 29280 raft_consensus.cc:2243] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.314361 29280 raft_consensus.cc:2272] T 339747664ecc489f95b3d04d961ac367 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.316460 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.317126 29280 raft_consensus.cc:2243] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.318094 29280 raft_consensus.cc:2272] T dd270a9c7b814d829f34285ded0099eb P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.320291 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.320972 29280 raft_consensus.cc:2243] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.321462 29280 raft_consensus.cc:2272] T ccd276985af7409ea9d00bf0d850b3b2 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.324311 29280 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:55.324229  4827 consensus_peers.cc:597] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.325210 29280 raft_consensus.cc:2243] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.325671 29280 raft_consensus.cc:2272] T 102e1754129b4dea9a2dab06dbab54c6 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.328620 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.329403 29280 raft_consensus.cc:2243] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.330377 29280 raft_consensus.cc:2272] T dfd7218c035c4f08a2f3c9ae35ee1279 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.332049  4975 consensus_peers.cc:597] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.333461 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.334404 29280 raft_consensus.cc:2243] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.334893 29280 raft_consensus.cc:2272] T 8ce5374ea4094a1da56f0705db711237 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.337929 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.338784 29280 raft_consensus.cc:2243] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.339704 29280 raft_consensus.cc:2272] T abd842ad26db48e1aa55713f47a1fe66 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.341027  4827 consensus_peers.cc:597] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.342747 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.343665 29280 raft_consensus.cc:2243] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.344192 29280 raft_consensus.cc:2272] T 57c70fd50ee1480c93f859973675ed01 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.346477 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.346993 29280 raft_consensus.cc:2243] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.347795 29280 raft_consensus.cc:2272] T 77c87c0a10ce45b48f3527e14aed165a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.350646 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.351433 29280 raft_consensus.cc:2243] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.352064 29280 raft_consensus.cc:2272] T 30ffeaaf1e8242629b324e7fda7bb872 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.354530 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.355317 29280 raft_consensus.cc:2243] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.355890 29280 raft_consensus.cc:2272] T e325c8dae3b241c0b43a7b965cac7191 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.358685 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.359368 29280 raft_consensus.cc:2243] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.359784 29280 raft_consensus.cc:2272] T af9dc48f4b54413583c9249d86ec89af P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.361966 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.362691 29280 raft_consensus.cc:2243] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.363242 29280 raft_consensus.cc:2272] T 94a86b4bab4f4187a53108485c2ad257 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.366065 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.366875 29280 raft_consensus.cc:2243] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.367280 29280 raft_consensus.cc:2272] T cf96d3b028bf425fa8ef6948ef4d699a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.369596 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.370106 29280 raft_consensus.cc:2243] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.370581 29280 raft_consensus.cc:2272] T e023474754444ca7835a8410266d6d7b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.370846  4901 consensus_peers.cc:597] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.371517  4901 consensus_peers.cc:597] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.373023 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.373673 29280 raft_consensus.cc:2243] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.374429 29280 raft_consensus.cc:2272] T ed486b7fc9ef4feca3baf9633a218b34 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.376767 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.377305 29280 raft_consensus.cc:2243] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.377696 29280 raft_consensus.cc:2272] T 62609ec3ccb34bd699d9ec237ef73fc7 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.379901 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.380520 29280 raft_consensus.cc:2243] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.381305 29280 raft_consensus.cc:2272] T 7d44c39b62f14dfeb860991634e29c03 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.384202 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.384932 29280 raft_consensus.cc:2243] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.385905 29280 raft_consensus.cc:2272] T 52544a98965242fcad8616ff2cc4dc8a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.389101 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.389816 29280 raft_consensus.cc:2243] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.390321 29280 raft_consensus.cc:2272] T dbaafca747714377b26752357eb9c97b P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.390801  4975 consensus_peers.cc:597] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.392553 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.393157 29280 raft_consensus.cc:2243] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.393812 29280 raft_consensus.cc:2272] T 44e3e883f43749a59653968b3183850e P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.396039 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.396874 29280 raft_consensus.cc:2243] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.397754 29280 raft_consensus.cc:2272] T 103e2af53ccd444cac711b88eb93573f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.400135 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.400869 29280 raft_consensus.cc:2243] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.401585 29280 raft_consensus.cc:2272] T 8903177763274513a4ded75b98ac1ea5 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.404244 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.405095 29280 raft_consensus.cc:2243] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.405588 29280 raft_consensus.cc:2272] T 0a97f5da08f0457389cd2720c8c64d6d P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.407671 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.408308 29280 raft_consensus.cc:2243] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.408664 29280 raft_consensus.cc:2272] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.411386 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.412099 29280 raft_consensus.cc:2243] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.412443 29280 raft_consensus.cc:2272] T 3481089e907345869da25ad79e97a113 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.414847 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.415539 29280 raft_consensus.cc:2243] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.416038 29280 raft_consensus.cc:2272] T 296e8f525bb74ec48853794077e3bddf P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.419000 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.419874 29280 raft_consensus.cc:2243] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.420418 29280 raft_consensus.cc:2272] T a3bb45754e1f48068c332ed71e97ad32 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.423345 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.424098 29280 raft_consensus.cc:2243] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.424582 29280 raft_consensus.cc:2272] T a83e926be0c443dbadd95607ab1d8979 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.426769 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.427444 29280 raft_consensus.cc:2243] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.428310 29280 raft_consensus.cc:2272] T 7dde9a121e3b41e3afb39390e431154f P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.430814 29280 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:55.431015  4975 consensus_peers.cc:597] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.431424 29280 raft_consensus.cc:2243] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.431917 29280 raft_consensus.cc:2272] T 2b456ffffa884668a41f15046cec623b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.433945 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.434523 29280 raft_consensus.cc:2243] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.434938 29280 raft_consensus.cc:2272] T ef15cbb1e0264e3fae50d98caeaed84a P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.436911 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.437466 29280 raft_consensus.cc:2243] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.437906 29280 raft_consensus.cc:2272] T 8eb1376921f9451bbafdf0355341d793 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.439838 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.440407 29280 raft_consensus.cc:2243] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.440805 29280 raft_consensus.cc:2272] T 95c66086fcb84985afe1bf786ed3726e P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.442896 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.443475 29280 raft_consensus.cc:2243] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.443877 29280 raft_consensus.cc:2272] T 92327700b56842d580bb260af45dad1b P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.445938 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.446585 29280 raft_consensus.cc:2243] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.447078 29280 raft_consensus.cc:2272] T e29c0f2d503146f6b27e75a54137a273 P f6c95e5d9485488f9de4ffe24035c81d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.449704 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.450433 29280 raft_consensus.cc:2243] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:55.450839  4975 consensus_peers.cc:597] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.451020 29280 raft_consensus.cc:2272] T 5fc863e914714666afa0468d30e21e3a P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.453261 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.453831 29280 raft_consensus.cc:2243] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.454648 29280 raft_consensus.cc:2272] T 16f58579d1984a7490486826d572a5c8 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.456875 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.457422 29280 raft_consensus.cc:2243] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.457959 29280 raft_consensus.cc:2272] T e56552e1ca874e52bfef190ac96a1740 P f6c95e5d9485488f9de4ffe24035c81d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.460208 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:55.460731 29280 raft_consensus.cc:2243] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.461480 29280 raft_consensus.cc:2272] T 65e7df4527b14d3e9e9d026dca65d9b6 P f6c95e5d9485488f9de4ffe24035c81d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.478467  4901 consensus_peers.cc:597] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.487852  4901 consensus_peers.cc:597] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.509958  4827 consensus_peers.cc:597] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.519587  4901 connection.cc:769] client connection to 127.28.152.1:33395 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:12:55.520702  4901 consensus_peers.cc:597] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.528218 29280 tablet_server.cc:196] TabletServer@127.28.152.1:33395 shutdown complete.
W20260709 13:12:55.528539  4901 consensus_peers.cc:597] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.529934  4827 consensus_peers.cc:597] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.546414  4827 consensus_peers.cc:597] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.556491  4975 consensus_peers.cc:597] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.562466  4827 consensus_peers.cc:597] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.590895  4975 consensus_peers.cc:597] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.609519  4901 consensus_peers.cc:597] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.616626 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
W20260709 13:12:55.629457  4901 consensus_peers.cc:597] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.655606  4975 consensus_peers.cc:597] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.658572  4972 consensus_peers.cc:597] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.659556  4898 consensus_peers.cc:597] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.659997 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:55.660759 29280 tablet_replica.cc:333] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.661387 29280 raft_consensus.cc:2243] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.661937 29280 raft_consensus.cc:2272] T 9388dee194834b479a120a34a1460d47 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.664665 29280 tablet_replica.cc:333] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.665372 29280 raft_consensus.cc:2243] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.665776 29280 raft_consensus.cc:2272] T 937c0a0afa904d0ba5e441074701b4d8 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.668292 29280 tablet_replica.cc:333] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.669296 29280 raft_consensus.cc:2243] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.669817 29280 raft_consensus.cc:2272] T d34da2d7f05c4d8abebd5e99d71cf8c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.670622  4827 consensus_peers.cc:597] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.672158 29280 tablet_replica.cc:333] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.672811 29280 raft_consensus.cc:2243] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.673241 29280 raft_consensus.cc:2272] T e29c0f2d503146f6b27e75a54137a273 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.675242 29280 tablet_replica.cc:333] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.675814 29280 raft_consensus.cc:2243] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.676199 29280 raft_consensus.cc:2272] T ed486b7fc9ef4feca3baf9633a218b34 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.678433 29280 tablet_replica.cc:333] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.679060 29280 raft_consensus.cc:2243] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.679464 29280 raft_consensus.cc:2272] T e023474754444ca7835a8410266d6d7b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.682049 29280 tablet_replica.cc:333] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.682862 29280 raft_consensus.cc:2243] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.683701 29280 raft_consensus.cc:2272] T 51025d71068843cfb90078f0d937070d P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.685762 29280 tablet_replica.cc:333] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.686283 29280 raft_consensus.cc:2243] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:55.686295  4975 consensus_peers.cc:597] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.686822 29280 raft_consensus.cc:2272] T eaa38c5ee7284bf6a4390de9a0f8ea74 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.688832 29280 tablet_replica.cc:333] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.689394 29280 raft_consensus.cc:2243] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.690132 29280 raft_consensus.cc:2272] T 0a97f5da08f0457389cd2720c8c64d6d P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.692232 29280 tablet_replica.cc:333] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.692848 29280 raft_consensus.cc:2243] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.693699 29280 raft_consensus.cc:2272] T ef15cbb1e0264e3fae50d98caeaed84a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.694875  4898 consensus_peers.cc:597] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.696166 29280 tablet_replica.cc:333] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.697127 29280 raft_consensus.cc:2243] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.697544 29280 raft_consensus.cc:2272] T 7dde9a121e3b41e3afb39390e431154f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.699782 29280 tablet_replica.cc:333] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.700302 29280 raft_consensus.cc:2243] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.700732 29280 raft_consensus.cc:2272] T a83e926be0c443dbadd95607ab1d8979 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.702548 29280 tablet_replica.cc:333] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.703142 29280 raft_consensus.cc:2243] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.704111 29280 raft_consensus.cc:2272] T 339747664ecc489f95b3d04d961ac367 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.706454 29280 tablet_replica.cc:333] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.707132 29280 raft_consensus.cc:2243] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.707871 29280 raft_consensus.cc:2272] T feb6150ed16c4b01b553aeed27359f05 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.710050 29280 tablet_replica.cc:333] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.710649 29280 raft_consensus.cc:2243] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.711434 29280 raft_consensus.cc:2272] T a2ea7c05d7854df3bd11f18d32aed4e0 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.712530  4901 consensus_peers.cc:597] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.713985 29280 tablet_replica.cc:333] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.714906 29280 raft_consensus.cc:2243] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.715375 29280 raft_consensus.cc:2272] T 7d44c39b62f14dfeb860991634e29c03 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.717311  4972 consensus_peers.cc:597] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.718116 29280 tablet_replica.cc:333] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.719009 29280 raft_consensus.cc:2243] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.719517 29280 raft_consensus.cc:2272] T 8903177763274513a4ded75b98ac1ea5 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.719725  4972 consensus_peers.cc:597] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.721698  4975 consensus_peers.cc:597] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.721789 29280 tablet_replica.cc:333] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.722568 29280 raft_consensus.cc:2243] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.723116 29280 raft_consensus.cc:2272] T 7281a21402c24e61b74acfc1564a4c8a P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.724323  4975 consensus_peers.cc:597] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.725710 29280 tablet_replica.cc:333] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.726922 29280 raft_consensus.cc:2243] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.727558 29280 raft_consensus.cc:2272] T 0b5a1385cb5e4ceea7a319f6861603a7 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.730540  4972 consensus_peers.cc:597] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.731379 29280 tablet_replica.cc:333] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.732550 29280 raft_consensus.cc:2243] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.733302 29280 raft_consensus.cc:2272] T 91c40c4ad6094ad0a5be7f2f349a9d29 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.737109 29280 tablet_replica.cc:333] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.737979 29280 raft_consensus.cc:2243] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.739043 29280 raft_consensus.cc:2272] T cf96d3b028bf425fa8ef6948ef4d699a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.741880 29280 tablet_replica.cc:333] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.742458 29280 raft_consensus.cc:2243] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.743023 29280 raft_consensus.cc:2272] T af9dc48f4b54413583c9249d86ec89af P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.745893 29280 tablet_replica.cc:333] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.746542 29280 raft_consensus.cc:2243] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.747658 29280 raft_consensus.cc:2272] T 3b56e2153ec4421281afc2150b970668 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.748131  4975 consensus_peers.cc:597] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Couldn't send request to peer f6c95e5d9485488f9de4ffe24035c81d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.749694 29280 tablet_replica.cc:333] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.750303 29280 raft_consensus.cc:2243] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.751096 29280 raft_consensus.cc:2272] T 102e1754129b4dea9a2dab06dbab54c6 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.753014 29280 tablet_replica.cc:333] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.753578 29280 raft_consensus.cc:2243] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.753928 29280 raft_consensus.cc:2272] T 65e7df4527b14d3e9e9d026dca65d9b6 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.755681 29280 tablet_replica.cc:333] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.756186 29280 raft_consensus.cc:2243] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.756531 29280 raft_consensus.cc:2272] T 103e2af53ccd444cac711b88eb93573f P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.758232 29280 tablet_replica.cc:333] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.758772 29280 raft_consensus.cc:2243] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.759135 29280 raft_consensus.cc:2272] T 4b0d8d1af32d4333bfb27a527def8b9c P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.761183 29280 tablet_replica.cc:333] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.761700 29280 raft_consensus.cc:2243] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.762048 29280 raft_consensus.cc:2272] T 52544a98965242fcad8616ff2cc4dc8a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.763999 29280 tablet_replica.cc:333] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.764712 29280 raft_consensus.cc:2243] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.765158 29280 raft_consensus.cc:2272] T b4e66b31d7944054bde6909f874d9531 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.767355 29280 tablet_replica.cc:333] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
W20260709 13:12:55.767695  4898 consensus_peers.cc:597] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.767918 29280 raft_consensus.cc:2243] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.768798 29280 raft_consensus.cc:2272] T 296e8f525bb74ec48853794077e3bddf P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.770742 29280 tablet_replica.cc:333] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.771346 29280 raft_consensus.cc:2243] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.771822 29280 raft_consensus.cc:2272] T 6936f88d50994becb09fad0cbb8de81a P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.773830 29280 tablet_replica.cc:333] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.774379 29280 raft_consensus.cc:2243] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.774806 29280 raft_consensus.cc:2272] T cd2cac51497e440e9a975e6e0bd8efa8 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.776577 29280 tablet_replica.cc:333] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.777107 29280 raft_consensus.cc:2243] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.777875 29280 raft_consensus.cc:2272] T 95057452fb6c47048344f8f068d7c0d1 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.779873 29280 tablet_replica.cc:333] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.780413 29280 raft_consensus.cc:2243] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.781195 29280 raft_consensus.cc:2272] T 3481089e907345869da25ad79e97a113 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.783232 29280 tablet_replica.cc:333] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.783757 29280 raft_consensus.cc:2243] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.784154 29280 raft_consensus.cc:2272] T e56552e1ca874e52bfef190ac96a1740 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.785961 29280 tablet_replica.cc:333] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.786458 29280 raft_consensus.cc:2243] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.787443 29280 raft_consensus.cc:2272] T 63b20012ccf24e2394387d169d9c75fe P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.789433 29280 tablet_replica.cc:333] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.790057 29280 raft_consensus.cc:2243] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.790464 29280 raft_consensus.cc:2272] T 16f58579d1984a7490486826d572a5c8 P 7d069c6c6db44e9882ec432292c00563 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.792150 29280 tablet_replica.cc:333] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.792657 29280 raft_consensus.cc:2243] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.793044 29280 raft_consensus.cc:2272] T dfd7218c035c4f08a2f3c9ae35ee1279 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.794840 29280 tablet_replica.cc:333] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.795316 29280 raft_consensus.cc:2243] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.796043 29280 raft_consensus.cc:2272] T 30ffeaaf1e8242629b324e7fda7bb872 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.798415 29280 tablet_replica.cc:333] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.799162 29280 raft_consensus.cc:2243] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.799707 29280 raft_consensus.cc:2272] T 92327700b56842d580bb260af45dad1b P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.800438  4972 consensus_peers.cc:597] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.801755 29280 tablet_replica.cc:333] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.802459 29280 raft_consensus.cc:2243] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.803388 29280 raft_consensus.cc:2272] T 8eb1376921f9451bbafdf0355341d793 P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.805855 29280 tablet_replica.cc:333] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.806303 29280 raft_consensus.cc:2243] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.806653 29280 raft_consensus.cc:2272] T c88dea137c8e49a484a715cf7078e4c2 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.808512 29280 tablet_replica.cc:333] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.809022 29280 raft_consensus.cc:2243] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.809434 29280 raft_consensus.cc:2272] T 8ce5374ea4094a1da56f0705db711237 P 7d069c6c6db44e9882ec432292c00563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.811441 29280 tablet_replica.cc:333] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563: stopping tablet replica
I20260709 13:12:55.811895 29280 raft_consensus.cc:2243] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.812297 29280 raft_consensus.cc:2272] T 77c87c0a10ce45b48f3527e14aed165a P 7d069c6c6db44e9882ec432292c00563 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:55.827678  4972 consensus_peers.cc:597] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.884310 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
W20260709 13:12:55.896533  4972 consensus_peers.cc:597] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.897195  4972 consensus_peers.cc:597] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.908922  4898 consensus_peers.cc:597] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.960417  4898 consensus_peers.cc:597] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.969509 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
W20260709 13:12:55.981710  4898 consensus_peers.cc:597] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.003842  4898 consensus_peers.cc:597] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.011082  4973 consensus_peers.cc:597] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.017602  4898 consensus_peers.cc:597] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.021930  4972 consensus_peers.cc:597] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Couldn't send request to peer 7d069c6c6db44e9882ec432292c00563. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.023066 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:56.024813 29280 tablet_replica.cc:333] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.026013 29280 raft_consensus.cc:2243] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.026661 29280 raft_consensus.cc:2272] T 81c2fbed84cd431a80e4b6875377505a P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.029350 29280 tablet_replica.cc:333] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.029987 29280 raft_consensus.cc:2243] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.030843 29280 raft_consensus.cc:2272] T 9388dee194834b479a120a34a1460d47 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.032728 29280 tablet_replica.cc:333] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.033249 29280 raft_consensus.cc:2243] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.033943 29280 raft_consensus.cc:2272] T e90059dfb0354efcbdf13a0b245cefb3 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.035807 29280 tablet_replica.cc:333] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.036299 29280 raft_consensus.cc:2243] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.036952 29280 raft_consensus.cc:2272] T d34da2d7f05c4d8abebd5e99d71cf8c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.038620 29280 tablet_replica.cc:333] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.039158 29280 raft_consensus.cc:2243] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.039855 29280 raft_consensus.cc:2272] T 2b456ffffa884668a41f15046cec623b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.041735 29280 tablet_replica.cc:333] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.042205 29280 raft_consensus.cc:2243] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.042548 29280 raft_consensus.cc:2272] T 63b20012ccf24e2394387d169d9c75fe P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.044368 29280 tablet_replica.cc:333] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.044878 29280 raft_consensus.cc:2243] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.045264 29280 raft_consensus.cc:2272] T ed486b7fc9ef4feca3baf9633a218b34 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.046998 29280 tablet_replica.cc:333] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.047608 29280 raft_consensus.cc:2243] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.048369 29280 raft_consensus.cc:2272] T e023474754444ca7835a8410266d6d7b P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.050233 29280 tablet_replica.cc:333] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.050925 29280 raft_consensus.cc:2243] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.051403 29280 raft_consensus.cc:2272] T 51025d71068843cfb90078f0d937070d P f0ebe0c3053f48d6852e07257efbf0f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.053848 29280 tablet_replica.cc:333] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.054567 29280 raft_consensus.cc:2243] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.055085 29280 raft_consensus.cc:2272] T 57c70fd50ee1480c93f859973675ed01 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.056960 29280 tablet_replica.cc:333] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.057551 29280 raft_consensus.cc:2243] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.058372 29280 raft_consensus.cc:2272] T eaa38c5ee7284bf6a4390de9a0f8ea74 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.060180 29280 tablet_replica.cc:333] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.060664 29280 raft_consensus.cc:2243] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.061007 29280 raft_consensus.cc:2272] T 0a97f5da08f0457389cd2720c8c64d6d P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.062846 29280 tablet_replica.cc:333] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.063341 29280 raft_consensus.cc:2243] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.063866 29280 raft_consensus.cc:2272] T ef15cbb1e0264e3fae50d98caeaed84a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.066306 29280 tablet_replica.cc:333] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.067059 29280 raft_consensus.cc:2243] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.067515 29280 raft_consensus.cc:2272] T feb6150ed16c4b01b553aeed27359f05 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.069563 29280 tablet_replica.cc:333] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.070108 29280 raft_consensus.cc:2243] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.070523 29280 raft_consensus.cc:2272] T cd2cac51497e440e9a975e6e0bd8efa8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.072299 29280 tablet_replica.cc:333] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.072885 29280 raft_consensus.cc:2243] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.073295 29280 raft_consensus.cc:2272] T cf96d3b028bf425fa8ef6948ef4d699a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.075095 29280 tablet_replica.cc:333] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.075585 29280 raft_consensus.cc:2243] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.076620 29280 raft_consensus.cc:2272] T 94a86b4bab4f4187a53108485c2ad257 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.078402 29280 tablet_replica.cc:333] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.078969 29280 raft_consensus.cc:2243] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.079766 29280 raft_consensus.cc:2272] T af9dc48f4b54413583c9249d86ec89af P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.081691 29280 tablet_replica.cc:333] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.082178 29280 raft_consensus.cc:2243] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.082548 29280 raft_consensus.cc:2272] T 3b56e2153ec4421281afc2150b970668 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.084451 29280 tablet_replica.cc:333] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.084980 29280 raft_consensus.cc:2243] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.085421 29280 raft_consensus.cc:2272] T a3bb45754e1f48068c332ed71e97ad32 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.087736 29280 tablet_replica.cc:333] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.088349 29280 raft_consensus.cc:2243] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.088841 29280 raft_consensus.cc:2272] T e325c8dae3b241c0b43a7b965cac7191 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.090770 29280 tablet_replica.cc:333] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.091275 29280 raft_consensus.cc:2243] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.091629 29280 raft_consensus.cc:2272] T 30ffeaaf1e8242629b324e7fda7bb872 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.093432 29280 tablet_replica.cc:333] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.093915 29280 raft_consensus.cc:2243] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.094252 29280 raft_consensus.cc:2272] T a2ea7c05d7854df3bd11f18d32aed4e0 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.096728 29280 tablet_replica.cc:333] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.097452 29280 raft_consensus.cc:2243] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.097990 29280 raft_consensus.cc:2272] T 62609ec3ccb34bd699d9ec237ef73fc7 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.100421 29280 tablet_replica.cc:333] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.101085 29280 raft_consensus.cc:2243] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.101605 29280 raft_consensus.cc:2272] T 95057452fb6c47048344f8f068d7c0d1 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.104017 29280 tablet_replica.cc:333] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.104655 29280 raft_consensus.cc:2243] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.105602 29280 raft_consensus.cc:2272] T b4e66b31d7944054bde6909f874d9531 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.106016  4973 consensus_peers.cc:597] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.108114 29280 tablet_replica.cc:333] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.108956 29280 raft_consensus.cc:2243] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.109452 29280 raft_consensus.cc:2272] T 296e8f525bb74ec48853794077e3bddf P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.112128 29280 tablet_replica.cc:333] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.112882 29280 raft_consensus.cc:2243] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.113894 29280 raft_consensus.cc:2272] T 6936f88d50994becb09fad0cbb8de81a P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.115267  4973 consensus_peers.cc:597] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.116328 29280 tablet_replica.cc:333] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.116897 29280 raft_consensus.cc:2243] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.117327 29280 raft_consensus.cc:2272] T dfd7218c035c4f08a2f3c9ae35ee1279 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.119194 29280 tablet_replica.cc:333] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.119689 29280 raft_consensus.cc:2243] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.120033 29280 raft_consensus.cc:2272] T 102e1754129b4dea9a2dab06dbab54c6 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.121758 29280 tablet_replica.cc:333] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.122241 29280 raft_consensus.cc:2243] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.122984 29280 raft_consensus.cc:2272] T ccd276985af7409ea9d00bf0d850b3b2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.124732 29280 tablet_replica.cc:333] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.125205 29280 raft_consensus.cc:2243] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.125888 29280 raft_consensus.cc:2272] T 95c66086fcb84985afe1bf786ed3726e P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.127955 29280 tablet_replica.cc:333] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.128492 29280 raft_consensus.cc:2243] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.128947 29280 raft_consensus.cc:2272] T 8eb1376921f9451bbafdf0355341d793 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.131136 29280 tablet_replica.cc:333] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.131685 29280 raft_consensus.cc:2243] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.132104 29280 raft_consensus.cc:2272] T 77c87c0a10ce45b48f3527e14aed165a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.134004 29280 tablet_replica.cc:333] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.134635 29280 raft_consensus.cc:2243] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.135170 29280 raft_consensus.cc:2272] T 5fc863e914714666afa0468d30e21e3a P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.137624 29280 tablet_replica.cc:333] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.138319 29280 raft_consensus.cc:2243] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.139156 29280 raft_consensus.cc:2272] T 937c0a0afa904d0ba5e441074701b4d8 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.140899 29280 tablet_replica.cc:333] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.141390 29280 raft_consensus.cc:2243] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.141866 29280 raft_consensus.cc:2272] T dd270a9c7b814d829f34285ded0099eb P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.143615 29280 tablet_replica.cc:333] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.144111 29280 raft_consensus.cc:2243] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.144541 29280 raft_consensus.cc:2272] T abd842ad26db48e1aa55713f47a1fe66 P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.146929 29280 tablet_replica.cc:333] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.147588 29280 raft_consensus.cc:2243] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.148078 29280 raft_consensus.cc:2272] T c88dea137c8e49a484a715cf7078e4c2 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.148891  4973 consensus_peers.cc:597] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.150482 29280 tablet_replica.cc:333] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.151074 29280 raft_consensus.cc:2243] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.151850 29280 raft_consensus.cc:2272] T 8ce5374ea4094a1da56f0705db711237 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.154112 29280 tablet_replica.cc:333] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.154860 29280 raft_consensus.cc:2243] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.155280 29280 raft_consensus.cc:2272] T dbaafca747714377b26752357eb9c97b P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.157042 29280 tablet_replica.cc:333] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
W20260709 13:12:56.157253  4973 consensus_peers.cc:597] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.157552 29280 raft_consensus.cc:2243] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.158107 29280 raft_consensus.cc:2272] T 44e3e883f43749a59653968b3183850e P f0ebe0c3053f48d6852e07257efbf0f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.159946 29280 tablet_replica.cc:333] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.160364 29280 raft_consensus.cc:2243] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.161068 29280 raft_consensus.cc:2272] T 4b0d8d1af32d4333bfb27a527def8b9c P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.162919 29280 tablet_replica.cc:333] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9: stopping tablet replica
I20260709 13:12:56.163308 29280 raft_consensus.cc:2243] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.163692 29280 raft_consensus.cc:2272] T 91c40c4ad6094ad0a5be7f2f349a9d29 P f0ebe0c3053f48d6852e07257efbf0f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.219848  4973 consensus_peers.cc:597] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.3:41787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.236254 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:12:56.310940 29280 tablet_server.cc:179] TabletServer@127.28.152.4:0 shutting down...
W20260709 13:12:56.322825  4973 consensus_peers.cc:597] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.3:41787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.350101  4973 consensus_peers.cc:597] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.3:41787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.361781 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:56.362833 29280 tablet_replica.cc:333] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.363850 29280 raft_consensus.cc:2243] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.364429 29280 raft_consensus.cc:2272] T 81c2fbed84cd431a80e4b6875377505a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.366274 29280 tablet_replica.cc:333] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.366883 29280 raft_consensus.cc:2243] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.367228 29280 raft_consensus.cc:2272] T 9388dee194834b479a120a34a1460d47 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.369021 29280 tablet_replica.cc:333] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.369500 29280 raft_consensus.cc:2243] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.369850 29280 raft_consensus.cc:2272] T e90059dfb0354efcbdf13a0b245cefb3 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.371702 29280 tablet_replica.cc:333] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.372489 29280 raft_consensus.cc:2243] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.372957 29280 raft_consensus.cc:2272] T d34da2d7f05c4d8abebd5e99d71cf8c6 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.375192 29280 tablet_replica.cc:333] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.375919 29280 raft_consensus.cc:2243] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.376402 29280 raft_consensus.cc:2272] T 51025d71068843cfb90078f0d937070d P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.378283 29280 tablet_replica.cc:333] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.378815 29280 raft_consensus.cc:2243] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.379491 29280 raft_consensus.cc:2272] T 57c70fd50ee1480c93f859973675ed01 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.381217 29280 tablet_replica.cc:333] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.381699 29280 raft_consensus.cc:2243] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.382411 29280 raft_consensus.cc:2272] T c88dea137c8e49a484a715cf7078e4c2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.384313 29280 tablet_replica.cc:333] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.384837 29280 raft_consensus.cc:2243] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.385180 29280 raft_consensus.cc:2272] T 339747664ecc489f95b3d04d961ac367 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.387213 29280 tablet_replica.cc:333] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.387704 29280 raft_consensus.cc:2243] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.388168 29280 raft_consensus.cc:2272] T feb6150ed16c4b01b553aeed27359f05 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.389897 29280 tablet_replica.cc:333] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.390370 29280 raft_consensus.cc:2243] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.390791 29280 raft_consensus.cc:2272] T 7dde9a121e3b41e3afb39390e431154f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.392474 29280 tablet_replica.cc:333] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.392949 29280 raft_consensus.cc:2243] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.393296 29280 raft_consensus.cc:2272] T 2b456ffffa884668a41f15046cec623b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.395084 29280 tablet_replica.cc:333] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.395555 29280 raft_consensus.cc:2243] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.396238 29280 raft_consensus.cc:2272] T a83e926be0c443dbadd95607ab1d8979 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.397933 29280 tablet_replica.cc:333] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.398408 29280 raft_consensus.cc:2243] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.399094 29280 raft_consensus.cc:2272] T 62609ec3ccb34bd699d9ec237ef73fc7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.401091 29280 tablet_replica.cc:333] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.401629 29280 raft_consensus.cc:2243] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.402149 29280 raft_consensus.cc:2272] T a2ea7c05d7854df3bd11f18d32aed4e0 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.404678 29280 tablet_replica.cc:333] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.405349 29280 raft_consensus.cc:2243] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.405689 29280 raft_consensus.cc:2272] T 7d44c39b62f14dfeb860991634e29c03 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.407346 29280 tablet_replica.cc:333] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.407804 29280 raft_consensus.cc:2243] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.408157 29280 raft_consensus.cc:2272] T abd842ad26db48e1aa55713f47a1fe66 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.409890 29280 tablet_replica.cc:333] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.410494 29280 raft_consensus.cc:2243] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.410939 29280 raft_consensus.cc:2272] T 94a86b4bab4f4187a53108485c2ad257 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.412662 29280 tablet_replica.cc:333] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.413223 29280 raft_consensus.cc:2243] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.413619 29280 raft_consensus.cc:2272] T 3b56e2153ec4421281afc2150b970668 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.415386 29280 tablet_replica.cc:333] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.415917 29280 raft_consensus.cc:2243] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.416311 29280 raft_consensus.cc:2272] T 6936f88d50994becb09fad0cbb8de81a P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.418177 29280 tablet_replica.cc:333] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.418745 29280 raft_consensus.cc:2243] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.419139 29280 raft_consensus.cc:2272] T 8903177763274513a4ded75b98ac1ea5 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.420876 29280 tablet_replica.cc:333] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.421399 29280 raft_consensus.cc:2243] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.421798 29280 raft_consensus.cc:2272] T ccd276985af7409ea9d00bf0d850b3b2 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.423574 29280 tablet_replica.cc:333] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.424085 29280 raft_consensus.cc:2243] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.424798 29280 raft_consensus.cc:2272] T 91c40c4ad6094ad0a5be7f2f349a9d29 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.426433 29280 tablet_replica.cc:333] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.426975 29280 raft_consensus.cc:2243] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.427160  5877 raft_consensus.cc:493] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6c95e5d9485488f9de4ffe24035c81d)
I20260709 13:12:56.427765 29280 raft_consensus.cc:2272] T 7281a21402c24e61b74acfc1564a4c8a P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.427649  5877 raft_consensus.cc:515] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9d92f86c74ea0b6537c30a8846eab" member_type: VOTER last_known_addr { host: "127.28.152.4" port: 34929 } } peers { permanent_uuid: "f6c95e5d9485488f9de4ffe24035c81d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 33395 } } peers { permanent_uuid: "7d069c6c6db44e9882ec432292c00563" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 43901 } }
I20260709 13:12:56.429364  5877 leader_election.cc:290] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395), 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901)
I20260709 13:12:56.430224 29280 tablet_replica.cc:333] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.431073 29280 raft_consensus.cc:2243] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.431979 29280 raft_consensus.cc:2272] T 0b5a1385cb5e4ceea7a319f6861603a7 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.433058  4975 leader_election.cc:336] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f6c95e5d9485488f9de4ffe24035c81d (127.28.152.1:33395): Network error: Client connection negotiation failed: client connection to 127.28.152.1:33395: connect: Connection refused (error 111)
W20260709 13:12:56.433720  4972 leader_election.cc:336] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7d069c6c6db44e9882ec432292c00563 (127.28.152.2:43901): Network error: Client connection negotiation failed: client connection to 127.28.152.2:43901: connect: Connection refused (error 111)
I20260709 13:12:56.434055  4972 leader_election.cc:304] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9d92f86c74ea0b6537c30a8846eab; no voters: 7d069c6c6db44e9882ec432292c00563, f6c95e5d9485488f9de4ffe24035c81d
I20260709 13:12:56.434262 29280 tablet_replica.cc:333] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.434605  5877 raft_consensus.cc:2749] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:56.434963 29280 raft_consensus.cc:2243] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.435808 29280 raft_consensus.cc:2272] T a3bb45754e1f48068c332ed71e97ad32 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.437541 29280 tablet_replica.cc:333] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.438014 29280 raft_consensus.cc:2243] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.438356 29280 raft_consensus.cc:2272] T 3481089e907345869da25ad79e97a113 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.440151 29280 tablet_replica.cc:333] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.440601 29280 raft_consensus.cc:2243] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.440948 29280 raft_consensus.cc:2272] T 95057452fb6c47048344f8f068d7c0d1 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.442763 29280 tablet_replica.cc:333] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.443225 29280 raft_consensus.cc:2243] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.443579 29280 raft_consensus.cc:2272] T 65e7df4527b14d3e9e9d026dca65d9b6 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.445117 29280 tablet_replica.cc:333] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.445569 29280 raft_consensus.cc:2243] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.446237 29280 raft_consensus.cc:2272] T cd2cac51497e440e9a975e6e0bd8efa8 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.448143 29280 tablet_replica.cc:333] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.448592 29280 raft_consensus.cc:2243] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.449276 29280 raft_consensus.cc:2272] T e56552e1ca874e52bfef190ac96a1740 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.451020 29280 tablet_replica.cc:333] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.451462 29280 raft_consensus.cc:2243] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.451802 29280 raft_consensus.cc:2272] T 63b20012ccf24e2394387d169d9c75fe P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.453505 29280 tablet_replica.cc:333] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.453940 29280 raft_consensus.cc:2243] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.454282 29280 raft_consensus.cc:2272] T 16f58579d1984a7490486826d572a5c8 P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.455897 29280 tablet_replica.cc:333] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.456331 29280 raft_consensus.cc:2243] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.457036 29280 raft_consensus.cc:2272] T dbaafca747714377b26752357eb9c97b P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.458840 29280 tablet_replica.cc:333] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.459268 29280 raft_consensus.cc:2243] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.459585 29280 raft_consensus.cc:2272] T 103e2af53ccd444cac711b88eb93573f P e3b9d92f86c74ea0b6537c30a8846eab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.461301 29280 tablet_replica.cc:333] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.461736 29280 raft_consensus.cc:2243] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.462077 29280 raft_consensus.cc:2272] T 44e3e883f43749a59653968b3183850e P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.463747 29280 tablet_replica.cc:333] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.464210 29280 raft_consensus.cc:2243] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.464610 29280 raft_consensus.cc:2272] T 52544a98965242fcad8616ff2cc4dc8a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.466270 29280 tablet_replica.cc:333] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.466754 29280 raft_consensus.cc:2243] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.467178 29280 raft_consensus.cc:2272] T 4b0d8d1af32d4333bfb27a527def8b9c P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.468780 29280 tablet_replica.cc:333] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.469205 29280 raft_consensus.cc:2243] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.469837 29280 raft_consensus.cc:2272] T e29c0f2d503146f6b27e75a54137a273 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.471604 29280 tablet_replica.cc:333] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.472033 29280 raft_consensus.cc:2243] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.472702 29280 raft_consensus.cc:2272] T 5fc863e914714666afa0468d30e21e3a P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.474437 29280 tablet_replica.cc:333] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.474964 29280 raft_consensus.cc:2243] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.475327 29280 raft_consensus.cc:2272] T 937c0a0afa904d0ba5e441074701b4d8 P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.477062 29280 tablet_replica.cc:333] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.477710 29280 raft_consensus.cc:2243] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.478145 29280 raft_consensus.cc:2272] T dd270a9c7b814d829f34285ded0099eb P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.480363 29280 tablet_replica.cc:333] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.481030 29280 raft_consensus.cc:2243] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:56.481703  4973 consensus_peers.cc:597] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab -> Peer f0ebe0c3053f48d6852e07257efbf0f9 (127.28.152.3:41787): Couldn't send request to peer f0ebe0c3053f48d6852e07257efbf0f9. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.3:41787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.481891 29280 raft_consensus.cc:2272] T 92327700b56842d580bb260af45dad1b P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.484041 29280 tablet_replica.cc:333] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.484469 29280 raft_consensus.cc:2243] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.484791 29280 raft_consensus.cc:2272] T 95c66086fcb84985afe1bf786ed3726e P e3b9d92f86c74ea0b6537c30a8846eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.486462 29280 tablet_replica.cc:333] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab: stopping tablet replica
I20260709 13:12:56.486960 29280 raft_consensus.cc:2243] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.487635 29280 raft_consensus.cc:2272] T e325c8dae3b241c0b43a7b965cac7191 P e3b9d92f86c74ea0b6537c30a8846eab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.556713 29280 tablet_server.cc:196] TabletServer@127.28.152.4:0 shutdown complete.
I20260709 13:12:56.619506 29280 master.cc:562] Master@127.28.152.62:37459 shutting down...
I20260709 13:12:56.645104 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.645709 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.646055 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8c8223cba6214387b9330012dfde071d: stopping tablet replica
I20260709 13:12:56.667671 29280 master.cc:584] Master@127.28.152.62:37459 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28466 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:12:56.755841 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:38723
I20260709 13:12:56.756947 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:56.762599  5882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:56.763999  5881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:56.764150  5884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:56.765381 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:56.766502 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:56.766731 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:56.766901 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602776766885 us; error 0 us; skew 500 ppm
I20260709 13:12:56.767491 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:56.769941 29280 webserver.cc:533] Webserver started at http://127.28.152.62:41839/ using document root <none> and password file <none>
I20260709 13:12:56.770445 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:56.770627 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:56.771382 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:56.772569 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "22378f1879414a7bb71de381cfc0abfa"
format_stamp: "Formatted at 2026-07-09 13:12:56 on dist-test-slave-x7j4"
I20260709 13:12:56.777088 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:56.780465  5889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:56.781333 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:56.781635 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "22378f1879414a7bb71de381cfc0abfa"
format_stamp: "Formatted at 2026-07-09 13:12:56 on dist-test-slave-x7j4"
I20260709 13:12:56.781926 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:56.800086 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:56.801389 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:56.839421 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:38723
I20260709 13:12:56.839533  5940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:38723 every 8 connection(s)
I20260709 13:12:56.843415  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.854017  5941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa: Bootstrap starting.
I20260709 13:12:56.858904  5941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.863426  5941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa: No bootstrap required, opened a new log
I20260709 13:12:56.865906  5941 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER }
I20260709 13:12:56.866345  5941 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.866603  5941 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22378f1879414a7bb71de381cfc0abfa, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.867353  5941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER }
I20260709 13:12:56.867858  5941 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:56.868104  5941 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:56.868407  5941 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.873472  5941 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER }
I20260709 13:12:56.874102  5941 leader_election.cc:304] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22378f1879414a7bb71de381cfc0abfa; no voters: 
I20260709 13:12:56.875386  5941 leader_election.cc:290] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:56.875744  5944 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.877135  5944 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 1 LEADER]: Becoming Leader. State: Replica: 22378f1879414a7bb71de381cfc0abfa, State: Running, Role: LEADER
I20260709 13:12:56.877851  5944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER }
I20260709 13:12:56.878708  5941 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:56.882455  5945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22378f1879414a7bb71de381cfc0abfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER } }
I20260709 13:12:56.883175  5945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:56.882982  5946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22378f1879414a7bb71de381cfc0abfa. Latest consensus state: current_term: 1 leader_uuid: "22378f1879414a7bb71de381cfc0abfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22378f1879414a7bb71de381cfc0abfa" member_type: VOTER } }
I20260709 13:12:56.883582  5946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:56.886264  5951 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:56.894212  5951 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:56.895227 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:56.903151  5951 catalog_manager.cc:1383] Generated new cluster ID: 4a4d117ec083409fb4d33aacecb6563a
I20260709 13:12:56.903469  5951 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:56.917671  5951 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:56.918982  5951 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:56.930652  5951 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa: Generated new TSK 0
I20260709 13:12:56.931362  5951 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:56.962299 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:56.968371  5962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:56.969731  5963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:56.971611  5965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:56.972075 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:56.973049 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:56.973308 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:56.973480 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602776973460 us; error 0 us; skew 500 ppm
I20260709 13:12:56.974002 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:56.976336 29280 webserver.cc:533] Webserver started at http://127.28.152.1:39401/ using document root <none> and password file <none>
I20260709 13:12:56.976857 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:56.977108 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:56.977391 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:56.978456 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "29c8271267c746bdaf6dedda3f3848ac"
format_stamp: "Formatted at 2026-07-09 13:12:56 on dist-test-slave-x7j4"
I20260709 13:12:56.983160 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:56.986470  5970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:56.987223 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:56.987521 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "29c8271267c746bdaf6dedda3f3848ac"
format_stamp: "Formatted at 2026-07-09 13:12:56 on dist-test-slave-x7j4"
I20260709 13:12:56.987833 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:57.005857 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:57.007139 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:57.008607 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:57.010926 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:57.011147 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.011379 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:57.011575 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.051782 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:34235
I20260709 13:12:57.051885  6032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:34235 every 8 connection(s)
I20260709 13:12:57.056469 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:57.064018  6037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:57.065074  6038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:57.068504  6040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:57.068831 29280 server_base.cc:1061] running on GCE node
I20260709 13:12:57.070132 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:57.070400 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:57.070619 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602777070600 us; error 0 us; skew 500 ppm
I20260709 13:12:57.071302 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:57.073592  6033 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38723
I20260709 13:12:57.073966  6033 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:57.074378 29280 webserver.cc:533] Webserver started at http://127.28.152.2:34887/ using document root <none> and password file <none>
I20260709 13:12:57.074848  6033 heartbeater.cc:507] Master 127.28.152.62:38723 requested a full tablet report, sending...
I20260709 13:12:57.074987 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:57.075352 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:57.075639 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:57.076983 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "fd88c2679a424c1f92ce2541eac8debe"
format_stamp: "Formatted at 2026-07-09 13:12:57 on dist-test-slave-x7j4"
I20260709 13:12:57.077184  5906 ts_manager.cc:194] Registered new tserver with Master: 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235)
I20260709 13:12:57.079808  5906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59270
I20260709 13:12:57.083022 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:57.086541  6045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.087381 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:57.087639 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "fd88c2679a424c1f92ce2541eac8debe"
format_stamp: "Formatted at 2026-07-09 13:12:57 on dist-test-slave-x7j4"
I20260709 13:12:57.087908 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:57.096311 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:57.097807 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:57.099418 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:57.101604 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:57.101806 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.102065 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:57.102231 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.141078 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:32781
I20260709 13:12:57.141175  6107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:32781 every 8 connection(s)
I20260709 13:12:57.145968 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:57.153056  6111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:57.154827  6112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:57.157819 29280 server_base.cc:1061] running on GCE node
W20260709 13:12:57.158401  6114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:57.158768  6108 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38723
I20260709 13:12:57.159271  6108 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:57.159627 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:57.159930 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:57.160140 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602777160121 us; error 0 us; skew 500 ppm
I20260709 13:12:57.160210  6108 heartbeater.cc:507] Master 127.28.152.62:38723 requested a full tablet report, sending...
I20260709 13:12:57.160923 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:57.162362  5906 ts_manager.cc:194] Registered new tserver with Master: fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:57.164179  5906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59286
I20260709 13:12:57.164765 29280 webserver.cc:533] Webserver started at http://127.28.152.3:39475/ using document root <none> and password file <none>
I20260709 13:12:57.165416 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:57.165663 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:57.165993 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:57.167339 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "3ce2d273c2c0448bbaba951463f22a0b"
format_stamp: "Formatted at 2026-07-09 13:12:57 on dist-test-slave-x7j4"
I20260709 13:12:57.171705 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:57.175086  6119 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.175882 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:57.176179 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "3ce2d273c2c0448bbaba951463f22a0b"
format_stamp: "Formatted at 2026-07-09 13:12:57 on dist-test-slave-x7j4"
I20260709 13:12:57.176467 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:57.193449 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:57.194645 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:57.196146 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:57.198403 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:57.198627 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.198891 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:57.199064 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.240204 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:37265
I20260709 13:12:57.240345  6181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:37265 every 8 connection(s)
I20260709 13:12:57.254657  6182 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38723
I20260709 13:12:57.255120  6182 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:57.255846  6182 heartbeater.cc:507] Master 127.28.152.62:38723 requested a full tablet report, sending...
I20260709 13:12:57.257803  5906 ts_manager.cc:194] Registered new tserver with Master: 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:57.258230 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014821366s
I20260709 13:12:57.259285  5906 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59300
I20260709 13:12:57.284195  5906 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59308:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:57.287113  5906 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:57.358191  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 5106ce075ced482e9131d13c987b5ce1 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:57.360176  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5106ce075ced482e9131d13c987b5ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.364279  6072 tablet_service.cc:1511] Processing CreateTablet for tablet 081f3098b04d460b82cd3ccf71eae1b7 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:57.366588  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f3098b04d460b82cd3ccf71eae1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.372597  6071 tablet_service.cc:1511] Processing CreateTablet for tablet 91e99f76a1e243908c167c4bdb9923eb (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:57.374437  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e99f76a1e243908c167c4bdb9923eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.378284  6070 tablet_service.cc:1511] Processing CreateTablet for tablet ed092ba0604e48bb95c8c81962ba7f40 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:57.379281  5998 tablet_service.cc:1511] Processing CreateTablet for tablet 5106ce075ced482e9131d13c987b5ce1 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:57.379853  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed092ba0604e48bb95c8c81962ba7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.380676  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5106ce075ced482e9131d13c987b5ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.383850  5997 tablet_service.cc:1511] Processing CreateTablet for tablet 081f3098b04d460b82cd3ccf71eae1b7 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:57.385263  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f3098b04d460b82cd3ccf71eae1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.387811  5996 tablet_service.cc:1511] Processing CreateTablet for tablet 91e99f76a1e243908c167c4bdb9923eb (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:57.391501  5995 tablet_service.cc:1511] Processing CreateTablet for tablet ed092ba0604e48bb95c8c81962ba7f40 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:57.389657  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e99f76a1e243908c167c4bdb9923eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.396606  5995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed092ba0604e48bb95c8c81962ba7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.424995  6198 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.427410  5994 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:57.433461  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.430371  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:57.439203  6147 tablet_service.cc:1511] Processing CreateTablet for tablet 5106ce075ced482e9131d13c987b5ce1 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:57.439630  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.439841  6146 tablet_service.cc:1511] Processing CreateTablet for tablet 081f3098b04d460b82cd3ccf71eae1b7 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:57.440615  6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5106ce075ced482e9131d13c987b5ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.441303  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081f3098b04d460b82cd3ccf71eae1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.444176  6145 tablet_service.cc:1511] Processing CreateTablet for tablet 91e99f76a1e243908c167c4bdb9923eb (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:57.445607  6145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e99f76a1e243908c167c4bdb9923eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.446156  5997 tablet_service.cc:1511] Processing CreateTablet for tablet f3706a0b71b6460fb2eff3cc97110566 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:57.447597  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3706a0b71b6460fb2eff3cc97110566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.449404  6144 tablet_service.cc:1511] Processing CreateTablet for tablet ed092ba0604e48bb95c8c81962ba7f40 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:57.450868  6144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed092ba0604e48bb95c8c81962ba7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.454216  6143 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:57.455664  6143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7fcdc58ebd4ba0916583a4cf92fc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.460964  6198 tablet_bootstrap.cc:654] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.466861  6072 tablet_service.cc:1511] Processing CreateTablet for tablet f3706a0b71b6460fb2eff3cc97110566 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:57.471676  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3706a0b71b6460fb2eff3cc97110566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.471947  6197 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.475263  6142 tablet_service.cc:1511] Processing CreateTablet for tablet f3706a0b71b6460fb2eff3cc97110566 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:57.476748  6142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3706a0b71b6460fb2eff3cc97110566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.483129  5995 tablet_service.cc:1511] Processing CreateTablet for tablet a9f90927861340b7bfd6eb14a7ee4d52 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:57.484683  5995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f90927861340b7bfd6eb14a7ee4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.485765  6197 tablet_bootstrap.cc:654] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.488498  6198 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.499332  6198 ts_tablet_manager.cc:1403] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 13:12:57.490545  6199 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.494376  6147 tablet_service.cc:1511] Processing CreateTablet for tablet a9f90927861340b7bfd6eb14a7ee4d52 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:57.494990  6070 tablet_service.cc:1511] Processing CreateTablet for tablet a9f90927861340b7bfd6eb14a7ee4d52 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:57.495390  5996 tablet_service.cc:1511] Processing CreateTablet for tablet a0b60dea31f6493c921066ad71214a11 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:57.507951  6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f90927861340b7bfd6eb14a7ee4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.507817  6144 tablet_service.cc:1511] Processing CreateTablet for tablet a0b60dea31f6493c921066ad71214a11 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:57.508965  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b60dea31f6493c921066ad71214a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.525404  5997 tablet_service.cc:1511] Processing CreateTablet for tablet ebe60224722f403a9bceff668326dac9 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:57.510520  6072 tablet_service.cc:1511] Processing CreateTablet for tablet a0b60dea31f6493c921066ad71214a11 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:57.502487  6198 raft_consensus.cc:359] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.513671  6071 tablet_service.cc:1511] Processing CreateTablet for tablet ebe60224722f403a9bceff668326dac9 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:57.516654  6141 tablet_service.cc:1511] Processing CreateTablet for tablet ebe60224722f403a9bceff668326dac9 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:57.517961  5998 tablet_service.cc:1511] Processing CreateTablet for tablet 95a206890c514360a9bb33671f0e5de8 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:57.525557  6069 tablet_service.cc:1511] Processing CreateTablet for tablet 95a206890c514360a9bb33671f0e5de8 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:57.507951  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f90927861340b7bfd6eb14a7ee4d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.530171  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a206890c514360a9bb33671f0e5de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.530766  6199 tablet_bootstrap.cc:654] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.535233  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe60224722f403a9bceff668326dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.539290  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b60dea31f6493c921066ad71214a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.527330  6144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b60dea31f6493c921066ad71214a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.545356  6141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe60224722f403a9bceff668326dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.550961  6198 raft_consensus.cc:385] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.553398  6198 raft_consensus.cc:740] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.527237  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe60224722f403a9bceff668326dac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.559753  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a206890c514360a9bb33671f0e5de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.568301  6145 tablet_service.cc:1511] Processing CreateTablet for tablet 95a206890c514360a9bb33671f0e5de8 (DEFAULT_TABLE table=test-workload [id=8dc03d7523344844858ee2d189f37fae]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:57.569656  6145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a206890c514360a9bb33671f0e5de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.569233  6198 consensus_queue.cc:260] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.589738  6033 heartbeater.cc:499] Master 127.28.152.62:38723 was elected leader, sending a full tablet report...
I20260709 13:12:57.590831  6198 ts_tablet_manager.cc:1434] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.006s
I20260709 13:12:57.591013  6197 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.604558  6197 ts_tablet_manager.cc:1403] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.010s
I20260709 13:12:57.600682  6199 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.605387  6199 ts_tablet_manager.cc:1403] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.000s
I20260709 13:12:57.607776  6197 raft_consensus.cc:359] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.608299  6199 raft_consensus.cc:359] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.613008  6197 raft_consensus.cc:385] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.613157  6199 raft_consensus.cc:385] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.613418  6197 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.613538  6199 raft_consensus.cc:740] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.614467  6197 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.614604  6199 consensus_queue.cc:260] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.612671  6198 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.617889  6197 ts_tablet_manager.cc:1434] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:12:57.618638  6108 heartbeater.cc:499] Master 127.28.152.62:38723 was elected leader, sending a full tablet report...
I20260709 13:12:57.618980  6197 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.625572  6199 ts_tablet_manager.cc:1434] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 13:12:57.626318  6182 heartbeater.cc:499] Master 127.28.152.62:38723 was elected leader, sending a full tablet report...
I20260709 13:12:57.626564  6199 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.627365  6197 tablet_bootstrap.cc:654] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.633034  6199 tablet_bootstrap.cc:654] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.635197  6198 tablet_bootstrap.cc:654] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.663738  6198 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.664335  6198 ts_tablet_manager.cc:1403] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.005s
I20260709 13:12:57.667377  6198 raft_consensus.cc:359] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.668169  6198 raft_consensus.cc:385] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.668503  6198 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.669211  6198 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.670431  6199 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.671324  6199 ts_tablet_manager.cc:1403] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.017s
I20260709 13:12:57.673622  6198 ts_tablet_manager.cc:1434] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:57.674827  6198 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.674937  6197 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.675523  6197 ts_tablet_manager.cc:1403] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.020s
I20260709 13:12:57.675171  6199 raft_consensus.cc:359] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.675905  6199 raft_consensus.cc:385] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.676213  6199 raft_consensus.cc:740] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.677150  6199 consensus_queue.cc:260] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.678890  6197 raft_consensus.cc:359] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.679666  6197 raft_consensus.cc:385] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.679966  6197 raft_consensus.cc:740] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.680876  6197 consensus_queue.cc:260] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.682533  6198 tablet_bootstrap.cc:654] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.684841  6197 ts_tablet_manager.cc:1434] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:12:57.685842  6199 ts_tablet_manager.cc:1434] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:12:57.685853  6197 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.689540  6199 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.693331  6197 tablet_bootstrap.cc:654] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.696564  6199 tablet_bootstrap.cc:654] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.705051  6198 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.705051  6197 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.705674  6197 ts_tablet_manager.cc:1403] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:12:57.705685  6198 ts_tablet_manager.cc:1403] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.016s
I20260709 13:12:57.705892  6199 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.706540  6199 ts_tablet_manager.cc:1403] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:12:57.708948  6198 raft_consensus.cc:359] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.709179  6197 raft_consensus.cc:359] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.709307  6199 raft_consensus.cc:359] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.709757  6198 raft_consensus.cc:385] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.709894  6197 raft_consensus.cc:385] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.710114  6199 raft_consensus.cc:385] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.710163  6198 raft_consensus.cc:740] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.710225  6197 raft_consensus.cc:740] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.710625  6199 raft_consensus.cc:740] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.711340  6198 consensus_queue.cc:260] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.711434  6199 consensus_queue.cc:260] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.711341  6197 consensus_queue.cc:260] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.713670  6198 ts_tablet_manager.cc:1434] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:57.714157  6199 ts_tablet_manager.cc:1434] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:12:57.714640  6198 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.715269  6199 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.717092  6197 ts_tablet_manager.cc:1434] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:57.718204  6197 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.721457  6199 tablet_bootstrap.cc:654] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.721616  6198 tablet_bootstrap.cc:654] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.724470  6197 tablet_bootstrap.cc:654] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.730235  6198 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.730731  6198 ts_tablet_manager.cc:1403] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:12:57.733664  6198 raft_consensus.cc:359] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.734356  6198 raft_consensus.cc:385] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.734627  6198 raft_consensus.cc:740] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.736757  6198 consensus_queue.cc:260] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.737952  6199 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.738656  6199 ts_tablet_manager.cc:1403] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 13:12:57.739094  6198 ts_tablet_manager.cc:1434] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:12:57.741230  6198 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.741961  6197 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.741671  6199 raft_consensus.cc:359] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.742501  6197 ts_tablet_manager.cc:1403] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:12:57.742455  6199 raft_consensus.cc:385] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.743057  6199 raft_consensus.cc:740] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.744071  6199 consensus_queue.cc:260] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.746275  6199 ts_tablet_manager.cc:1434] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.745954  6197 raft_consensus.cc:359] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.746734  6197 raft_consensus.cc:385] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.747022  6197 raft_consensus.cc:740] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.747326  6199 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.748225  6198 tablet_bootstrap.cc:654] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.747870  6197 consensus_queue.cc:260] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.750406  6197 ts_tablet_manager.cc:1434] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.751503  6197 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.758796  6197 tablet_bootstrap.cc:654] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.760380  6199 tablet_bootstrap.cc:654] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.761605  6198 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.762137  6198 ts_tablet_manager.cc:1403] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:12:57.765165  6198 raft_consensus.cc:359] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.765903  6198 raft_consensus.cc:385] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.766191  6198 raft_consensus.cc:740] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.767107  6198 consensus_queue.cc:260] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.769593  6198 ts_tablet_manager.cc:1434] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:57.770498  6198 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.770560  6199 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.770571  6197 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.771306  6199 ts_tablet_manager.cc:1403] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 13:12:57.771346  6197 ts_tablet_manager.cc:1403] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:12:57.774350  6197 raft_consensus.cc:359] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.774960  6197 raft_consensus.cc:385] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.775254  6197 raft_consensus.cc:740] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.776126  6197 consensus_queue.cc:260] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.776834  6199 raft_consensus.cc:359] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.777554  6199 raft_consensus.cc:385] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.777851  6198 tablet_bootstrap.cc:654] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.777874  6199 raft_consensus.cc:740] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.778798  6197 ts_tablet_manager.cc:1434] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:57.779080  6199 consensus_queue.cc:260] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.779829  6197 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.786618  6197 tablet_bootstrap.cc:654] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.786578  6199 ts_tablet_manager.cc:1434] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:12:57.787931  6199 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.795902  6199 tablet_bootstrap.cc:654] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.802553  6197 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.803089  6197 ts_tablet_manager.cc:1403] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 13:12:57.805918  6197 raft_consensus.cc:359] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.806656  6197 raft_consensus.cc:385] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.806967  6197 raft_consensus.cc:740] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.808449  6197 consensus_queue.cc:260] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.810635  6199 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.810932  6197 ts_tablet_manager.cc:1434] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:57.811210  6199 ts_tablet_manager.cc:1403] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:12:57.812000  6197 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.814329  6199 raft_consensus.cc:359] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.815052  6199 raft_consensus.cc:385] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.815382  6199 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.816367  6199 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.818811  6197 tablet_bootstrap.cc:654] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.821442  6199 ts_tablet_manager.cc:1434] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:57.822723  6199 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.830178  6199 tablet_bootstrap.cc:654] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.830509  6197 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.831079  6197 ts_tablet_manager.cc:1403] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:12:57.835155  6197 raft_consensus.cc:359] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.836143  6197 raft_consensus.cc:385] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.836501  6197 raft_consensus.cc:740] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.837800  6203 raft_consensus.cc:493] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.837522  6197 consensus_queue.cc:260] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.838312  6203 raft_consensus.cc:515] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.842916  6203 leader_election.cc:290] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:57.843536  6197 ts_tablet_manager.cc:1434] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:57.844954  6197 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.846742  6205 raft_consensus.cc:493] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.847381  6205 raft_consensus.cc:515] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.853405  6197 tablet_bootstrap.cc:654] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.855167  6203 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.855623  6205 leader_election.cc:290] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235)
I20260709 13:12:57.855739  6203 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.858482  6203 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:57.865099  6199 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.865638  6199 ts_tablet_manager.cc:1403] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.007s
I20260709 13:12:57.866220  6197 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.866740  6197 ts_tablet_manager.cc:1403] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 13:12:57.868225  6198 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:57.868770  6198 ts_tablet_manager.cc:1403] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.045s
I20260709 13:12:57.870018  6197 raft_consensus.cc:359] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.870797  6197 raft_consensus.cc:385] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.871058  6197 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.871908  6197 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.874567  6197 ts_tablet_manager.cc:1434] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.871976  6199 raft_consensus.cc:359] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.875694  6199 raft_consensus.cc:385] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.876004  6199 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.876788  6199 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.877374  6197 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:57.883612  6197 tablet_bootstrap.cc:654] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.876449  6198 raft_consensus.cc:359] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.885252  6198 raft_consensus.cc:385] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.885516  6199 ts_tablet_manager.cc:1434] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
W20260709 13:12:57.888983  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:57.885558  6198 raft_consensus.cc:740] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.892648  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5106ce075ced482e9131d13c987b5ce1" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:57.893353  6008 raft_consensus.cc:2468] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:57.893304  6198 consensus_queue.cc:260] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.894411  6199 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.897787  6121 leader_election.cc:304] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:12:57.898973  6205 raft_consensus.cc:2804] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.899322  6205 raft_consensus.cc:493] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.899641  6205 raft_consensus.cc:3060] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.903095  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5106ce075ced482e9131d13c987b5ce1" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:57.903839  6083 raft_consensus.cc:2468] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:57.909062  6199 tablet_bootstrap.cc:654] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.909884  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:57.910640  6082 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 0.
I20260709 13:12:57.912644  5974 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:57.912711  6204 raft_consensus.cc:493] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.912966  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:57.913652  6203 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.913444  6204 raft_consensus.cc:515] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.914036  6203 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.914444  6203 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.913663  6083 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 0.
I20260709 13:12:57.919917  6199 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:57.920145  5974 leader_election.cc:304] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:57.920504  6199 ts_tablet_manager.cc:1403] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.003s
I20260709 13:12:57.918540  6205 raft_consensus.cc:515] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:57.924077  6199 raft_consensus.cc:359] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.924899  6199 raft_consensus.cc:385] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.925228  6199 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.925632  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5106ce075ced482e9131d13c987b5ce1" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:57.926327  6198 ts_tablet_manager.cc:1434] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:12:57.926156  6199 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.926620  6204 leader_election.cc:290] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:57.927707  6198 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:57.932600  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5106ce075ced482e9131d13c987b5ce1" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:57.933183  6008 raft_consensus.cc:3060] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.926332  6083 raft_consensus.cc:3060] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.933985  6205 leader_election.cc:290] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Requested vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235)
I20260709 13:12:57.940204  6197 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:57.940910  6197 ts_tablet_manager.cc:1403] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.008s
I20260709 13:12:57.941226  6198 tablet_bootstrap.cc:654] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.942497  6203 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.945530  6205 raft_consensus.cc:493] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.948101  6205 raft_consensus.cc:515] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.950501  6203 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 election: Requested vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:57.951504  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:57.952026  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:57.952381  6157 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 0.
I20260709 13:12:57.952476  6205 leader_election.cc:290] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:57.952693  6082 raft_consensus.cc:2468] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:57.953037  6205 raft_consensus.cc:493] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.952399  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:57.953578  6205 raft_consensus.cc:515] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.953940  6156 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 0.
I20260709 13:12:57.954340  6203 raft_consensus.cc:2804] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.954196  6123 leader_election.cc:304] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:57.953171  6197 raft_consensus.cc:359] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.958077  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:57.958222  6203 raft_consensus.cc:493] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.959316  6203 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.961745  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
W20260709 13:12:57.962203  6121 leader_election.cc:343] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.962383  6081 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.955675  6205 leader_election.cc:290] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:57.963156  6205 raft_consensus.cc:2804] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.956179  6083 raft_consensus.cc:2468] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:57.963546  6205 raft_consensus.cc:493] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.963963  6205 raft_consensus.cc:3060] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.959947  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:57.967031  6082 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:57.967283  6123 leader_election.cc:304] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:57.967549  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:57.958352  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:57.968219  6006 raft_consensus.cc:2468] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:57.968608  6156 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.969481  6047 leader_election.cc:304] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:57.970363  6204 raft_consensus.cc:2804] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.960816  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:57.970749  6204 raft_consensus.cc:493] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.971015  6007 raft_consensus.cc:2468] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:57.958374  6197 raft_consensus.cc:385] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.971148  6204 raft_consensus.cc:3060] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.971668  6197 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.972573  6197 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.972874  6205 raft_consensus.cc:515] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.975334  6123 leader_election.cc:304] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:12:57.977254  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:57.977883  6007 raft_consensus.cc:3060] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.979137  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:57.979969  6157 raft_consensus.cc:2393] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd88c2679a424c1f92ce2541eac8debe in current term 1: Already voted for candidate 3ce2d273c2c0448bbaba951463f22a0b in this term.
I20260709 13:12:57.981252  6205 leader_election.cc:290] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:57.982111  6205 raft_consensus.cc:2804] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.982761  6205 raft_consensus.cc:697] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:12:57.983561  6234 raft_consensus.cc:2804] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.985163  6199 ts_tablet_manager.cc:1434] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.021s
I20260709 13:12:57.986096  6234 raft_consensus.cc:493] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.986552  6234 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.987636  6203 raft_consensus.cc:515] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.990027  6199 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:57.994158  6008 raft_consensus.cc:2468] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:57.996354  6204 raft_consensus.cc:515] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:57.999965  6205 consensus_queue.cc:237] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:12:58.003183  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:58.003882  6082 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.004276  6203 leader_election.cc:290] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 election: Requested vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.006487  6007 raft_consensus.cc:2468] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:58.008704  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:58.009670  6197 ts_tablet_manager.cc:1434] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.068s	user 0.016s	sys 0.027s
I20260709 13:12:58.009829  6157 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.000056  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.011125  6197 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: Bootstrap starting.
I20260709 13:12:58.015086  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:58.015630  6121 leader_election.cc:304] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:12:58.016248  6083 raft_consensus.cc:2393] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ce2d273c2c0448bbaba951463f22a0b in current term 1: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:12:58.018077  6236 raft_consensus.cc:2804] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.020076  6197 tablet_bootstrap.cc:654] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.020517  6081 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 1.
I20260709 13:12:58.024679  6199 tablet_bootstrap.cc:654] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.027328  6205 raft_consensus.cc:493] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.027872  6205 raft_consensus.cc:515] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.023532  6008 raft_consensus.cc:2393] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd88c2679a424c1f92ce2541eac8debe in current term 1: Already voted for candidate 3ce2d273c2c0448bbaba951463f22a0b in this term.
I20260709 13:12:58.037561  5974 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.038757  6156 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 1.
I20260709 13:12:58.036104  6204 leader_election.cc:290] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.040117  6203 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.040961  6198 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:58.041545  6198 ts_tablet_manager.cc:1403] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.114s	user 0.003s	sys 0.008s
I20260709 13:12:58.041304  6234 raft_consensus.cc:515] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.044286  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.045394  6007 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:58.029449  6082 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 1.
I20260709 13:12:58.032797  6235 raft_consensus.cc:493] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.049729  6121 leader_election.cc:304] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:12:58.049901  6235 raft_consensus.cc:515] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.040824  6203 raft_consensus.cc:697] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 LEADER]: Becoming Leader. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Running, Role: LEADER
I20260709 13:12:58.055267  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.054968  6203 consensus_queue.cc:237] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.040113  6204 raft_consensus.cc:493] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.058910  6204 raft_consensus.cc:515] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.066277  5974 leader_election.cc:304] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.067312  6233 raft_consensus.cc:2804] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.070770  6204 leader_election.cc:290] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.067744  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7fcdc58ebd4ba0916583a4cf92fc8f" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:58.063086  6236 raft_consensus.cc:697] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:12:58.063243  6157 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c8271267c746bdaf6dedda3f3848ac in term 1.
I20260709 13:12:58.064766  6205 leader_election.cc:290] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:58.077041  6205 raft_consensus.cc:2804] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.077229  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.076092  6204 raft_consensus.cc:493] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.078722  6155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
W20260709 13:12:58.078879  6047 leader_election.cc:343] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.078850  6204 raft_consensus.cc:515] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.079500  6155 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.079638  6205 raft_consensus.cc:493] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.079439  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:58.081017  6048 leader_election.cc:304] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:12:58.081136  6082 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:58.081344  6236 consensus_queue.cc:237] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.082136  6239 raft_consensus.cc:2804] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.080062  6205 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.082615  6239 raft_consensus.cc:493] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.083099  6239 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.093657  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.094615  6006 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.096024  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.096946  6008 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.098404  6205 raft_consensus.cc:515] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.098835  6047 leader_election.cc:304] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.099959  6239 raft_consensus.cc:515] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
W20260709 13:12:58.100870  6121 leader_election.cc:343] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.104094  6205 leader_election.cc:290] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:58.105516  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:58.106902  6082 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.108572  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:58.109218  6157 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.114820  6239 leader_election.cc:290] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.115504  6204 leader_election.cc:290] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.116896  6155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.117081  6235 leader_election.cc:290] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.117671  6155 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.118878  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.119350  6198 raft_consensus.cc:359] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.120273  6198 raft_consensus.cc:385] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.120669  6198 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.120741  6157 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:12:58.119808  6007 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.118897  6239 raft_consensus.cc:2804] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.122113  6239 raft_consensus.cc:493] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.122460  6239 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.122843  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:58.123482  6081 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.123952  6048 leader_election.cc:304] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:12:58.114436  6082 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:58.115370  6234 leader_election.cc:290] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:58.130086  6199 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:58.130528  6199 ts_tablet_manager.cc:1403] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.007s
I20260709 13:12:58.133919  6199 raft_consensus.cc:359] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.130905  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.135388  6156 raft_consensus.cc:2393] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd88c2679a424c1f92ce2541eac8debe in current term 1: Already voted for candidate 3ce2d273c2c0448bbaba951463f22a0b in this term.
I20260709 13:12:58.134630  6199 raft_consensus.cc:385] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.136296  6199 raft_consensus.cc:740] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.136982  6199 consensus_queue.cc:260] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.139416  6199 ts_tablet_manager.cc:1434] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:12:58.140424  6199 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: Bootstrap starting.
I20260709 13:12:58.141564  6081 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:58.128531  6235 raft_consensus.cc:2749] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.124996  6233 raft_consensus.cc:697] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 LEADER]: Becoming Leader. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Running, Role: LEADER
I20260709 13:12:58.143005  6240 raft_consensus.cc:493] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.143654  6047 leader_election.cc:304] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.144445  6123 leader_election.cc:304] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:12:58.144481  6048 leader_election.cc:304] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.145643  6240 raft_consensus.cc:515] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.146880  6204 raft_consensus.cc:2764] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:58.147239  6233 consensus_queue.cc:237] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.147576  6204 raft_consensus.cc:2804] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.148432  6204 raft_consensus.cc:697] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:12:58.148679  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.148846  6240 leader_election.cc:290] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:58.149736  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.149324  6204 consensus_queue.cc:237] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.151415  6246 raft_consensus.cc:493] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.121686  6198 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.149361  6006 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 0.
I20260709 13:12:58.158206  6121 leader_election.cc:304] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:12:58.159143  6234 raft_consensus.cc:2804] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.159322  6198 ts_tablet_manager.cc:1434] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.117s	user 0.009s	sys 0.002s
I20260709 13:12:58.158725  5904 catalog_manager.cc:5697] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1). New cstate: current_term: 1 leader_uuid: "29c8271267c746bdaf6dedda3f3848ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.160039  6240 raft_consensus.cc:2804] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.159653  6234 raft_consensus.cc:493] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.160171  6123 leader_election.cc:304] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.160605  6234 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.161469  6047 leader_election.cc:343] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.164698  6236 raft_consensus.cc:2804] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.165264  6236 raft_consensus.cc:697] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:12:58.166574  6236 consensus_queue.cc:237] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.171994  6199 tablet_bootstrap.cc:654] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.175379  6197 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: No bootstrap required, opened a new log
I20260709 13:12:58.175781  6197 ts_tablet_manager.cc:1403] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.019s
I20260709 13:12:58.173102  6198 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:58.171046  6240 raft_consensus.cc:697] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:12:58.179461  6240 consensus_queue.cc:237] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.172825  6007 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 1.
I20260709 13:12:58.175191  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:58.183599  6239 raft_consensus.cc:515] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.186764  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.163090  5905 catalog_manager.cc:5697] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 1 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.163582  6246 raft_consensus.cc:515] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.188956  6197 raft_consensus.cc:359] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.193176  6197 raft_consensus.cc:385] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.193264  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:58.188166  6007 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.192504  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
W20260709 13:12:58.197185  6047 leader_election.cc:343] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.197118  5906 catalog_manager.cc:5697] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 0 to 1, leader changed from <none> to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 1 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.193832  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.192720  6246 leader_election.cc:290] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.200408  6157 raft_consensus.cc:2468] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.201756  6048 leader_election.cc:304] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:12:58.193537  6197 raft_consensus.cc:740] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.203292  6007 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:12:58.198101  6082 raft_consensus.cc:2393] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ce2d273c2c0448bbaba951463f22a0b in current term 1: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:12:58.195230  6234 raft_consensus.cc:515] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.192315  6239 leader_election.cc:290] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.203281  6197 consensus_queue.cc:260] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.207369  6047 leader_election.cc:304] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.208101  6197 ts_tablet_manager.cc:1434] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:12:58.208401  6204 raft_consensus.cc:2804] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.206467  6246 raft_consensus.cc:2804] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.208952  6204 raft_consensus.cc:697] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:12:58.209510  6246 raft_consensus.cc:493] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.209975  6246 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.210073  6204 consensus_queue.cc:237] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.212466  6156 raft_consensus.cc:2393] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd88c2679a424c1f92ce2541eac8debe in current term 1: Already voted for candidate 3ce2d273c2c0448bbaba951463f22a0b in this term.
I20260709 13:12:58.216529  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.218179  6007 raft_consensus.cc:2393] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ce2d273c2c0448bbaba951463f22a0b in current term 1: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:12:58.217211  6234 leader_election.cc:290] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:12:58.220777  6246 raft_consensus.cc:515] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.221621  6198 tablet_bootstrap.cc:654] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.223812  6246 leader_election.cc:290] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.224825  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.228561  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:12:58.229060  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
W20260709 13:12:58.229914  6047 leader_election.cc:343] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.229671  6156 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.231175  6121 leader_election.cc:304] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b; no voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe
I20260709 13:12:58.240307  6156 raft_consensus.cc:2468] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:12:58.240646  6199 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: No bootstrap required, opened a new log
I20260709 13:12:58.241173  6199 ts_tablet_manager.cc:1403] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.010s
I20260709 13:12:58.241564  6048 leader_election.cc:304] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:12:58.242736  6204 raft_consensus.cc:2804] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.243201  6204 raft_consensus.cc:697] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:12:58.243436  6199 raft_consensus.cc:359] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.244131  6199 raft_consensus.cc:385] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.244467  6199 raft_consensus.cc:740] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.243999  6204 consensus_queue.cc:237] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.245234  6199 consensus_queue.cc:260] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.246243  6234 raft_consensus.cc:2749] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.247277  6199 ts_tablet_manager.cc:1434] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:12:58.254410  6198 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:58.254969  6198 ts_tablet_manager.cc:1403] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.010s
I20260709 13:12:58.257190  6198 raft_consensus.cc:359] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.257822  6198 raft_consensus.cc:385] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.258069  6198 raft_consensus.cc:740] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.258818  6198 consensus_queue.cc:260] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.260880  6198 ts_tablet_manager.cc:1434] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:58.261854  6198 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:58.267839  6198 tablet_bootstrap.cc:654] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.278506  6198 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:58.278995  6198 ts_tablet_manager.cc:1403] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:12:58.278951  5905 catalog_manager.cc:5697] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1). New cstate: current_term: 1 leader_uuid: "29c8271267c746bdaf6dedda3f3848ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.282028  6198 raft_consensus.cc:359] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.282574  6198 raft_consensus.cc:385] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.282831  6198 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.283371  6198 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.284896  6198 ts_tablet_manager.cc:1434] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:58.285708  6198 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:12:58.289620  5904 catalog_manager.cc:5697] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 0 to 1, leader changed from <none> to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 1 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.290671  6198 tablet_bootstrap.cc:654] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.291467  5904 catalog_manager.cc:5697] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 0 to 1, leader changed from <none> to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 1 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.296468  6198 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: No bootstrap required, opened a new log
I20260709 13:12:58.296934  6198 ts_tablet_manager.cc:1403] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:12:58.299012  6198 raft_consensus.cc:359] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.299647  6198 raft_consensus.cc:385] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.299916  6198 raft_consensus.cc:740] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.300567  6198 consensus_queue.cc:260] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.302570  6198 ts_tablet_manager.cc:1434] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:58.302189  5906 catalog_manager.cc:5697] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 1 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.304016  5906 catalog_manager.cc:5697] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 1 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.305403  5906 catalog_manager.cc:5697] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 1 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.336156  6233 raft_consensus.cc:493] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.336706  6233 raft_consensus.cc:515] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.338308  6233 leader_election.cc:290] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.339115  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:58.339390  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.339748  6082 raft_consensus.cc:2393] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29c8271267c746bdaf6dedda3f3848ac in current term 1: Already voted for candidate 3ce2d273c2c0448bbaba951463f22a0b in this term.
I20260709 13:12:58.340900  5974 leader_election.cc:304] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac; no voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe
I20260709 13:12:58.341627  6233 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.347009  6233 raft_consensus.cc:2749] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.422075  6240 consensus_queue.cc:1048] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.433439  6236 consensus_queue.cc:1048] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.439360  6233 raft_consensus.cc:493] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.439975  6233 raft_consensus.cc:515] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.441905  6233 leader_election.cc:290] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.442535  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:58.443071  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.443861  6156 raft_consensus.cc:2393] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29c8271267c746bdaf6dedda3f3848ac in current term 1: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:12:58.445171  5973 leader_election.cc:304] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac; no voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe
I20260709 13:12:58.445986  6233 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.452066  6233 raft_consensus.cc:2749] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.465270  6204 raft_consensus.cc:493] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.465857  6204 raft_consensus.cc:515] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.467828  6204 leader_election.cc:290] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.468667  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a206890c514360a9bb33671f0e5de8" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac" is_pre_election: true
I20260709 13:12:58.468896  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a206890c514360a9bb33671f0e5de8" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.469269  6007 raft_consensus.cc:2468] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.469518  6156 raft_consensus.cc:2468] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 0.
I20260709 13:12:58.470300  6047 leader_election.cc:304] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.471141  6204 raft_consensus.cc:2804] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.471457  6204 raft_consensus.cc:493] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.471733  6204 raft_consensus.cc:3060] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.476979  6204 raft_consensus.cc:515] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.478787  6204 leader_election.cc:290] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.479712  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a206890c514360a9bb33671f0e5de8" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:12:58.479645  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a206890c514360a9bb33671f0e5de8" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:12:58.480479  6156 raft_consensus.cc:3060] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.480568  6007 raft_consensus.cc:3060] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.486130  6156 raft_consensus.cc:2468] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:12:58.486575  6007 raft_consensus.cc:2468] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:12:58.487265  6048 leader_election.cc:304] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:12:58.488178  6204 raft_consensus.cc:2804] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.488711  6204 raft_consensus.cc:697] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:12:58.489542  6204 consensus_queue.cc:237] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.497095  5906 catalog_manager.cc:5697] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 0 to 1, leader changed from <none> to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 1 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.502622  6233 raft_consensus.cc:493] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.503170  6233 raft_consensus.cc:515] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:12:58.505231  6233 leader_election.cc:290] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:12:58.505988  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:12:58.506259  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "29c8271267c746bdaf6dedda3f3848ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:12:58.507087  6156 raft_consensus.cc:2393] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29c8271267c746bdaf6dedda3f3848ac in current term 1: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:12:58.508014  5973 leader_election.cc:304] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac; no voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe
I20260709 13:12:58.508663  6233 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.513726  6233 raft_consensus.cc:2749] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.531879  6240 consensus_queue.cc:1048] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.542166  6234 consensus_queue.cc:1048] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.551712  6204 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.564898  6235 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.566370 29280 ts_manager.cc:295] Set tserver state for 29c8271267c746bdaf6dedda3f3848ac to MAINTENANCE_MODE
I20260709 13:12:58.567312 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
I20260709 13:12:58.569851  6233 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.583261  6234 consensus_queue.cc:1048] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:58.599983  6121 consensus_peers.cc:597] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.622030  6233 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:58.632443  6233 consensus_queue.cc:1048] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.647488 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:58.650231 29280 tablet_replica.cc:333] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.651085 29280 raft_consensus.cc:2243] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.651018  6235 consensus_queue.cc:1048] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.651782 29280 raft_consensus.cc:2272] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.658448  6203 consensus_queue.cc:1048] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.681396 29280 tablet_replica.cc:333] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.682489 29280 raft_consensus.cc:2243] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.685700 29280 raft_consensus.cc:2272] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.687450  6235 consensus_queue.cc:1048] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.692435 29280 tablet_replica.cc:333] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.694468  6205 consensus_queue.cc:1048] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:58.695359  6121 consensus_peers.cc:597] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.697974 29280 raft_consensus.cc:2243] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.698731 29280 raft_consensus.cc:2272] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.701529 29280 tablet_replica.cc:333] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.702309 29280 raft_consensus.cc:2243] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.702816 29280 raft_consensus.cc:2272] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.715993 29280 tablet_replica.cc:333] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.717099 29280 raft_consensus.cc:2243] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.717738 29280 raft_consensus.cc:2272] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:58.722458  6047 consensus_peers.cc:597] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.727548 29280 tablet_replica.cc:333] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.728552 29280 raft_consensus.cc:2243] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.729051 29280 raft_consensus.cc:2272] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.731377 29280 tablet_replica.cc:333] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.731962 29280 raft_consensus.cc:2243] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.732475 29280 raft_consensus.cc:2272] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:58.734131  6047 consensus_peers.cc:597] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.735971 29280 tablet_replica.cc:333] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.736768 29280 raft_consensus.cc:2243] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.737258 29280 raft_consensus.cc:2272] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.740334 29280 tablet_replica.cc:333] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.741263 29280 raft_consensus.cc:2243] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:58.742507 29280 raft_consensus.cc:2272] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.745679 29280 tablet_replica.cc:333] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: stopping tablet replica
I20260709 13:12:58.746366 29280 raft_consensus.cc:2243] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:58.747779 29280 raft_consensus.cc:2272] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.773998 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
I20260709 13:12:58.872337  6246 consensus_queue.cc:1048] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:58.886947  6047 consensus_peers.cc:597] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:58.889993  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:58.915740  6121 consensus_peers.cc:597] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:58.976902  6047 consensus_peers.cc:597] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.030632  6121 consensus_peers.cc:597] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.891022  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:00.127537  6286 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
I20260709 13:13:00.128165  6286 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.129876  6286 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:00.130470  6236 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
I20260709 13:13:00.131114  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:13:00.131050  6236 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.132062  6156 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:13:00.133340  6048 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:00.134310  6286 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:00.134344  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:13:00.134774  6286 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
W20260709 13:13:00.134827  6047 leader_election.cc:336] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.135155  6236 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:00.135190  6286 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.137240  6121 leader_election.cc:336] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.140648  6286 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.141712  6081 raft_consensus.cc:2393] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ce2d273c2c0448bbaba951463f22a0b in current term 2: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:13:00.142608  6286 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:00.143899  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:00.144532  6156 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.144604  6123 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b; no voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe
W20260709 13:13:00.146534  6047 leader_election.cc:336] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.149830  6156 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:00.150358  6236 raft_consensus.cc:2749] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.150988  6048 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:13:00.151887  6286 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.152508  6286 raft_consensus.cc:697] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:00.153273  6286 consensus_queue.cc:237] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.160926  5905 catalog_manager.cc:5697] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 1 to 2, leader changed from 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 2 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.183631  6286 raft_consensus.cc:493] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
I20260709 13:13:00.184273  6286 raft_consensus.cc:515] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.185310  6236 raft_consensus.cc:493] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
I20260709 13:13:00.185848  6236 raft_consensus.cc:515] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.186297  6286 leader_election.cc:290] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:00.187539  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b" is_pre_election: true
I20260709 13:13:00.187970  6236 leader_election.cc:290] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:00.188233  6156 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 1.
I20260709 13:13:00.189635  6048 leader_election.cc:304] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:00.189638  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd88c2679a424c1f92ce2541eac8debe" is_pre_election: true
I20260709 13:13:00.190477  6286 raft_consensus.cc:2804] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:00.190948  6047 leader_election.cc:336] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.190970  6286 raft_consensus.cc:493] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29c8271267c746bdaf6dedda3f3848ac)
I20260709 13:13:00.191601  6286 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.192106  6121 leader_election.cc:336] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.197350  6286 raft_consensus.cc:515] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.198290  6081 raft_consensus.cc:2393] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ce2d273c2c0448bbaba951463f22a0b in current term 2: Already voted for candidate fd88c2679a424c1f92ce2541eac8debe in this term.
I20260709 13:13:00.199545  6286 leader_election.cc:290] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:00.200155  6123 leader_election.cc:304] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b; no voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe
I20260709 13:13:00.200685  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081f3098b04d460b82cd3ccf71eae1b7" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:00.201012  6240 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.204668  6047 leader_election.cc:336] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111)
I20260709 13:13:00.208866  6240 raft_consensus.cc:2749] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.260977  6156 raft_consensus.cc:2468] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:00.264389  6048 leader_election.cc:304] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 29c8271267c746bdaf6dedda3f3848ac
I20260709 13:13:00.265964  6286 raft_consensus.cc:2804] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.266654  6286 raft_consensus.cc:697] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:00.268296  6286 consensus_queue.cc:237] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:00.280045  5905 catalog_manager.cc:5697] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 1 to 2, leader changed from 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 2 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:00.283170  6121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111) [suppressed 119 similar messages]
W20260709 13:13:00.476426  5937 debug-util.cc:398] Leaking SignalData structure 0x7b0800008700 after lost signal to thread 29283
W20260709 13:13:00.477984  5937 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6a20 after lost signal to thread 5940
W20260709 13:13:00.479673  5937 debug-util.cc:398] Leaking SignalData structure 0x7b08000a66a0 after lost signal to thread 6107
W20260709 13:13:00.481047  5937 debug-util.cc:398] Leaking SignalData structure 0x7b0800127880 after lost signal to thread 6181
I20260709 13:13:00.613611  6157 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.615336  6239 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:00.635641  6047 consensus_peers.cc:597] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.690338  6157 raft_consensus.cc:1275] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.691813  6286 consensus_queue.cc:1048] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:00.707800  6047 consensus_peers.cc:597] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.892413  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:01.124575  6047 consensus_peers.cc:597] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.236806  6121 consensus_peers.cc:597] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.324132  6121 consensus_peers.cc:597] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.333171  6121 consensus_peers.cc:597] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.385313  6047 consensus_peers.cc:597] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.387653  6121 consensus_peers.cc:597] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.640635  6047 consensus_peers.cc:597] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.762555  6047 consensus_peers.cc:597] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:01.893749  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:02.895058  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:02.986239  6047 consensus_peers.cc:597] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.268262  6047 consensus_peers.cc:597] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.592092  6121 consensus_peers.cc:597] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:03.649050  6121 consensus_peers.cc:597] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:03.755196  6047 consensus_peers.cc:597] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:03.889868 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:03.896381  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:03.898300  6301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:03.899135  6302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:03.901281  6304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:03.902683 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:03.905293 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:03.905534 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:03.905776 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602783905757 us; error 0 us; skew 500 ppm
I20260709 13:13:03.906544 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:13:03.910840  6121 consensus_peers.cc:597] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:03.911237 29280 webserver.cc:533] Webserver started at http://127.28.152.1:39401/ using document root <none> and password file <none>
I20260709 13:13:03.911901 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:03.912099 29280 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:03.916983 29280 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:13:03.921005  6309 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:03.921777 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:03.922082 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "29c8271267c746bdaf6dedda3f3848ac"
format_stamp: "Formatted at 2026-07-09 13:12:56 on dist-test-slave-x7j4"
I20260709 13:13:03.922482 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:03.935822  6121 consensus_peers.cc:597] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:03.945106 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:03.946507 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:03.948088 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:03.951715  6316 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:03.973723  6047 consensus_peers.cc:597] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:03.990020  6047 consensus_peers.cc:597] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:04.004839 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:04.005273 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:13:04.005605 29280 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:04.011036  6316 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.022558  6316 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.023322  6316 tablet_bootstrap.cc:492] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.023941  6316 ts_tablet_manager.cc:1403] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:13:04.026114  6316 raft_consensus.cc:359] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.026580  6316 raft_consensus.cc:740] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.027261  6316 consensus_queue.cc:260] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.029476  6316 ts_tablet_manager.cc:1434] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:04.030236  6316 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.042639  6316 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.043468  6316 tablet_bootstrap.cc:492] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.044020  6316 ts_tablet_manager.cc:1403] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:13:04.044665 29280 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:04.044978 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.035s	sys 0.003s
I20260709 13:13:04.046378  6316 raft_consensus.cc:359] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:13:04.047042  6316 raft_consensus.cc:740] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.047662  6316 consensus_queue.cc:260] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } } peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } }
I20260709 13:13:04.049211  6316 ts_tablet_manager.cc:1434] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:04.049878  6316 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.065431  6316 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.066249  6316 tablet_bootstrap.cc:492] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.066905  6316 ts_tablet_manager.cc:1403] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:13:04.069651  6316 raft_consensus.cc:359] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.070218  6316 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.071005  6316 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.072784  6316 ts_tablet_manager.cc:1434] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:04.073544  6316 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.086043  6316 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.086781  6316 tablet_bootstrap.cc:492] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.087345  6316 ts_tablet_manager.cc:1403] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:13:04.089792  6316 raft_consensus.cc:359] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.090330  6316 raft_consensus.cc:740] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.091126  6316 consensus_queue.cc:260] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.092633  6316 ts_tablet_manager.cc:1434] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:04.093279  6316 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.107213  6316 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.108253  6316 tablet_bootstrap.cc:492] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.108830 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:34235
I20260709 13:13:04.108904  6316 ts_tablet_manager.cc:1403] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:04.108963  6378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:34235 every 8 connection(s)
I20260709 13:13:04.111546  6316 raft_consensus.cc:359] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.112085  6316 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.112756  6316 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.114392  6316 ts_tablet_manager.cc:1434] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:13:04.115386  6316 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
W20260709 13:13:04.120132  6380 tablet.cc:2406] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:04.122087 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.137434  6316 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.142890  6316 tablet_bootstrap.cc:492] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.143391  6316 ts_tablet_manager.cc:1403] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 13:13:04.146399  6316 raft_consensus.cc:359] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.147317  6316 raft_consensus.cc:740] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.148043  6316 consensus_queue.cc:260] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.150089  6316 ts_tablet_manager.cc:1434] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:04.150894  6316 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.159741  6379 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38723
I20260709 13:13:04.160526  6379 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:04.161538  6379 heartbeater.cc:507] Master 127.28.152.62:38723 requested a full tablet report, sending...
I20260709 13:13:04.166265  6316 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.167137  6316 tablet_bootstrap.cc:492] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.167806  6316 ts_tablet_manager.cc:1403] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:13:04.168877  5905 ts_manager.cc:194] Re-registered known tserver with Master: 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235)
I20260709 13:13:04.169891  6081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:04.170449  6081 raft_consensus.cc:606] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:04.170403  6316 raft_consensus.cc:359] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.171375  6316 raft_consensus.cc:740] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.172119  6316 consensus_queue.cc:260] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.173518  6081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:04.174068  6081 raft_consensus.cc:606] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:04.174252  6316 ts_tablet_manager.cc:1434] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:04.175117  6316 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.175173 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:04.175848 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:04.176474 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.181635  5905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55964
I20260709 13:13:04.186905  6379 heartbeater.cc:499] Master 127.28.152.62:38723 was elected leader, sending a full tablet report...
I20260709 13:13:04.192633  6316 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.193560  6316 tablet_bootstrap.cc:492] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.194198  6316 ts_tablet_manager.cc:1403] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:13:04.196126  6316 raft_consensus.cc:359] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.196630  6316 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.197156  6316 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.198501  6316 ts_tablet_manager.cc:1434] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:04.199162  6316 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.210004  6316 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.210772  6316 tablet_bootstrap.cc:492] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.211279  6316 ts_tablet_manager.cc:1403] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:13:04.212986  6316 raft_consensus.cc:359] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.213485  6316 raft_consensus.cc:740] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.213949  6316 consensus_queue.cc:260] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.215725  6316 ts_tablet_manager.cc:1434] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:13:04.216491  6316 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap starting.
I20260709 13:13:04.228585  6316 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.229575  6316 tablet_bootstrap.cc:492] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Bootstrap complete.
I20260709 13:13:04.230156  6316 ts_tablet_manager.cc:1403] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:13:04.232069  6316 raft_consensus.cc:359] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.232606  6316 raft_consensus.cc:740] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c8271267c746bdaf6dedda3f3848ac, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.233201  6316 consensus_queue.cc:260] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.235087  6316 ts_tablet_manager.cc:1434] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:04.279428  6300 raft_consensus.cc:993] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:04.279888  6300 raft_consensus.cc:1081] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:04.281338  6157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:04.281863  6157 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.282160  6157 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.288309  6157 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.290048  6157 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 3 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:04.291188  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:04.291886  6081 raft_consensus.cc:3055] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:04.292207  6081 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:04.292968  6081 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.293980  6081 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.298986  6352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:04.299573  6352 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.300187  6081 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 3.
I20260709 13:13:04.301585  6123 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce2d273c2c0448bbaba951463f22a0b, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:04.302400  6240 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.303623  6240 raft_consensus.cc:697] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:04.304648  6240 consensus_queue.cc:237] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.306849  6352 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 3.
I20260709 13:13:04.313306  5905 catalog_manager.cc:5697] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 2 to 3, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 3 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.498047  6352 raft_consensus.cc:3060] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.573840  6393 raft_consensus.cc:993] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:04.574319  6300 raft_consensus.cc:1081] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:04.575829  6157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:04.576313  6157 raft_consensus.cc:493] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.576607  6157 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.582683  6157 raft_consensus.cc:515] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.584446  6157 leader_election.cc:290] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:04.585289  6352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:04.585573  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:04.585973  6352 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.586169  6081 raft_consensus.cc:3055] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:04.586539  6081 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:04.587314  6081 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.588366  6081 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.591801  6352 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:04.592885  6121 leader_election.cc:304] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:13:04.593793  6394 raft_consensus.cc:2804] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.593998  6081 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:04.594197  6394 raft_consensus.cc:697] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:04.595290  6394 consensus_queue.cc:237] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:04.601857  5905 catalog_manager.cc:5697] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 1 to 2, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 2 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.792481  6352 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.793804  6240 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.804210  6081 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.805521  6394 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:04.897605  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:05.079507  6352 raft_consensus.cc:1275] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.080928  6240 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:05.090499  6082 raft_consensus.cc:1275] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:05.095439  6394 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:05.187278 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:05.203917  6157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
mode: GRACEFUL
new_leader_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:34824
I20260709 13:13:05.204396  6157 raft_consensus.cc:606] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Received request to transfer leadership to TS fd88c2679a424c1f92ce2541eac8debe
I20260709 13:13:05.206729  6157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
mode: GRACEFUL
new_leader_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:34824
I20260709 13:13:05.207131  6157 raft_consensus.cc:606] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Received request to transfer leadership to TS fd88c2679a424c1f92ce2541eac8debe
I20260709 13:13:05.208045 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:05.208492 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:05.209059 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:05.236917  6407 raft_consensus.cc:993] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: : Instructing follower fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:05.237509  6394 raft_consensus.cc:1081] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Signalling peer fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:05.239099  6082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:52198
I20260709 13:13:05.239629  6082 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.240022  6082 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.245489  6082 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.247175  6082 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 4 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:05.247879  6352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:05.248201  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:05.248502  6352 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.248838  6157 raft_consensus.cc:3055] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:05.249140  6157 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:05.249828  6157 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.250813  6157 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:05.254319  6352 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 4.
I20260709 13:13:05.255488  6047 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:05.255743  6157 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 4.
I20260709 13:13:05.256511  6405 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:05.256930  6405 raft_consensus.cc:697] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:05.257655  6405 consensus_queue.cc:237] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.263960  5905 catalog_manager.cc:5697] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 3 to 4, leader changed from 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 4 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.618166  6407 raft_consensus.cc:993] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: : Instructing follower fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:05.618682  6407 raft_consensus.cc:1081] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Signalling peer fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:05.620277  6082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:52198
I20260709 13:13:05.620759  6082 raft_consensus.cc:493] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.621078  6082 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.626374  6082 raft_consensus.cc:515] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.628407  6082 leader_election.cc:290] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 3 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:05.629381  6352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:05.629545  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b60dea31f6493c921066ad71214a11" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:05.630039  6352 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.630081  6156 raft_consensus.cc:3055] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:05.630650  6156 raft_consensus.cc:740] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:05.631532  6156 consensus_queue.cc:260] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.632571  6156 raft_consensus.cc:3060] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:05.636659  6352 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 3.
I20260709 13:13:05.637804  6047 leader_election.cc:304] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:05.638504  6156 raft_consensus.cc:2468] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 3.
I20260709 13:13:05.638528  6300 raft_consensus.cc:2804] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:05.639199  6300 raft_consensus.cc:697] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 3 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:05.640059  6300 consensus_queue.cc:237] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:05.645856  5905 catalog_manager.cc:5697] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 2 to 3, leader changed from 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 3 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.655416  6156 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 4 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:05.656729  6405 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:05.665169  6352 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 4 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:05.666503  6300 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:05.898772  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:06.020843  6157 raft_consensus.cc:1275] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:06.022287  6300 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.030176  6351 raft_consensus.cc:1275] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:06.031721  6420 consensus_queue.cc:1048] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.215143 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:06.222463  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe60224722f403a9bceff668326dac9"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:06.223068  6082 raft_consensus.cc:606] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:06.225829  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:06.226354  6082 raft_consensus.cc:606] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:06.227479 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:06.227955 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:06.228508 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:06.376842  6420 raft_consensus.cc:993] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:06.377475  6420 raft_consensus.cc:1081] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:06.379172  6156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe60224722f403a9bceff668326dac9"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:06.379611  6156 raft_consensus.cc:493] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:06.379873  6156 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.385025  6156 raft_consensus.cc:515] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.386787  6156 leader_election.cc:290] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:06.387650  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:06.387826  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe60224722f403a9bceff668326dac9" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:06.388463  6351 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.388507  6082 raft_consensus.cc:3055] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:06.388931  6082 raft_consensus.cc:740] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:06.389748  6082 consensus_queue.cc:260] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.390854  6082 raft_consensus.cc:3060] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.394680  6351 raft_consensus.cc:2468] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:06.395954  6121 leader_election.cc:304] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:13:06.395969  6082 raft_consensus.cc:2468] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:06.396924  6407 raft_consensus.cc:2804] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:06.397487  6407 raft_consensus.cc:697] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:06.398403  6407 consensus_queue.cc:237] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.405733  5905 catalog_manager.cc:5697] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 1 to 2, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 2 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.656772  6420 raft_consensus.cc:993] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:06.657248  6424 raft_consensus.cc:1081] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:06.658684  6156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:06.659215  6156 raft_consensus.cc:493] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:06.659559  6156 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.665122  6156 raft_consensus.cc:515] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.667093  6156 leader_election.cc:290] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:06.667752  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:06.669004  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3706a0b71b6460fb2eff3cc97110566" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:06.669404  6351 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.669659  6082 raft_consensus.cc:3055] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:06.670053  6082 raft_consensus.cc:740] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:06.670969  6082 consensus_queue.cc:260] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.672170  6082 raft_consensus.cc:3060] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.675168  6351 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:06.676250  6121 leader_election.cc:304] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:13:06.676924  6407 raft_consensus.cc:2804] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:06.677423  6407 raft_consensus.cc:697] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:06.677572  6082 raft_consensus.cc:2468] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 2.
I20260709 13:13:06.678403  6407 consensus_queue.cc:237] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:06.685262  5905 catalog_manager.cc:5697] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 1 to 2, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 2 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:06.899808  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:06.992975  6351 raft_consensus.cc:1275] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:06.994540  6426 consensus_queue.cc:1048] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:06.998895  6082 raft_consensus.cc:1275] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.000412  6407 consensus_queue.cc:1048] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.189836  6351 raft_consensus.cc:1275] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.191249  6426 consensus_queue.cc:1048] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.199600  6082 raft_consensus.cc:1275] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.201572  6407 consensus_queue.cc:1048] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.234766 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:07.241864  6156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
mode: GRACEFUL
new_leader_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:34824
I20260709 13:13:07.242424  6156 raft_consensus.cc:606] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Received request to transfer leadership to TS fd88c2679a424c1f92ce2541eac8debe
I20260709 13:13:07.245014  6156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
mode: GRACEFUL
new_leader_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:34824
I20260709 13:13:07.245486  6156 raft_consensus.cc:606] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Received request to transfer leadership to TS fd88c2679a424c1f92ce2541eac8debe
I20260709 13:13:07.246495 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:07.246950 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:07.247514 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:07.265944  6426 raft_consensus.cc:993] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: : Instructing follower fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:07.266469  6407 raft_consensus.cc:1081] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Signalling peer fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:07.268093  6082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:52198
I20260709 13:13:07.268591  6082 raft_consensus.cc:493] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.268896  6082 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.275691  6082 raft_consensus.cc:515] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.277313  6082 leader_election.cc:290] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:07.278337  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:07.278335  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed092ba0604e48bb95c8c81962ba7f40" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:07.279089  6351 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.279155  6156 raft_consensus.cc:3055] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:07.279578  6156 raft_consensus.cc:740] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:07.280362  6156 consensus_queue.cc:260] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.281572  6156 raft_consensus.cc:3060] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.284840  6351 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:07.285835  6047 leader_election.cc:304] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:07.286509  6424 raft_consensus.cc:2804] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.287436  6156 raft_consensus.cc:2468] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:07.287652  6424 raft_consensus.cc:697] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:07.288703  6424 consensus_queue.cc:237] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.296211  5906 catalog_manager.cc:5697] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 1 to 2, leader changed from 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 2 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.312809  6426 raft_consensus.cc:993] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: : Instructing follower fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:07.313319  6407 raft_consensus.cc:1081] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Signalling peer fd88c2679a424c1f92ce2541eac8debe to start an election
I20260709 13:13:07.314677  6082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
 from {username='slave'} at 127.0.0.1:52198
I20260709 13:13:07.315167  6082 raft_consensus.cc:493] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.315443  6082 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.320174  6082 raft_consensus.cc:515] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.321622  6082 leader_election.cc:290] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3:37265)
I20260709 13:13:07.322547  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:07.322793  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "fd88c2679a424c1f92ce2541eac8debe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
I20260709 13:13:07.323225  6351 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.323364  6156 raft_consensus.cc:3055] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:07.323736  6156 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:07.324539  6156 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.325502  6156 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.328562  6351 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:07.329596  6047 leader_election.cc:304] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, fd88c2679a424c1f92ce2541eac8debe; no voters: 
I20260709 13:13:07.330317  6424 raft_consensus.cc:2804] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.330467  6156 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd88c2679a424c1f92ce2541eac8debe in term 2.
I20260709 13:13:07.330749  6424 raft_consensus.cc:697] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Leader. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:07.331791  6424 consensus_queue.cc:237] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:07.338238  5906 catalog_manager.cc:5697] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe reported cstate change: term changed from 1 to 2, leader changed from 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3) to fd88c2679a424c1f92ce2541eac8debe (127.28.152.2). New cstate: current_term: 2 leader_uuid: "fd88c2679a424c1f92ce2541eac8debe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.763610  6157 raft_consensus.cc:1275] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.764845  6424 consensus_queue.cc:1048] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.774235  6351 raft_consensus.cc:1275] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.775548  6424 consensus_queue.cc:1048] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.813179  6157 raft_consensus.cc:1275] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.814386  6424 consensus_queue.cc:1048] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.823249  6351 raft_consensus.cc:1275] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Refusing update from remote peer fd88c2679a424c1f92ce2541eac8debe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.825033  6441 consensus_queue.cc:1048] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.900768  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:08.253722 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:08.262861  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:08.263386  6082 raft_consensus.cc:606] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:08.265878  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52"
dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
mode: GRACEFUL
new_leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:13:08.266407  6082 raft_consensus.cc:606] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Received request to transfer leadership to TS 3ce2d273c2c0448bbaba951463f22a0b
I20260709 13:13:08.267365 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:08.267827 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:08.268373 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:08.366386  6424 raft_consensus.cc:993] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:08.366968  6441 raft_consensus.cc:1081] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:08.368405  6157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:08.368877  6157 raft_consensus.cc:493] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.369246  6157 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.375635  6157 raft_consensus.cc:515] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.377058  6157 leader_election.cc:290] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 3 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:08.377861  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:08.378093  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9f90927861340b7bfd6eb14a7ee4d52" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:08.378620  6351 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.378774  6082 raft_consensus.cc:3055] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:08.379173  6082 raft_consensus.cc:740] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:08.379776  6082 consensus_queue.cc:260] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.380744  6082 raft_consensus.cc:3060] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:08.383868  6351 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 3.
I20260709 13:13:08.384954  6121 leader_election.cc:304] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:13:08.385174  6082 raft_consensus.cc:2468] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 3.
I20260709 13:13:08.385591  6426 raft_consensus.cc:2804] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:08.386559  6426 raft_consensus.cc:697] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:08.387423  6426 consensus_queue.cc:237] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.393467  5905 catalog_manager.cc:5697] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 2 to 3, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 3 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.784034  6455 raft_consensus.cc:993] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: : Instructing follower 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:08.784600  6441 raft_consensus.cc:1081] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 LEADER]: Signalling peer 3ce2d273c2c0448bbaba951463f22a0b to start an election
I20260709 13:13:08.785903  6157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb"
dest_uuid: "3ce2d273c2c0448bbaba951463f22a0b"
 from {username='slave'} at 127.0.0.1:42680
I20260709 13:13:08.786358  6157 raft_consensus.cc:493] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:08.786629  6157 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.791610  6157 raft_consensus.cc:515] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.792965  6157 leader_election.cc:290] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 5 election: Requested vote from peers 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235), fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781)
I20260709 13:13:08.793759  6351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "29c8271267c746bdaf6dedda3f3848ac"
I20260709 13:13:08.793900  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e99f76a1e243908c167c4bdb9923eb" candidate_uuid: "3ce2d273c2c0448bbaba951463f22a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fd88c2679a424c1f92ce2541eac8debe"
I20260709 13:13:08.794518  6351 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.794562  6082 raft_consensus.cc:3055] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:08.795033  6082 raft_consensus.cc:740] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd88c2679a424c1f92ce2541eac8debe, State: Running, Role: LEADER
I20260709 13:13:08.795778  6082 consensus_queue.cc:260] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.796941  6082 raft_consensus.cc:3060] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:08.801344  6351 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 5.
I20260709 13:13:08.802451  6121 leader_election.cc:304] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c8271267c746bdaf6dedda3f3848ac, 3ce2d273c2c0448bbaba951463f22a0b; no voters: 
I20260709 13:13:08.803063  6082 raft_consensus.cc:2468] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce2d273c2c0448bbaba951463f22a0b in term 5.
I20260709 13:13:08.803103  6426 raft_consensus.cc:2804] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:08.803798  6426 raft_consensus.cc:697] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 5 LEADER]: Becoming Leader. State: Replica: 3ce2d273c2c0448bbaba951463f22a0b, State: Running, Role: LEADER
I20260709 13:13:08.804566  6426 consensus_queue.cc:237] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } }
I20260709 13:13:08.811071  5905 catalog_manager.cc:5697] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b reported cstate change: term changed from 4 to 5, leader changed from fd88c2679a424c1f92ce2541eac8debe (127.28.152.2) to 3ce2d273c2c0448bbaba951463f22a0b (127.28.152.3). New cstate: current_term: 5 leader_uuid: "3ce2d273c2c0448bbaba951463f22a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ce2d273c2c0448bbaba951463f22a0b" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37265 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:08.901679  5954 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:08.961378  6082 raft_consensus.cc:1275] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:08.962803  6426 consensus_queue.cc:1048] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:08.975013  6351 raft_consensus.cc:1275] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:08.977841  6457 consensus_queue.cc:1048] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c8271267c746bdaf6dedda3f3848ac" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.274680 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:09.305603 29280 tablet_server.cc:179] TabletServer@127.28.152.1:34235 shutting down...
W20260709 13:13:09.321925  6121 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 77 similar messages]
W20260709 13:13:09.327692  6121 consensus_peers.cc:597] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.335984  6047 consensus_peers.cc:597] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.345392 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.346170 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.346925 29280 raft_consensus.cc:2243] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.347406 29280 raft_consensus.cc:2272] T 081f3098b04d460b82cd3ccf71eae1b7 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.349427 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.349979 29280 raft_consensus.cc:2243] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.350406 29280 raft_consensus.cc:2272] T f3706a0b71b6460fb2eff3cc97110566 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.352201 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.352715 29280 raft_consensus.cc:2243] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.353076 29280 raft_consensus.cc:2272] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.354856 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.355473 29280 raft_consensus.cc:2243] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.355895 29280 raft_consensus.cc:2272] T ed092ba0604e48bb95c8c81962ba7f40 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.357589 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.358091 29280 raft_consensus.cc:2243] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.358490 29280 raft_consensus.cc:2272] T ebe60224722f403a9bceff668326dac9 P 29c8271267c746bdaf6dedda3f3848ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.360378 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.360877 29280 raft_consensus.cc:2243] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.361291 29280 raft_consensus.cc:2272] T 91e99f76a1e243908c167c4bdb9923eb P 29c8271267c746bdaf6dedda3f3848ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.363174 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.363670 29280 raft_consensus.cc:2243] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.364068 29280 raft_consensus.cc:2272] T a0b60dea31f6493c921066ad71214a11 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.365772 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.366257 29280 raft_consensus.cc:2243] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.366636 29280 raft_consensus.cc:2272] T 5106ce075ced482e9131d13c987b5ce1 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.368405 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.368880 29280 raft_consensus.cc:2243] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.369298 29280 raft_consensus.cc:2272] T a9f90927861340b7bfd6eb14a7ee4d52 P 29c8271267c746bdaf6dedda3f3848ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.371519 29280 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:09.372036 29280 raft_consensus.cc:2243] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.372437 29280 raft_consensus.cc:2272] T 95a206890c514360a9bb33671f0e5de8 P 29c8271267c746bdaf6dedda3f3848ac [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.382020  6121 consensus_peers.cc:597] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.386615  6082 raft_consensus.cc:1275] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 5 FOLLOWER]: Refusing update from remote peer 3ce2d273c2c0448bbaba951463f22a0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:09.388298  6457 consensus_queue.cc:1048] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd88c2679a424c1f92ce2541eac8debe" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 32781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:09.405683 29280 tablet_server.cc:196] TabletServer@127.28.152.1:34235 shutdown complete.
W20260709 13:13:09.408200  6121 consensus_peers.cc:597] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.409821  6047 consensus_peers.cc:597] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.426095 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
W20260709 13:13:09.437346  6047 consensus_peers.cc:597] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.454331 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.455102 29280 tablet_replica.cc:333] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.455852 29280 raft_consensus.cc:2243] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.456611 29280 raft_consensus.cc:2272] T 95a206890c514360a9bb33671f0e5de8 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.458940 29280 tablet_replica.cc:333] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.459510 29280 raft_consensus.cc:2243] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.459957 29280 raft_consensus.cc:2272] T a9f90927861340b7bfd6eb14a7ee4d52 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.463349 29280 tablet_replica.cc:333] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.463929 29280 raft_consensus.cc:2243] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.464288 29280 raft_consensus.cc:2272] T f3706a0b71b6460fb2eff3cc97110566 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.466374 29280 tablet_replica.cc:333] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.466889 29280 raft_consensus.cc:2243] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.467568 29280 raft_consensus.cc:2272] T 081f3098b04d460b82cd3ccf71eae1b7 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.470353 29280 tablet_replica.cc:333] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.471107 29280 raft_consensus.cc:2243] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.471956 29280 raft_consensus.cc:2272] T a0b60dea31f6493c921066ad71214a11 P fd88c2679a424c1f92ce2541eac8debe [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.472258  6123 consensus_peers.cc:597] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781): Couldn't send request to peer fd88c2679a424c1f92ce2541eac8debe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.474617 29280 tablet_replica.cc:333] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.475422 29280 raft_consensus.cc:2243] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.476056 29280 raft_consensus.cc:2272] T 5106ce075ced482e9131d13c987b5ce1 P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.478343 29280 tablet_replica.cc:333] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.479002 29280 raft_consensus.cc:2243] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.479494 29280 raft_consensus.cc:2272] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P fd88c2679a424c1f92ce2541eac8debe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.481698 29280 tablet_replica.cc:333] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.482218 29280 raft_consensus.cc:2243] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.483042 29280 raft_consensus.cc:2272] T ed092ba0604e48bb95c8c81962ba7f40 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.485561 29280 tablet_replica.cc:333] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.486058 29280 raft_consensus.cc:2243] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.486478 29280 raft_consensus.cc:2272] T ebe60224722f403a9bceff668326dac9 P fd88c2679a424c1f92ce2541eac8debe [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.488329  6123 consensus_peers.cc:597] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781): Couldn't send request to peer fd88c2679a424c1f92ce2541eac8debe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.489044 29280 tablet_replica.cc:333] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe: stopping tablet replica
I20260709 13:13:09.489701 29280 raft_consensus.cc:2243] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.490131 29280 raft_consensus.cc:2272] T 91e99f76a1e243908c167c4bdb9923eb P fd88c2679a424c1f92ce2541eac8debe [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.504041  6123 consensus_peers.cc:597] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781): Couldn't send request to peer fd88c2679a424c1f92ce2541eac8debe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.513023  6121 consensus_peers.cc:597] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.517402 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:13:09.541364 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
W20260709 13:13:09.548930  6123 consensus_peers.cc:597] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer fd88c2679a424c1f92ce2541eac8debe (127.28.152.2:32781): Couldn't send request to peer fd88c2679a424c1f92ce2541eac8debe. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:32781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.568586  6121 consensus_peers.cc:597] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b -> Peer 29c8271267c746bdaf6dedda3f3848ac (127.28.152.1:34235): Couldn't send request to peer 29c8271267c746bdaf6dedda3f3848ac. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:34235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.572319 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.573164 29280 tablet_replica.cc:333] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.573808 29280 raft_consensus.cc:2243] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.574326 29280 raft_consensus.cc:2272] T 95a206890c514360a9bb33671f0e5de8 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.576572 29280 tablet_replica.cc:333] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.577263 29280 raft_consensus.cc:2243] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.578140 29280 raft_consensus.cc:2272] T a9f90927861340b7bfd6eb14a7ee4d52 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.580977 29280 tablet_replica.cc:333] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.581534 29280 raft_consensus.cc:2243] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.582276 29280 raft_consensus.cc:2272] T ebe60224722f403a9bceff668326dac9 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.584403 29280 tablet_replica.cc:333] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.584928 29280 raft_consensus.cc:2243] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.585656 29280 raft_consensus.cc:2272] T 91e99f76a1e243908c167c4bdb9923eb P 3ce2d273c2c0448bbaba951463f22a0b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.588019 29280 tablet_replica.cc:333] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.588672 29280 raft_consensus.cc:2243] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.589123 29280 raft_consensus.cc:2272] T 081f3098b04d460b82cd3ccf71eae1b7 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.591125 29280 tablet_replica.cc:333] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.591646 29280 raft_consensus.cc:2243] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.592419 29280 raft_consensus.cc:2272] T 4f7fcdc58ebd4ba0916583a4cf92fc8f P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.594424 29280 tablet_replica.cc:333] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.594965 29280 raft_consensus.cc:2243] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.595357 29280 raft_consensus.cc:2272] T ed092ba0604e48bb95c8c81962ba7f40 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.597466 29280 tablet_replica.cc:333] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.598006 29280 raft_consensus.cc:2243] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.598780 29280 raft_consensus.cc:2272] T f3706a0b71b6460fb2eff3cc97110566 P 3ce2d273c2c0448bbaba951463f22a0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.600749 29280 tablet_replica.cc:333] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.601230 29280 raft_consensus.cc:2243] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.601631 29280 raft_consensus.cc:2272] T a0b60dea31f6493c921066ad71214a11 P 3ce2d273c2c0448bbaba951463f22a0b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.603472 29280 tablet_replica.cc:333] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b: stopping tablet replica
I20260709 13:13:09.603914 29280 raft_consensus.cc:2243] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.604671 29280 raft_consensus.cc:2272] T 5106ce075ced482e9131d13c987b5ce1 P 3ce2d273c2c0448bbaba951463f22a0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.635613 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:13:09.657274 29280 master.cc:562] Master@127.28.152.62:38723 shutting down...
I20260709 13:13:09.685355 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.685894 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.686226 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 22378f1879414a7bb71de381cfc0abfa: stopping tablet replica
I20260709 13:13:09.723053 29280 master.cc:584] Master@127.28.152.62:38723 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13012 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:09.767938 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:41405
I20260709 13:13:09.769044 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:09.774065  6478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.774824  6477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.775674  6480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:09.776300 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:09.777287 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:09.777483 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:09.777674 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602789777640 us; error 0 us; skew 500 ppm
I20260709 13:13:09.778219 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:09.780491 29280 webserver.cc:533] Webserver started at http://127.28.152.62:34935/ using document root <none> and password file <none>
I20260709 13:13:09.780987 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:09.781184 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:09.781471 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:09.782549 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "e3f5faa0962744a5b714f40ce38992a7"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-x7j4"
I20260709 13:13:09.786971 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:09.790234  6485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:09.791062 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:09.791364 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "e3f5faa0962744a5b714f40ce38992a7"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-x7j4"
I20260709 13:13:09.791656 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:09.808651 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:09.809873 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:09.849305 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:41405
I20260709 13:13:09.849428  6536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:41405 every 8 connection(s)
I20260709 13:13:09.853219  6537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:09.864331  6537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7: Bootstrap starting.
I20260709 13:13:09.869204  6537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:09.873327  6537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7: No bootstrap required, opened a new log
I20260709 13:13:09.875562  6537 raft_consensus.cc:359] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER }
I20260709 13:13:09.875926  6537 raft_consensus.cc:385] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:09.876106  6537 raft_consensus.cc:740] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f5faa0962744a5b714f40ce38992a7, State: Initialized, Role: FOLLOWER
I20260709 13:13:09.876595  6537 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER }
I20260709 13:13:09.876999  6537 raft_consensus.cc:399] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:09.877183  6537 raft_consensus.cc:493] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:09.877393  6537 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:09.881760  6537 raft_consensus.cc:515] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER }
I20260709 13:13:09.882215  6537 leader_election.cc:304] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3f5faa0962744a5b714f40ce38992a7; no voters: 
I20260709 13:13:09.883410  6537 leader_election.cc:290] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:09.883836  6540 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:09.885208  6540 raft_consensus.cc:697] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 1 LEADER]: Becoming Leader. State: Replica: e3f5faa0962744a5b714f40ce38992a7, State: Running, Role: LEADER
I20260709 13:13:09.885885  6540 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER }
I20260709 13:13:09.886241  6537 sys_catalog.cc:565] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:09.890974  6542 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f5faa0962744a5b714f40ce38992a7. Latest consensus state: current_term: 1 leader_uuid: "e3f5faa0962744a5b714f40ce38992a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER } }
I20260709 13:13:09.891707  6542 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:09.892509  6541 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3f5faa0962744a5b714f40ce38992a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3f5faa0962744a5b714f40ce38992a7" member_type: VOTER } }
I20260709 13:13:09.893332  6541 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:09.895032  6549 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:09.902617  6549 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:09.903615 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:09.911291  6549 catalog_manager.cc:1383] Generated new cluster ID: baf47e9c1ddf48b8ae0f0a1e745751d6
I20260709 13:13:09.911592  6549 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:09.939090  6549 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:09.940448  6549 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:09.954066  6549 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7: Generated new TSK 0
I20260709 13:13:09.954746  6549 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:09.970456 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:09.976476  6558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.977428  6559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.979064  6561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:09.979861 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:09.981115 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:09.981331 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:09.981514 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602789981495 us; error 0 us; skew 500 ppm
I20260709 13:13:09.982084 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:09.984418 29280 webserver.cc:533] Webserver started at http://127.28.152.1:36367/ using document root <none> and password file <none>
I20260709 13:13:09.984907 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:09.985112 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:09.985426 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:09.986524 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "75984cfd728e40fda12c61d3743c2e31"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-x7j4"
I20260709 13:13:09.991264 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:09.994663  6566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:09.995548 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:09.995872 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "75984cfd728e40fda12c61d3743c2e31"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-x7j4"
I20260709 13:13:09.996201 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.023010 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.024235 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.025779 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.027999 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.028247 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.028483 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.028650 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.069207 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:34647
I20260709 13:13:10.069314  6628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:34647 every 8 connection(s)
I20260709 13:13:10.074427 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:10.081271  6633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.083148  6634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.084857  6636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:10.086614 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:10.086921  6629 heartbeater.cc:344] Connected to a master server at 127.28.152.62:41405
I20260709 13:13:10.087378  6629 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.087882 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:10.088203 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:10.088150  6629 heartbeater.cc:507] Master 127.28.152.62:41405 requested a full tablet report, sending...
I20260709 13:13:10.088672 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602790088626 us; error 0 us; skew 500 ppm
I20260709 13:13:10.089455 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:10.091059  6502 ts_manager.cc:194] Registered new tserver with Master: 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647)
I20260709 13:13:10.092437 29280 webserver.cc:533] Webserver started at http://127.28.152.2:42633/ using document root <none> and password file <none>
I20260709 13:13:10.093221 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:10.093482 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:10.093801 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:10.093988  6502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57960
I20260709 13:13:10.095427 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "8f41f186312c44eb8ae01eaad17a987e"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-x7j4"
I20260709 13:13:10.100170 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:10.103647  6641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.104334 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:10.104632 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "8f41f186312c44eb8ae01eaad17a987e"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-x7j4"
I20260709 13:13:10.104930 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.119149 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.120388 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.121857 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.124073 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.124346 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.124594 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.124773 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.164124 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:42121
I20260709 13:13:10.164228  6703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:42121 every 8 connection(s)
I20260709 13:13:10.168872 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:10.176357  6707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.178717  6710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.178987  6708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:10.179765 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:10.180837 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:10.181098 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:10.181340 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602790181296 us; error 0 us; skew 500 ppm
I20260709 13:13:10.181830  6704 heartbeater.cc:344] Connected to a master server at 127.28.152.62:41405
I20260709 13:13:10.181978 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:10.182266  6704 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.183068  6704 heartbeater.cc:507] Master 127.28.152.62:41405 requested a full tablet report, sending...
I20260709 13:13:10.184828 29280 webserver.cc:533] Webserver started at http://127.28.152.3:46733/ using document root <none> and password file <none>
I20260709 13:13:10.185207  6502 ts_manager.cc:194] Registered new tserver with Master: 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121)
I20260709 13:13:10.185497 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:10.185793 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:10.186103 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:10.187081  6502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57970
I20260709 13:13:10.187677 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "6784047074b34e018a7b2e1aba5e68c7"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-x7j4"
I20260709 13:13:10.192224 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:10.195457  6715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.196326 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:10.196574 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "6784047074b34e018a7b2e1aba5e68c7"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-x7j4"
I20260709 13:13:10.196797 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.212095 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.213212 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.214529 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.216676 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.216856 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.217135 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.217291 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.257026 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:37519
I20260709 13:13:10.257135  6777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:37519 every 8 connection(s)
I20260709 13:13:10.303714  6778 heartbeater.cc:344] Connected to a master server at 127.28.152.62:41405
I20260709 13:13:10.304442  6778 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.305510  6778 heartbeater.cc:507] Master 127.28.152.62:41405 requested a full tablet report, sending...
I20260709 13:13:10.308184  6502 ts_manager.cc:194] Registered new tserver with Master: 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:10.308344 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.048299572s
I20260709 13:13:10.310372  6502 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57972
I20260709 13:13:10.338249  6502 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57976:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:10.340744  6502 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:10.404932  6743 tablet_service.cc:1511] Processing CreateTablet for tablet ed1bd044d9794d8ea45a198d35c01a5d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.405206  6742 tablet_service.cc:1511] Processing CreateTablet for tablet 82c96f09c4f045c2820c7e60a5f93f32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.407021  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1bd044d9794d8ea45a198d35c01a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.407833  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c96f09c4f045c2820c7e60a5f93f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.413544  6669 tablet_service.cc:1511] Processing CreateTablet for tablet ed1bd044d9794d8ea45a198d35c01a5d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.415499  6669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1bd044d9794d8ea45a198d35c01a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.418778  6594 tablet_service.cc:1511] Processing CreateTablet for tablet ed1bd044d9794d8ea45a198d35c01a5d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.419034  6593 tablet_service.cc:1511] Processing CreateTablet for tablet 82c96f09c4f045c2820c7e60a5f93f32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.420621  6594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1bd044d9794d8ea45a198d35c01a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.421334  6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c96f09c4f045c2820c7e60a5f93f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.417244  6668 tablet_service.cc:1511] Processing CreateTablet for tablet 82c96f09c4f045c2820c7e60a5f93f32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f319a249e51347449d49f5cfbe3ba33e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.423547  6668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c96f09c4f045c2820c7e60a5f93f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.456691  6795 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: Bootstrap starting.
I20260709 13:13:10.462028  6794 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: Bootstrap starting.
I20260709 13:13:10.463626  6796 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: Bootstrap starting.
I20260709 13:13:10.464958  6795 tablet_bootstrap.cc:654] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.470187  6796 tablet_bootstrap.cc:654] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.470602  6794 tablet_bootstrap.cc:654] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.472978  6795 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: No bootstrap required, opened a new log
I20260709 13:13:10.473711  6795 ts_tablet_manager.cc:1403] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:13:10.475641  6796 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: No bootstrap required, opened a new log
I20260709 13:13:10.476187  6796 ts_tablet_manager.cc:1403] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 13:13:10.477591  6794 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: No bootstrap required, opened a new log
I20260709 13:13:10.478406  6794 ts_tablet_manager.cc:1403] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.012s
I20260709 13:13:10.477591  6795 raft_consensus.cc:359] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.478902  6795 raft_consensus.cc:385] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.478782  6796 raft_consensus.cc:359] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.479542  6796 raft_consensus.cc:385] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.479363  6795 raft_consensus.cc:740] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.479856  6796 raft_consensus.cc:740] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.480451  6795 consensus_queue.cc:260] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.480789  6796 consensus_queue.cc:260] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.481606  6794 raft_consensus.cc:359] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.482324  6794 raft_consensus.cc:385] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.482743  6794 raft_consensus.cc:740] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784047074b34e018a7b2e1aba5e68c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.483312  6629 heartbeater.cc:499] Master 127.28.152.62:41405 was elected leader, sending a full tablet report...
I20260709 13:13:10.483742  6794 consensus_queue.cc:260] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.486012  6795 ts_tablet_manager.cc:1434] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:13:10.487692  6795 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: Bootstrap starting.
I20260709 13:13:10.490207  6796 ts_tablet_manager.cc:1434] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:13:10.491325  6704 heartbeater.cc:499] Master 127.28.152.62:41405 was elected leader, sending a full tablet report...
I20260709 13:13:10.491647  6796 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: Bootstrap starting.
I20260709 13:13:10.495488  6795 tablet_bootstrap.cc:654] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.499934  6796 tablet_bootstrap.cc:654] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.506939  6778 heartbeater.cc:499] Master 127.28.152.62:41405 was elected leader, sending a full tablet report...
I20260709 13:13:10.507536  6794 ts_tablet_manager.cc:1434] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: Time spent starting tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 13:13:10.508675  6794 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: Bootstrap starting.
I20260709 13:13:10.515635  6794 tablet_bootstrap.cc:654] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.516988  6796 tablet_bootstrap.cc:492] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: No bootstrap required, opened a new log
I20260709 13:13:10.517628  6796 ts_tablet_manager.cc:1403] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.005s
I20260709 13:13:10.520967  6796 raft_consensus.cc:359] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.521740  6796 raft_consensus.cc:385] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.522068  6796 raft_consensus.cc:740] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.523135  6795 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: No bootstrap required, opened a new log
I20260709 13:13:10.523025  6796 consensus_queue.cc:260] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.523741  6795 ts_tablet_manager.cc:1403] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.005s
I20260709 13:13:10.525414  6796 ts_tablet_manager.cc:1434] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:10.527040  6795 raft_consensus.cc:359] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.527912  6795 raft_consensus.cc:385] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.528020  6794 tablet_bootstrap.cc:492] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: No bootstrap required, opened a new log
I20260709 13:13:10.528316  6795 raft_consensus.cc:740] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.528703  6794 ts_tablet_manager.cc:1403] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:13:10.529404  6795 consensus_queue.cc:260] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.532023  6794 raft_consensus.cc:359] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.532943  6794 raft_consensus.cc:385] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.531998  6795 ts_tablet_manager.cc:1434] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:13:10.533337  6794 raft_consensus.cc:740] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784047074b34e018a7b2e1aba5e68c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.534214  6794 consensus_queue.cc:260] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.536244  6794 ts_tablet_manager.cc:1434] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:10.548605  6802 raft_consensus.cc:493] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.549201  6802 raft_consensus.cc:515] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.551501  6802 leader_election.cc:290] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121)
I20260709 13:13:10.558542  6801 raft_consensus.cc:493] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.559163  6801 raft_consensus.cc:515] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.563463  6801 leader_election.cc:290] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:10.563331  6604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
I20260709 13:13:10.564356  6604 raft_consensus.cc:2468] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6784047074b34e018a7b2e1aba5e68c7 in term 0.
I20260709 13:13:10.566920  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f41f186312c44eb8ae01eaad17a987e" is_pre_election: true
I20260709 13:13:10.567660  6679 raft_consensus.cc:2468] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6784047074b34e018a7b2e1aba5e68c7 in term 0.
I20260709 13:13:10.567878  6719 leader_election.cc:304] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31; no voters: 
I20260709 13:13:10.568925  6802 raft_consensus.cc:2804] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:10.569286  6802 raft_consensus.cc:493] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.569640  6802 raft_consensus.cc:3060] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.574097  6604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
I20260709 13:13:10.574812  6604 raft_consensus.cc:2468] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:10.576268  6645 leader_election.cc:304] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:10.577099  6801 raft_consensus.cc:2804] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:10.577528  6801 raft_consensus.cc:493] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.577899  6801 raft_consensus.cc:3060] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.577925  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7" is_pre_election: true
I20260709 13:13:10.577930  6802 raft_consensus.cc:515] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.579535  6753 raft_consensus.cc:2393] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f41f186312c44eb8ae01eaad17a987e in current term 1: Already voted for candidate 6784047074b34e018a7b2e1aba5e68c7 in this term.
I20260709 13:13:10.581152  6604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:10.581751  6604 raft_consensus.cc:3060] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.581966  6802 leader_election.cc:290] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 election: Requested vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121)
I20260709 13:13:10.583230  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
I20260709 13:13:10.585877  6801 raft_consensus.cc:515] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.586932  6679 raft_consensus.cc:2393] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6784047074b34e018a7b2e1aba5e68c7 in current term 1: Already voted for candidate 8f41f186312c44eb8ae01eaad17a987e in this term.
I20260709 13:13:10.588049  6801 leader_election.cc:290] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Requested vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:10.588073  6604 raft_consensus.cc:2468] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6784047074b34e018a7b2e1aba5e68c7 in term 1.
I20260709 13:13:10.589134  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:10.589183  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c96f09c4f045c2820c7e60a5f93f32" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:10.590005  6719 leader_election.cc:304] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31; no voters: 8f41f186312c44eb8ae01eaad17a987e
I20260709 13:13:10.590109  6603 raft_consensus.cc:2393] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f41f186312c44eb8ae01eaad17a987e in current term 1: Already voted for candidate 6784047074b34e018a7b2e1aba5e68c7 in this term.
I20260709 13:13:10.590106  6753 raft_consensus.cc:2393] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f41f186312c44eb8ae01eaad17a987e in current term 1: Already voted for candidate 6784047074b34e018a7b2e1aba5e68c7 in this term.
I20260709 13:13:10.591024  6802 raft_consensus.cc:2804] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:10.591657  6645 leader_election.cc:304] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f41f186312c44eb8ae01eaad17a987e; no voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31
I20260709 13:13:10.592263  6802 raft_consensus.cc:697] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 LEADER]: Becoming Leader. State: Replica: 6784047074b34e018a7b2e1aba5e68c7, State: Running, Role: LEADER
I20260709 13:13:10.592443  6801 raft_consensus.cc:2749] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:10.593396  6802 consensus_queue.cc:237] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.600884  6501 catalog_manager.cc:5697] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3). New cstate: current_term: 1 leader_uuid: "6784047074b34e018a7b2e1aba5e68c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.650370  6801 raft_consensus.cc:493] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.650961  6801 raft_consensus.cc:515] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.652740  6801 leader_election.cc:290] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519), 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647)
I20260709 13:13:10.653798  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
I20260709 13:13:10.653787  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7" is_pre_election: true
I20260709 13:13:10.654796  6603 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:10.654829  6753 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:10.656067  6643 leader_election.cc:304] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:10.656716  6801 raft_consensus.cc:2804] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:10.657055  6801 raft_consensus.cc:493] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.657325  6801 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.662228  6801 raft_consensus.cc:515] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.663895  6801 leader_election.cc:290] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Requested vote from peers 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519), 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647)
I20260709 13:13:10.664667  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:10.665002  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:10.665355  6753 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.665611  6603 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.671562  6603 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:10.671957  6753 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:10.672549  6645 leader_election.cc:304] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:10.673453  6801 raft_consensus.cc:2804] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:10.674409  6801 raft_consensus.cc:697] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Leader. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:10.675123  6801 consensus_queue.cc:237] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:10.681505  6501 catalog_manager.cc:5697] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "8f41f186312c44eb8ae01eaad17a987e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.748023  6501 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57986:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:10.749950  6501 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:10.773473  6594 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a8d8a1724e8c82af7a91ff5de5c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.774852  6594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a8d8a1724e8c82af7a91ff5de5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.774770  6668 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a8d8a1724e8c82af7a91ff5de5c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.776271  6668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a8d8a1724e8c82af7a91ff5de5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.778249  6593 tablet_service.cc:1511] Processing CreateTablet for tablet c69f37f1ef7a4413b2b5d2673237df02 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.778934  6669 tablet_service.cc:1511] Processing CreateTablet for tablet c69f37f1ef7a4413b2b5d2673237df02 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.779541  6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69f37f1ef7a4413b2b5d2673237df02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.780133  6669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69f37f1ef7a4413b2b5d2673237df02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.776309  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 4941a8d8a1724e8c82af7a91ff5de5c7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:10.781709  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4941a8d8a1724e8c82af7a91ff5de5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.781435  6742 tablet_service.cc:1511] Processing CreateTablet for tablet c69f37f1ef7a4413b2b5d2673237df02 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ea0b269cba284f309e6749753a88de0d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:10.782625  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69f37f1ef7a4413b2b5d2673237df02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.792956  6795 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: Bootstrap starting.
I20260709 13:13:10.799577  6794 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: Bootstrap starting.
I20260709 13:13:10.800328  6795 tablet_bootstrap.cc:654] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.807401  6794 tablet_bootstrap.cc:654] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.808389  6795 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: No bootstrap required, opened a new log
I20260709 13:13:10.808969  6795 ts_tablet_manager.cc:1403] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 13:13:10.812084  6795 raft_consensus.cc:359] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.812950  6795 raft_consensus.cc:385] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.813323  6795 raft_consensus.cc:740] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.815212  6794 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: No bootstrap required, opened a new log
I20260709 13:13:10.814949  6795 consensus_queue.cc:260] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.815729  6794 ts_tablet_manager.cc:1403] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:13:10.818310  6796 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Bootstrap starting.
I20260709 13:13:10.818887  6794 raft_consensus.cc:359] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.819608  6794 raft_consensus.cc:385] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.819909  6794 raft_consensus.cc:740] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784047074b34e018a7b2e1aba5e68c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.820647  6794 consensus_queue.cc:260] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.821943  6795 ts_tablet_manager.cc:1434] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:10.822888  6794 ts_tablet_manager.cc:1434] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:10.823093  6795 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: Bootstrap starting.
I20260709 13:13:10.823978  6794 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: Bootstrap starting.
I20260709 13:13:10.829514  6802 raft_consensus.cc:493] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.830166  6802 raft_consensus.cc:515] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.831576  6794 tablet_bootstrap.cc:654] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.832306  6796 tablet_bootstrap.cc:654] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.831604  6795 tablet_bootstrap.cc:654] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.834625  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f41f186312c44eb8ae01eaad17a987e" is_pre_election: true
I20260709 13:13:10.836246  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "6784047074b34e018a7b2e1aba5e68c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
W20260709 13:13:10.837908  6719 leader_election.cc:343] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:10.840409  6718 leader_election.cc:343] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:10.841001  6718 leader_election.cc:304] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7; no voters: 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e
I20260709 13:13:10.841228  6802 leader_election.cc:290] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121)
I20260709 13:13:10.842063  6802 raft_consensus.cc:2749] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:10.846138  6794 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: No bootstrap required, opened a new log
I20260709 13:13:10.846665  6794 ts_tablet_manager.cc:1403] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:13:10.849479  6796 tablet_bootstrap.cc:492] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: No bootstrap required, opened a new log
I20260709 13:13:10.849958  6796 ts_tablet_manager.cc:1403] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:13:10.850178  6795 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: No bootstrap required, opened a new log
I20260709 13:13:10.850095  6794 raft_consensus.cc:359] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.850816  6795 ts_tablet_manager.cc:1403] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.010s
I20260709 13:13:10.851038  6794 raft_consensus.cc:385] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.851397  6794 raft_consensus.cc:740] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784047074b34e018a7b2e1aba5e68c7, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.852211  6794 consensus_queue.cc:260] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.852651  6796 raft_consensus.cc:359] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.853331  6796 raft_consensus.cc:385] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.853870  6795 raft_consensus.cc:359] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.854548  6794 ts_tablet_manager.cc:1434] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:13:10.854643  6795 raft_consensus.cc:385] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.855070  6795 raft_consensus.cc:740] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.855361  6796 raft_consensus.cc:740] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.855831  6795 consensus_queue.cc:260] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.856205  6796 consensus_queue.cc:260] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.858132  6795 ts_tablet_manager.cc:1434] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:13:10.858402  6796 ts_tablet_manager.cc:1434] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:13:10.859459  6796 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: Bootstrap starting.
I20260709 13:13:10.865700  6796 tablet_bootstrap.cc:654] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.873138  6796 tablet_bootstrap.cc:492] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: No bootstrap required, opened a new log
I20260709 13:13:10.873605  6796 ts_tablet_manager.cc:1403] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:13:10.876183  6796 raft_consensus.cc:359] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.876762  6796 raft_consensus.cc:385] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.877017  6796 raft_consensus.cc:740] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.877664  6796 consensus_queue.cc:260] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.879794  6796 ts_tablet_manager.cc:1434] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
W20260709 13:13:10.895961  6550 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:10.976271  6801 raft_consensus.cc:493] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.976995  6801 raft_consensus.cc:515] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.978798  6801 leader_election.cc:290] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:10.979893  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
I20260709 13:13:10.979893  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7" is_pre_election: true
I20260709 13:13:10.980876  6603 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:10.980924  6753 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:10.982146  6643 leader_election.cc:304] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:10.982880  6801 raft_consensus.cc:2804] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:10.983191  6801 raft_consensus.cc:493] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.983457  6801 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.989303  6801 raft_consensus.cc:515] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:10.990926  6801 leader_election.cc:290] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Requested vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:10.991639  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:10.991827  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:10.992210  6603 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.992389  6753 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.999814  6753 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:10.999972  6603 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:11.001127  6643 leader_election.cc:304] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:11.002074  6801 raft_consensus.cc:2804] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.002592  6801 raft_consensus.cc:697] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Leader. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:11.003477  6801 consensus_queue.cc:237] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.011433  6502 catalog_manager.cc:5697] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "8f41f186312c44eb8ae01eaad17a987e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.026419  6801 raft_consensus.cc:493] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.027024  6801 raft_consensus.cc:515] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.028765  6801 leader_election.cc:290] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:11.029501  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31" is_pre_election: true
I20260709 13:13:11.029764  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7" is_pre_election: true
I20260709 13:13:11.030247  6603 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:11.030411  6753 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 0.
I20260709 13:13:11.031500  6645 leader_election.cc:304] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:11.032267  6801 raft_consensus.cc:2804] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.032615  6801 raft_consensus.cc:493] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.032908  6801 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.038183  6801 raft_consensus.cc:515] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.040889  6801 leader_election.cc:290] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Requested vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:11.041199  6802 consensus_queue.cc:1048] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.041271  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:11.040897  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:11.042196  6753 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.042284  6603 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.047945  6603 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:11.049021  6645 leader_election.cc:304] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:11.049829  6801 raft_consensus.cc:2804] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.050307  6801 raft_consensus.cc:697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Leader. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:11.051122  6801 consensus_queue.cc:237] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.052399  6753 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 1.
I20260709 13:13:11.059433  6502 catalog_manager.cc:5697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "8f41f186312c44eb8ae01eaad17a987e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.062381  6802 consensus_queue.cc:1048] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:11.069226  6801 consensus_queue.cc:1048] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.092074  6801 consensus_queue.cc:1048] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:11.146436  6679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d"
dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
mode: GRACEFUL
new_leader_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:44156
I20260709 13:13:11.147105  6679 raft_consensus.cc:606] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Received request to transfer leadership to TS 75984cfd728e40fda12c61d3743c2e31
I20260709 13:13:11.155241  6679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7"
dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
mode: GRACEFUL
new_leader_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:44156
I20260709 13:13:11.155793  6679 raft_consensus.cc:606] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Received request to transfer leadership to TS 75984cfd728e40fda12c61d3743c2e31
I20260709 13:13:11.160678  6679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02"
dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
mode: GRACEFUL
new_leader_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:44156
I20260709 13:13:11.161176  6679 raft_consensus.cc:606] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Received request to transfer leadership to TS 75984cfd728e40fda12c61d3743c2e31
I20260709 13:13:11.528542  6832 consensus_queue.cc:1048] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.539147  6801 consensus_queue.cc:1048] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.548346  6810 raft_consensus.cc:993] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: : Instructing follower 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.548822  6801 raft_consensus.cc:1081] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Signalling peer 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.550264  6604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02"
dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:41528
I20260709 13:13:11.550961  6604 raft_consensus.cc:493] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.551357  6604 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.556514  6604 raft_consensus.cc:515] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.558475  6604 leader_election.cc:290] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Requested vote from peers 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:11.570030  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
I20260709 13:13:11.570808  6679 raft_consensus.cc:3055] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.571136  6679 raft_consensus.cc:740] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:11.572057  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69f37f1ef7a4413b2b5d2673237df02" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:11.572700  6753 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.572218  6679 consensus_queue.cc:260] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.573848  6679 raft_consensus.cc:3060] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.579679  6753 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.580734  6801 consensus_queue.cc:1048] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.581529  6568 leader_election.cc:304] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31; no voters: 
I20260709 13:13:11.582119  6679 raft_consensus.cc:2468] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.582720  6800 raft_consensus.cc:2804] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.586833  6800 raft_consensus.cc:697] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Becoming Leader. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Running, Role: LEADER
I20260709 13:13:11.588596  6800 consensus_queue.cc:237] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.591306  6810 raft_consensus.cc:993] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: : Instructing follower 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.591743  6810 raft_consensus.cc:1081] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Signalling peer 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.593775  6603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7"
dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:41528
I20260709 13:13:11.594357  6603 raft_consensus.cc:493] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.594764  6603 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.597916  6500 catalog_manager.cc:5697] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 reported cstate change: term changed from 1 to 2, leader changed from 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2) to 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "75984cfd728e40fda12c61d3743c2e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.598779  6810 consensus_queue.cc:1048] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:11.603883  6603 raft_consensus.cc:515] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.606846  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
I20260709 13:13:11.607399  6679 raft_consensus.cc:3055] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.607723  6679 raft_consensus.cc:740] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:11.608814  6679 consensus_queue.cc:260] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.609709  6679 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.617403  6679 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.618315  6604 raft_consensus.cc:1240] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Rejecting Update request from peer 8f41f186312c44eb8ae01eaad17a987e for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:11.618836  6569 leader_election.cc:304] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75984cfd728e40fda12c61d3743c2e31, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:11.619902  6800 raft_consensus.cc:2804] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.620508  6800 raft_consensus.cc:697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Becoming Leader. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Running, Role: LEADER
I20260709 13:13:11.621424  6800 consensus_queue.cc:237] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:11.622501  6603 leader_election.cc:290] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Requested vote from peers 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:11.625252  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:11.626112  6753 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.633935  6753 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.634275  6810 raft_consensus.cc:993] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: : Instructing follower 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.634857  6810 raft_consensus.cc:1081] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Signalling peer 75984cfd728e40fda12c61d3743c2e31 to start an election
I20260709 13:13:11.636925  6603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d"
dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
 from {username='slave'} at 127.0.0.1:41528
I20260709 13:13:11.637610  6603 raft_consensus.cc:493] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.638096  6603 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.640015  6501 catalog_manager.cc:5697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 reported cstate change: term changed from 1 to 2, leader changed from 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2) to 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "75984cfd728e40fda12c61d3743c2e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.644222  6603 raft_consensus.cc:515] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:11.646517  6603 leader_election.cc:290] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Requested vote from peers 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519), 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2:42121)
I20260709 13:13:11.647174  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:11.647612  6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1bd044d9794d8ea45a198d35c01a5d" candidate_uuid: "75984cfd728e40fda12c61d3743c2e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
I20260709 13:13:11.647866  6753 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.648255  6679 raft_consensus.cc:3055] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.648588  6679 raft_consensus.cc:740] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:11.649398  6679 consensus_queue.cc:260] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:11.651824  6679 raft_consensus.cc:3060] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.655025  6753 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.656190  6568 leader_election.cc:304] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 75984cfd728e40fda12c61d3743c2e31; no voters: 
I20260709 13:13:11.656896  6800 raft_consensus.cc:2804] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.657382  6800 raft_consensus.cc:697] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Becoming Leader. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Running, Role: LEADER
I20260709 13:13:11.658188  6800 consensus_queue.cc:237] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } }
I20260709 13:13:11.658491  6679 raft_consensus.cc:2468] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75984cfd728e40fda12c61d3743c2e31 in term 2.
I20260709 13:13:11.665290  6502 catalog_manager.cc:5697] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 reported cstate change: term changed from 1 to 2, leader changed from 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2) to 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1). New cstate: current_term: 2 leader_uuid: "75984cfd728e40fda12c61d3743c2e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.888468 29280 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:11.890023 29280 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:11.890359 29280 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:11.903682  6603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7"
dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
mode: GRACEFUL
new_leader_uuid: "8f41f186312c44eb8ae01eaad17a987e"
 from {username='slave'} at 127.0.0.1:41544
I20260709 13:13:11.904356  6603 raft_consensus.cc:606] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Received request to transfer leadership to TS 8f41f186312c44eb8ae01eaad17a987e
I20260709 13:13:11.905709 29280 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:12.022505  6679 raft_consensus.cc:1275] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.024053  6800 consensus_queue.cc:1048] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.029282  6841 raft_consensus.cc:993] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: : Instructing follower 8f41f186312c44eb8ae01eaad17a987e to start an election
I20260709 13:13:12.029722  6841 raft_consensus.cc:1081] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Signalling peer 8f41f186312c44eb8ae01eaad17a987e to start an election
I20260709 13:13:12.032109  6678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7"
dest_uuid: "8f41f186312c44eb8ae01eaad17a987e"
 from {username='slave'} at 127.0.0.1:44172
I20260709 13:13:12.032743  6678 raft_consensus.cc:493] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.033105  6678 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.037547  6753 raft_consensus.cc:1275] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.039005  6800 consensus_queue.cc:1048] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.041380  6678 raft_consensus.cc:515] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:12.044006  6678 leader_election.cc:290] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 3 election: Requested vote from peers 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1:34647), 6784047074b34e018a7b2e1aba5e68c7 (127.28.152.3:37519)
I20260709 13:13:12.044188  6603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75984cfd728e40fda12c61d3743c2e31"
I20260709 13:13:12.045140  6603 raft_consensus.cc:3055] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.045495  6603 raft_consensus.cc:740] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 75984cfd728e40fda12c61d3743c2e31, State: Running, Role: LEADER
I20260709 13:13:12.045634  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4941a8d8a1724e8c82af7a91ff5de5c7" candidate_uuid: "8f41f186312c44eb8ae01eaad17a987e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6784047074b34e018a7b2e1aba5e68c7"
I20260709 13:13:12.046362  6753 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.046496  6603 consensus_queue.cc:260] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:12.047950  6603 raft_consensus.cc:3060] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.053947  6753 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 3.
I20260709 13:13:12.055126  6603 raft_consensus.cc:2468] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f41f186312c44eb8ae01eaad17a987e in term 3.
I20260709 13:13:12.055285  6643 leader_election.cc:304] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6784047074b34e018a7b2e1aba5e68c7, 8f41f186312c44eb8ae01eaad17a987e; no voters: 
I20260709 13:13:12.056138  6801 raft_consensus.cc:2804] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.056658  6801 raft_consensus.cc:697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 LEADER]: Becoming Leader. State: Replica: 8f41f186312c44eb8ae01eaad17a987e, State: Running, Role: LEADER
I20260709 13:13:12.057396  6801 consensus_queue.cc:237] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } }
I20260709 13:13:12.063287  6501 catalog_manager.cc:5697] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e reported cstate change: term changed from 2 to 3, leader changed from 75984cfd728e40fda12c61d3743c2e31 (127.28.152.1) to 8f41f186312c44eb8ae01eaad17a987e (127.28.152.2). New cstate: current_term: 3 leader_uuid: "8f41f186312c44eb8ae01eaad17a987e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75984cfd728e40fda12c61d3743c2e31" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 34647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.100162  6753 raft_consensus.cc:1275] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.101356  6800 consensus_queue.cc:1048] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.109205  6678 raft_consensus.cc:1275] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.110858  6841 consensus_queue.cc:1048] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.122429 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
I20260709 13:13:12.124267  6678 raft_consensus.cc:1275] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.126209  6841 consensus_queue.cc:1048] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f41f186312c44eb8ae01eaad17a987e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.136915  6753 raft_consensus.cc:1275] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Refusing update from remote peer 75984cfd728e40fda12c61d3743c2e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.138504  6842 consensus_queue.cc:1048] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784047074b34e018a7b2e1aba5e68c7" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.168299 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:12.168998 29280 tablet_replica.cc:333] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31: stopping tablet replica
I20260709 13:13:12.169579 29280 raft_consensus.cc:2243] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:12.170401 29280 raft_consensus.cc:2272] T c69f37f1ef7a4413b2b5d2673237df02 P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.172746 29280 tablet_replica.cc:333] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31: stopping tablet replica
I20260709 13:13:12.173311 29280 raft_consensus.cc:2243] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.173717 29280 raft_consensus.cc:2272] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 75984cfd728e40fda12c61d3743c2e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.175848 29280 tablet_replica.cc:333] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31: stopping tablet replica
I20260709 13:13:12.176352 29280 raft_consensus.cc:2243] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.176754 29280 raft_consensus.cc:2272] T 82c96f09c4f045c2820c7e60a5f93f32 P 75984cfd728e40fda12c61d3743c2e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.178469 29280 tablet_replica.cc:333] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31: stopping tablet replica
I20260709 13:13:12.179008 29280 raft_consensus.cc:2243] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:12.179769 29280 raft_consensus.cc:2272] T ed1bd044d9794d8ea45a198d35c01a5d P 75984cfd728e40fda12c61d3743c2e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.203111 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
I20260709 13:13:12.217105 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
I20260709 13:13:12.237908 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:12.238664 29280 tablet_replica.cc:333] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e: stopping tablet replica
I20260709 13:13:12.239251 29280 raft_consensus.cc:2243] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.239674 29280 raft_consensus.cc:2272] T c69f37f1ef7a4413b2b5d2673237df02 P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.241737 29280 tablet_replica.cc:333] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: stopping tablet replica
I20260709 13:13:12.242208 29280 raft_consensus.cc:2243] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:12.242826 29280 pending_rounds.cc:70] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Trying to abort 1 pending ops.
I20260709 13:13:12.242976 29280 pending_rounds.cc:77] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637036274171904 op_type: NO_OP noop_request { }
I20260709 13:13:12.243218 29280 raft_consensus.cc:2889] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:12.243435 29280 raft_consensus.cc:2272] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 8f41f186312c44eb8ae01eaad17a987e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.245378 29280 tablet_replica.cc:333] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e: stopping tablet replica
I20260709 13:13:12.245836 29280 raft_consensus.cc:2243] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.246174 29280 raft_consensus.cc:2272] T ed1bd044d9794d8ea45a198d35c01a5d P 8f41f186312c44eb8ae01eaad17a987e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.248275 29280 tablet_replica.cc:333] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e: stopping tablet replica
I20260709 13:13:12.248689 29280 raft_consensus.cc:2243] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.249032 29280 raft_consensus.cc:2272] T 82c96f09c4f045c2820c7e60a5f93f32 P 8f41f186312c44eb8ae01eaad17a987e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.270648 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:13:12.284258 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
I20260709 13:13:12.309046 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:12.309752 29280 tablet_replica.cc:333] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7: stopping tablet replica
I20260709 13:13:12.310329 29280 raft_consensus.cc:2243] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.310853 29280 raft_consensus.cc:2272] T 4941a8d8a1724e8c82af7a91ff5de5c7 P 6784047074b34e018a7b2e1aba5e68c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.313014 29280 tablet_replica.cc:333] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7: stopping tablet replica
I20260709 13:13:12.313550 29280 raft_consensus.cc:2243] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.313964 29280 raft_consensus.cc:2272] T c69f37f1ef7a4413b2b5d2673237df02 P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.316093 29280 tablet_replica.cc:333] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7: stopping tablet replica
I20260709 13:13:12.316586 29280 raft_consensus.cc:2243] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:12.317344 29280 raft_consensus.cc:2272] T 82c96f09c4f045c2820c7e60a5f93f32 P 6784047074b34e018a7b2e1aba5e68c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.319204 29280 tablet_replica.cc:333] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7: stopping tablet replica
I20260709 13:13:12.319676 29280 raft_consensus.cc:2243] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.320084 29280 raft_consensus.cc:2272] T ed1bd044d9794d8ea45a198d35c01a5d P 6784047074b34e018a7b2e1aba5e68c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.341765 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:13:12.355679 29280 master.cc:562] Master@127.28.152.62:41405 shutting down...
I20260709 13:13:12.375180 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:12.375749 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.376094 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P e3f5faa0962744a5b714f40ce38992a7: stopping tablet replica
I20260709 13:13:12.395187 29280 master.cc:584] Master@127.28.152.62:41405 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2662 ms)
[----------] 6 tests from LeaderRebalancerTest (273145 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:12.430680 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:38151
I20260709 13:13:12.431982 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:12.437198  6852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.438618  6855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.438663  6853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:12.439133 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:12.440126 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:12.440305 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:12.440523 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602792440479 us; error 0 us; skew 500 ppm
I20260709 13:13:12.441061 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:12.443336 29280 webserver.cc:533] Webserver started at http://127.28.152.62:36979/ using document root <none> and password file <none>
I20260709 13:13:12.443825 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:12.444028 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:12.444303 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:12.445402 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.449851 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:12.453047  6860 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.453742 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:12.454061 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.454401 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:12.471451 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:12.472574 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:12.511123 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:38151
I20260709 13:13:12.511232  6911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:38151 every 8 connection(s)
I20260709 13:13:12.514973  6912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:12.525753  6912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: Bootstrap starting.
I20260709 13:13:12.531071  6912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:12.535637  6912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: No bootstrap required, opened a new log
I20260709 13:13:12.537772  6912 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER }
I20260709 13:13:12.538166  6912 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:12.538405  6912 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7208a4f915dd4ba6a10e8196fa8a6cf6, State: Initialized, Role: FOLLOWER
I20260709 13:13:12.539009  6912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER }
I20260709 13:13:12.539467  6912 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:12.539688  6912 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:12.539952  6912 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:12.544734  6912 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER }
I20260709 13:13:12.545262  6912 leader_election.cc:304] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7208a4f915dd4ba6a10e8196fa8a6cf6; no voters: 
I20260709 13:13:12.546420  6912 leader_election.cc:290] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:12.546778  6915 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:12.548197  6915 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 1 LEADER]: Becoming Leader. State: Replica: 7208a4f915dd4ba6a10e8196fa8a6cf6, State: Running, Role: LEADER
I20260709 13:13:12.549065  6915 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER }
I20260709 13:13:12.549815  6912 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:12.552081  6916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER } }
I20260709 13:13:12.552155  6917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7208a4f915dd4ba6a10e8196fa8a6cf6. Latest consensus state: current_term: 1 leader_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7208a4f915dd4ba6a10e8196fa8a6cf6" member_type: VOTER } }
I20260709 13:13:12.552865  6916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:12.552940  6917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:12.555624  6921 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:12.560511  6921 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:12.570161  6921 catalog_manager.cc:1383] Generated new cluster ID: c7cd62228be04dc58b82a7daf294710c
I20260709 13:13:12.570562  6921 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:12.571013 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:12.589912  6921 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:12.591217  6921 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:12.606140  6921 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: Generated new TSK 0
I20260709 13:13:12.606820  6921 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:12.637573 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:12.643736  6933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.644806  6934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.646512  6936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:12.647188 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:12.648020 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:12.648201 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:12.648381 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602792648366 us; error 0 us; skew 500 ppm
I20260709 13:13:12.648942 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:12.651373 29280 webserver.cc:533] Webserver started at http://127.28.152.1:42491/ using document root <none> and password file <none>
I20260709 13:13:12.651861 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:12.652042 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:12.652329 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:12.653447 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.658057 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:12.661417  6941 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.662160 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:12.662448 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.662762 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:12.678831 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:12.680162 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:12.681571 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:12.683864 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:12.684077 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.684325 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:12.684520 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.724454 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:42467
I20260709 13:13:12.724573  7003 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:42467 every 8 connection(s)
I20260709 13:13:12.729839 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:12.737241  7008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.738899  7009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.741530  7011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:12.742527  7004 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38151
I20260709 13:13:12.743010  7004 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:12.743768 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:12.743911  7004 heartbeater.cc:507] Master 127.28.152.62:38151 requested a full tablet report, sending...
I20260709 13:13:12.744751 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:12.745072 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:12.745297 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602792745277 us; error 0 us; skew 500 ppm
I20260709 13:13:12.746047 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:12.746419  6877 ts_manager.cc:194] Registered new tserver with Master: 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467)
I20260709 13:13:12.748586  6877 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45750
I20260709 13:13:12.748687 29280 webserver.cc:533] Webserver started at http://127.28.152.2:36615/ using document root <none> and password file <none>
I20260709 13:13:12.749401 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:12.749651 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:12.750001 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:12.751230 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "d805c8f29e394a3c9a22ebb16138e228"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.755525 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:12.759007  7016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.759793 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:12.760080 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "d805c8f29e394a3c9a22ebb16138e228"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.760385 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:12.782013 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:12.783093 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:12.784500 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:12.786672 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:12.786909 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.787151 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:12.787339 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.825488 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:35555
I20260709 13:13:12.825605  7078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:35555 every 8 connection(s)
I20260709 13:13:12.830389 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:12.837293  7082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.838994  7083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:12.842025  7085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:12.842571 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:12.842905  7079 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38151
I20260709 13:13:12.843379  7079 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:12.843797 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:12.844064 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:12.844128  7079 heartbeater.cc:507] Master 127.28.152.62:38151 requested a full tablet report, sending...
I20260709 13:13:12.844282 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602792844259 us; error 0 us; skew 500 ppm
I20260709 13:13:12.844977 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:12.846462  6877 ts_manager.cc:194] Registered new tserver with Master: d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:12.847705 29280 webserver.cc:533] Webserver started at http://127.28.152.3:39031/ using document root <none> and password file <none>
I20260709 13:13:12.848381 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:12.848356  6877 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45752
I20260709 13:13:12.848867 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:12.849212 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:12.850397 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "aac6280f29ad410fb7865479848aca5f"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.855011 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:12.858187  7090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.859055 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:12.859391 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "aac6280f29ad410fb7865479848aca5f"
format_stamp: "Formatted at 2026-07-09 13:13:12 on dist-test-slave-x7j4"
I20260709 13:13:12.859658 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:12.889463 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:12.890547 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:12.891961 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:12.894140 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:12.894325 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:12.894616 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:12.894799 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:12.933826 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:39811
I20260709 13:13:12.933959  7153 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:39811 every 8 connection(s)
I20260709 13:13:12.947352  7154 heartbeater.cc:344] Connected to a master server at 127.28.152.62:38151
I20260709 13:13:12.947767  7154 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:12.948459  7154 heartbeater.cc:507] Master 127.28.152.62:38151 requested a full tablet report, sending...
I20260709 13:13:12.950292  6877 ts_manager.cc:194] Registered new tserver with Master: aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:12.950615 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0135184s
I20260709 13:13:12.951900  6877 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45768
I20260709 13:13:12.975332  6877 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45782:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:12.977900  6877 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:13.061862  7117 tablet_service.cc:1511] Processing CreateTablet for tablet 2e08e9a9f53c40068fbe6ec6a5154954 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.063417  7117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e08e9a9f53c40068fbe6ec6a5154954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.063076  7114 tablet_service.cc:1511] Processing CreateTablet for tablet cb750dd61ffc422596a4914ea6f0fe6c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.064895  7116 tablet_service.cc:1511] Processing CreateTablet for tablet bf887671668b458a8c123ae642ea702d (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.065411  7118 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae2281b99c4466580928dd4f7a1ee5c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.067226  7115 tablet_service.cc:1511] Processing CreateTablet for tablet 3413014b59d9416aa098597e395214c8 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.070363  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413014b59d9416aa098597e395214c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.072463  7044 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae2281b99c4466580928dd4f7a1ee5c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.073877  7044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae2281b99c4466580928dd4f7a1ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.075842  7043 tablet_service.cc:1511] Processing CreateTablet for tablet 2e08e9a9f53c40068fbe6ec6a5154954 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.077265  7043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e08e9a9f53c40068fbe6ec6a5154954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.077327  7038 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25e4706d2442d49f2521a761f09f41 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.079494  7038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25e4706d2442d49f2521a761f09f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.080200  7039 tablet_service.cc:1511] Processing CreateTablet for tablet f8d5a38931bd4cf4b44185ce6f765430 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.081843  7039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d5a38931bd4cf4b44185ce6f765430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.083518  6969 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae2281b99c4466580928dd4f7a1ee5c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.084905  6969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae2281b99c4466580928dd4f7a1ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.084610  7041 tablet_service.cc:1511] Processing CreateTablet for tablet 3413014b59d9416aa098597e395214c8 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.085930  7041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413014b59d9416aa098597e395214c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.087787  7040 tablet_service.cc:1511] Processing CreateTablet for tablet cb750dd61ffc422596a4914ea6f0fe6c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.089128  7040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb750dd61ffc422596a4914ea6f0fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.091768  6968 tablet_service.cc:1511] Processing CreateTablet for tablet 2e08e9a9f53c40068fbe6ec6a5154954 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.093053  6968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e08e9a9f53c40068fbe6ec6a5154954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.083586  7042 tablet_service.cc:1511] Processing CreateTablet for tablet bf887671668b458a8c123ae642ea702d (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.096622  7042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf887671668b458a8c123ae642ea702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.100979  7113 tablet_service.cc:1511] Processing CreateTablet for tablet f8d5a38931bd4cf4b44185ce6f765430 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.072840  7116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf887671668b458a8c123ae642ea702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.104305  7114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb750dd61ffc422596a4914ea6f0fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.105719  7118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae2281b99c4466580928dd4f7a1ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.107103  7113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d5a38931bd4cf4b44185ce6f765430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.109625  6967 tablet_service.cc:1511] Processing CreateTablet for tablet bf887671668b458a8c123ae642ea702d (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.112298  6967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf887671668b458a8c123ae642ea702d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.112975  6966 tablet_service.cc:1511] Processing CreateTablet for tablet 3413014b59d9416aa098597e395214c8 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.114421  6966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413014b59d9416aa098597e395214c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.116081  6965 tablet_service.cc:1511] Processing CreateTablet for tablet cb750dd61ffc422596a4914ea6f0fe6c (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.118794  6964 tablet_service.cc:1511] Processing CreateTablet for tablet f8d5a38931bd4cf4b44185ce6f765430 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.123461  7037 tablet_service.cc:1511] Processing CreateTablet for tablet 514af2f38baf42c28a096e07d44d74b6 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.124819  7037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514af2f38baf42c28a096e07d44d74b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.127036  6964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d5a38931bd4cf4b44185ce6f765430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.129426  6965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb750dd61ffc422596a4914ea6f0fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.135859  7036 tablet_service.cc:1511] Processing CreateTablet for tablet 213044b3cc154dba981cac599832053e (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.137312  7036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213044b3cc154dba981cac599832053e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.138099  7170 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.139786  7112 tablet_service.cc:1511] Processing CreateTablet for tablet 514af2f38baf42c28a096e07d44d74b6 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.141233  7112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514af2f38baf42c28a096e07d44d74b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.142884  7111 tablet_service.cc:1511] Processing CreateTablet for tablet 213044b3cc154dba981cac599832053e (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.144297  7111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213044b3cc154dba981cac599832053e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.144454  7170 tablet_bootstrap.cc:654] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.147804  6963 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25e4706d2442d49f2521a761f09f41 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.149195  6963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25e4706d2442d49f2521a761f09f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.151978  6962 tablet_service.cc:1511] Processing CreateTablet for tablet 514af2f38baf42c28a096e07d44d74b6 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.153328  6962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514af2f38baf42c28a096e07d44d74b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.155887  6961 tablet_service.cc:1511] Processing CreateTablet for tablet 213044b3cc154dba981cac599832053e (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.157207  6961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213044b3cc154dba981cac599832053e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.191836  7115 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25e4706d2442d49f2521a761f09f41 (DEFAULT_TABLE table=test-workload [id=8ff5964715624acc9273d856ecd00ca7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.203513  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25e4706d2442d49f2521a761f09f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.247262  7169 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.269769  7169 tablet_bootstrap.cc:654] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.325850  7170 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.326360  7170 ts_tablet_manager.cc:1403] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.189s	user 0.055s	sys 0.080s
I20260709 13:13:13.328922  7170 raft_consensus.cc:359] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.329493  7170 raft_consensus.cc:385] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.329806  7170 raft_consensus.cc:740] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.330282  7172 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.330579  7170 consensus_queue.cc:260] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.335242  7169 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.337791  7169 ts_tablet_manager.cc:1403] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.024s
I20260709 13:13:13.340613  7169 raft_consensus.cc:359] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.341406  7169 raft_consensus.cc:385] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.341733  7169 raft_consensus.cc:740] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.342734  7169 consensus_queue.cc:260] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.344158  7172 tablet_bootstrap.cc:654] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.350323  7079 heartbeater.cc:499] Master 127.28.152.62:38151 was elected leader, sending a full tablet report...
I20260709 13:13:13.350883  7170 ts_tablet_manager.cc:1434] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.017s
I20260709 13:13:13.352088  7170 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.355649  7172 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.356529  7172 ts_tablet_manager.cc:1403] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:13:13.358665  7170 tablet_bootstrap.cc:654] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.362077  7154 heartbeater.cc:499] Master 127.28.152.62:38151 was elected leader, sending a full tablet report...
I20260709 13:13:13.362962  7169 ts_tablet_manager.cc:1434] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 13:13:13.364085  7169 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.366894  7172 raft_consensus.cc:359] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.367733  7172 raft_consensus.cc:385] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.368099  7172 raft_consensus.cc:740] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.369059  7172 consensus_queue.cc:260] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.372013  7169 tablet_bootstrap.cc:654] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.372491  7170 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.373072  7170 ts_tablet_manager.cc:1403] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:13:13.376153  7170 raft_consensus.cc:359] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.376874  7170 raft_consensus.cc:385] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.377183  7170 raft_consensus.cc:740] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.378144  7170 consensus_queue.cc:260] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.380527  7170 ts_tablet_manager.cc:1434] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:13.381482  7170 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.387863  7170 tablet_bootstrap.cc:654] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.392283  7172 ts_tablet_manager.cc:1434] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.018s
I20260709 13:13:13.392848  7004 heartbeater.cc:499] Master 127.28.152.62:38151 was elected leader, sending a full tablet report...
I20260709 13:13:13.393453  7172 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.394127  7175 raft_consensus.cc:493] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.394655  7169 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.394655  7175 raft_consensus.cc:515] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.395365  7169 ts_tablet_manager.cc:1403] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.015s
I20260709 13:13:13.398612  7169 raft_consensus.cc:359] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.399396  7169 raft_consensus.cc:385] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.399765  7169 raft_consensus.cc:740] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.400733  7169 consensus_queue.cc:260] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.410092  7175 leader_election.cc:290] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.420423  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
W20260709 13:13:13.422724  7094 leader_election.cc:343] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.426277  7170 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.426913  7170 ts_tablet_manager.cc:1403] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.017s
I20260709 13:13:13.430079  7170 raft_consensus.cc:359] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.430860  7170 raft_consensus.cc:385] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.431154  7170 raft_consensus.cc:740] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.431890  7170 consensus_queue.cc:260] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.434429  7170 ts_tablet_manager.cc:1434] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:13.435549  7172 tablet_bootstrap.cc:654] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.435596  7170 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.439874  7169 ts_tablet_manager.cc:1434] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 13:13:13.441212  7169 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.444003  7170 tablet_bootstrap.cc:654] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.447613  7169 tablet_bootstrap.cc:654] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.455049  7172 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.455823  7172 ts_tablet_manager.cc:1403] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.001s
I20260709 13:13:13.460150  7169 tablet_bootstrap.cc:492] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.460214  7172 raft_consensus.cc:359] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.460930  7169 ts_tablet_manager.cc:1403] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:13:13.461261  7172 raft_consensus.cc:385] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.461596  7172 raft_consensus.cc:740] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.462518  7172 consensus_queue.cc:260] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.464485  7169 raft_consensus.cc:359] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.465333  7169 raft_consensus.cc:385] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.464941  7172 ts_tablet_manager.cc:1434] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:13.465708  7169 raft_consensus.cc:740] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.466835  7172 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.466595  7169 consensus_queue.cc:260] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.466877  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.469197  7169 ts_tablet_manager.cc:1434] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:13:13.469374  7054 raft_consensus.cc:2468] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.470399  7169 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.471305  7093 leader_election.cc:304] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.473162  7181 raft_consensus.cc:2804] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.473688  7181 raft_consensus.cc:493] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.474131  7181 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.476595  7172 tablet_bootstrap.cc:654] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.477284  7169 tablet_bootstrap.cc:654] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.488634  7172 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.489295  7172 ts_tablet_manager.cc:1403] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:13:13.496893  7181 raft_consensus.cc:515] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.498883  7169 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.499536  7169 ts_tablet_manager.cc:1403] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 13:13:13.499629  7181 leader_election.cc:290] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.500438  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.501032  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.501647  7054 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:13.502036  7094 leader_election.cc:343] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.503695  7169 raft_consensus.cc:359] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.504534  7169 raft_consensus.cc:385] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.504889  7169 raft_consensus.cc:740] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.505224  7170 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.505818  7170 ts_tablet_manager.cc:1403] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.070s	user 0.031s	sys 0.025s
I20260709 13:13:13.505846  7169 consensus_queue.cc:260] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.508549  7169 ts_tablet_manager.cc:1434] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:13.509546  7169 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.509262  7170 raft_consensus.cc:359] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.510257  7170 raft_consensus.cc:385] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.493304  7172 raft_consensus.cc:359] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.510569  7170 raft_consensus.cc:740] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.510888  7172 raft_consensus.cc:385] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.511369  7172 raft_consensus.cc:740] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.509373  7054 raft_consensus.cc:2468] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.511488  7170 consensus_queue.cc:260] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.513274  7093 leader_election.cc:304] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.514159  7170 ts_tablet_manager.cc:1434] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:13.514963  7175 raft_consensus.cc:2804] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.515226  7170 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.515630  7175 raft_consensus.cc:697] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:13.517129  7169 tablet_bootstrap.cc:654] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.516597  7175 consensus_queue.cc:237] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.517479  7174 raft_consensus.cc:493] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.517779  7172 consensus_queue.cc:260] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.518003  7174 raft_consensus.cc:515] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.520862  7174 leader_election.cc:290] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.530018  7172 ts_tablet_manager.cc:1434] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.002s
I20260709 13:13:13.534127  7172 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.526242  7170 tablet_bootstrap.cc:654] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.539943  7169 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.540512  7169 ts_tablet_manager.cc:1403] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.012s
I20260709 13:13:13.543562  7169 raft_consensus.cc:359] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.544287  7169 raft_consensus.cc:385] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.544591  7169 raft_consensus.cc:740] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.545399  7169 consensus_queue.cc:260] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.548101  7169 ts_tablet_manager.cc:1434] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:13.549103  7169 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.553330  7172 tablet_bootstrap.cc:654] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.553426  6874 catalog_manager.cc:5697] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.555421  7169 tablet_bootstrap.cc:654] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:13.564906  6925 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:13.572017  7170 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.575222  7170 ts_tablet_manager.cc:1403] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.004s
I20260709 13:13:13.578190  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.579571  7175 raft_consensus.cc:493] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.580120  7175 raft_consensus.cc:515] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.581959  7169 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.582520  7169 ts_tablet_manager.cc:1403] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.019s
I20260709 13:13:13.583494  7170 raft_consensus.cc:359] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.584333  7170 raft_consensus.cc:385] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.584509  7172 tablet_bootstrap.cc:492] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.584682  7170 raft_consensus.cc:740] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.585098  7172 ts_tablet_manager.cc:1403] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.004s
I20260709 13:13:13.584970  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.585817  6979 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
W20260709 13:13:13.586460  7020 leader_election.cc:343] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.586591  7178 raft_consensus.cc:493] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.586078  7169 raft_consensus.cc:359] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.587765  7169 raft_consensus.cc:385] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.587472  7178 raft_consensus.cc:515] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.588160  7169 raft_consensus.cc:740] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.587117  7175 leader_election.cc:290] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.588625  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.588609  7170 consensus_queue.cc:260] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.589681  7054 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.589223  7169 consensus_queue.cc:260] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.590992  7093 leader_election.cc:304] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.591385  7170 ts_tablet_manager.cc:1434] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:13:13.591845  7169 ts_tablet_manager.cc:1434] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:13:13.592109  7181 raft_consensus.cc:2804] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.592509  7181 raft_consensus.cc:493] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.592592  7170 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.592880  7181 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.593137  7169 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.604085  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.599061  7178 leader_election.cc:290] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
W20260709 13:13:13.607270  7020 leader_election.cc:343] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.608734  7020 leader_election.cc:304] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f
I20260709 13:13:13.613603  7174 raft_consensus.cc:2749] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:13.614454  7181 raft_consensus.cc:515] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.616875  7181 leader_election.cc:290] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.617808  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.618528  6979 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.619445  7172 raft_consensus.cc:359] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.620232  7172 raft_consensus.cc:385] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.620522  7172 raft_consensus.cc:740] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.620412  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.621245  7054 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.621465  7172 consensus_queue.cc:260] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.628109  7169 tablet_bootstrap.cc:654] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.629988  7054 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.631386  7093 leader_election.cc:304] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.632378  7181 raft_consensus.cc:2804] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.633509  7170 tablet_bootstrap.cc:654] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.634042  7181 raft_consensus.cc:697] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:13.636071  7181 consensus_queue.cc:237] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.637871  7172 ts_tablet_manager.cc:1434] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20260709 13:13:13.638873  7178 raft_consensus.cc:493] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.642043  7178 raft_consensus.cc:515] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.642529  7172 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.644120  7178 leader_election.cc:290] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.644299  7169 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.644562  7178 raft_consensus.cc:493] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.644901  7169 ts_tablet_manager.cc:1403] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.001s
I20260709 13:13:13.644979  7178 raft_consensus.cc:515] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.646917  7178 leader_election.cc:290] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.641327  7170 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.648154  7169 raft_consensus.cc:359] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.648846  7170 ts_tablet_manager.cc:1403] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.001s
I20260709 13:13:13.648934  7169 raft_consensus.cc:385] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.649358  7169 raft_consensus.cc:740] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.650296  7169 consensus_queue.cc:260] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.651594  7172 tablet_bootstrap.cc:654] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.651795  7170 raft_consensus.cc:359] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.652503  7170 raft_consensus.cc:385] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.652778  7170 raft_consensus.cc:740] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.653067  7169 ts_tablet_manager.cc:1434] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:13:13.653537  7170 consensus_queue.cc:260] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.654167  7169 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.638484  6979 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.663483  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.663740  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae2281b99c4466580928dd4f7a1ee5c" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.666976  7169 tablet_bootstrap.cc:654] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:13.668771  6945 leader_election.cc:343] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.665365  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.675151  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae2281b99c4466580928dd4f7a1ee5c" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.675961  7052 raft_consensus.cc:2468] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:13.676383  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.677246  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
W20260709 13:13:13.679458  6945 leader_election.cc:343] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.682300  6877 catalog_manager.cc:5697] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.684219  7172 tablet_bootstrap.cc:492] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.684612  7172 ts_tablet_manager.cc:1403] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.004s
I20260709 13:13:13.677497  7054 raft_consensus.cc:2393] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:13.685627  6944 leader_election.cc:304] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
W20260709 13:13:13.686961  6944 leader_election.cc:343] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.687026  7202 raft_consensus.cc:2804] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.687462  6944 leader_election.cc:304] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d; no voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:13.687716  7202 raft_consensus.cc:493] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.687613  7172 raft_consensus.cc:359] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.688472  7202 raft_consensus.cc:3060] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.688683  6944 leader_election.cc:304] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d; no voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:13.688485  7172 raft_consensus.cc:385] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.689891  7172 raft_consensus.cc:740] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.665208  7170 ts_tablet_manager.cc:1434] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:13:13.691628  7170 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.690927  7172 consensus_queue.cc:260] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.694015  7169 tablet_bootstrap.cc:492] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.696303  7169 ts_tablet_manager.cc:1403] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.016s
I20260709 13:13:13.696898  7178 raft_consensus.cc:2749] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:13.697721  7178 raft_consensus.cc:2749] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:13.699887  7202 raft_consensus.cc:515] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.700137  7169 raft_consensus.cc:359] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.701114  7169 raft_consensus.cc:385] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.701478  7169 raft_consensus.cc:740] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.703845  7202 leader_election.cc:290] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.704088  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae2281b99c4466580928dd4f7a1ee5c" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:13.710464  7172 ts_tablet_manager.cc:1434] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:13:13.711413  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae2281b99c4466580928dd4f7a1ee5c" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.711694  7172 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.712080  7054 raft_consensus.cc:3060] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.702394  7169 consensus_queue.cc:260] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.717190  7127 raft_consensus.cc:3060] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.718225  7170 tablet_bootstrap.cc:654] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.721122  7172 tablet_bootstrap.cc:654] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.726732  7127 raft_consensus.cc:2468] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:13.728529  7054 raft_consensus.cc:2468] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:13.730410  6944 leader_election.cc:304] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.733070  7169 ts_tablet_manager.cc:1434] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 13:13:13.733740  7206 raft_consensus.cc:2804] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.734589  7169 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:13.735103  7206 raft_consensus.cc:697] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:13.736099  7206 consensus_queue.cc:237] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } }
I20260709 13:13:13.744882  7169 tablet_bootstrap.cc:654] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.750046  7170 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.750605  7170 ts_tablet_manager.cc:1403] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.010s
I20260709 13:13:13.752698  7169 tablet_bootstrap.cc:492] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:13.753289  7169 ts_tablet_manager.cc:1403] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:13:13.752487  6877 catalog_manager.cc:5697] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.753787  7170 raft_consensus.cc:359] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.754421  7172 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.754649  7170 raft_consensus.cc:385] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.755045  7170 raft_consensus.cc:740] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.755074  7172 ts_tablet_manager.cc:1403] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.022s
I20260709 13:13:13.756022  7170 consensus_queue.cc:260] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.756878  7169 raft_consensus.cc:359] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.757622  7169 raft_consensus.cc:385] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.757920  7169 raft_consensus.cc:740] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.758714  7169 consensus_queue.cc:260] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.758771  7172 raft_consensus.cc:359] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.759759  7172 raft_consensus.cc:385] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.760159  7172 raft_consensus.cc:740] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.761183  7169 ts_tablet_manager.cc:1434] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:13.761219  7172 consensus_queue.cc:260] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.764117  7172 ts_tablet_manager.cc:1434] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:13.764674  7170 ts_tablet_manager.cc:1434] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:13.765336  7172 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.765820  7170 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.773092  7172 tablet_bootstrap.cc:654] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.773330  7170 tablet_bootstrap.cc:654] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.773684  7181 raft_consensus.cc:493] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.774132  7181 raft_consensus.cc:515] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.776131  7181 leader_election.cc:290] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.777695  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
W20260709 13:13:13.778975  7094 leader_election.cc:343] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.780845  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.781328  7170 tablet_bootstrap.cc:492] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.781514  7054 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.781814  7170 ts_tablet_manager.cc:1403] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:13:13.782018  7172 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.782585  7172 ts_tablet_manager.cc:1403] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:13:13.782739  7093 leader_election.cc:304] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.783603  7181 raft_consensus.cc:2804] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.784004  7181 raft_consensus.cc:493] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.784351  7181 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.784825  7170 raft_consensus.cc:359] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.785250  7172 raft_consensus.cc:359] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.785609  7170 raft_consensus.cc:385] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.785912  7172 raft_consensus.cc:385] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.785957  7170 raft_consensus.cc:740] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.786255  7172 raft_consensus.cc:740] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.786887  7170 consensus_queue.cc:260] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.787094  7172 consensus_queue.cc:260] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.789155  7170 ts_tablet_manager.cc:1434] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:13.789548  7172 ts_tablet_manager.cc:1434] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:13.790185  7170 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:13.790568  7172 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.791869  7174 raft_consensus.cc:493] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.792104  7181 raft_consensus.cc:515] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.792613  7174 raft_consensus.cc:515] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.796136  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.796838  6978 raft_consensus.cc:2468] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:13.797868  7170 tablet_bootstrap.cc:654] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.798226  7020 leader_election.cc:304] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.802173  7174 leader_election.cc:290] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.802713  7174 raft_consensus.cc:493] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.803365  7174 raft_consensus.cc:515] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.804003  7181 leader_election.cc:290] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.805384  7174 leader_election.cc:290] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.805984  7174 raft_consensus.cc:2804] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.806365  7174 raft_consensus.cc:493] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.806762  7174 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.807139  7181 raft_consensus.cc:493] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.807650  7181 raft_consensus.cc:515] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.810562  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.811424  6978 raft_consensus.cc:2468] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.812709  7094 leader_election.cc:304] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:13.813611  7175 raft_consensus.cc:2804] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.813970  7175 raft_consensus.cc:493] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.814301  7175 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.815383  7174 raft_consensus.cc:515] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.817507  7174 leader_election.cc:290] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.810434  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
W20260709 13:13:13.819188  7094 leader_election.cc:343] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.820097  7181 leader_election.cc:290] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.825263  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.827030  7172 tablet_bootstrap.cc:654] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.827605  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb750dd61ffc422596a4914ea6f0fe6c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.828379  6979 raft_consensus.cc:2468] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:13.830245  7170 tablet_bootstrap.cc:492] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:13.830024  7175 raft_consensus.cc:515] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.830403  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb750dd61ffc422596a4914ea6f0fe6c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:13.830899  7170 ts_tablet_manager.cc:1403] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.014s
I20260709 13:13:13.831388  7126 raft_consensus.cc:2468] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:13.832726  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:13.833035  7175 leader_election.cc:290] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.833694  7175 raft_consensus.cc:493] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.834103  7175 raft_consensus.cc:515] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.828379  7181 raft_consensus.cc:493] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.836187  7181 raft_consensus.cc:515] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.836767  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.837549  7170 raft_consensus.cc:359] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.838996  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.839481  7170 raft_consensus.cc:385] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.839401  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.840147  7170 raft_consensus.cc:740] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.840540  7053 raft_consensus.cc:2393] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac6280f29ad410fb7865479848aca5f in current term 1: Already voted for candidate d805c8f29e394a3c9a22ebb16138e228 in this term.
I20260709 13:13:13.841598  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.841399  7170 consensus_queue.cc:260] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.842068  7181 leader_election.cc:290] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.842273  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.842548  7052 raft_consensus.cc:2393] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac6280f29ad410fb7865479848aca5f in current term 1: Already voted for candidate d805c8f29e394a3c9a22ebb16138e228 in this term.
I20260709 13:13:13.842904  6978 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.839843  7127 raft_consensus.cc:2393] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d805c8f29e394a3c9a22ebb16138e228 in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:13.843344  7020 leader_election.cc:304] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.844225  7170 ts_tablet_manager.cc:1434] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
W20260709 13:13:13.838207  7094 leader_election.cc:343] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.839581  7054 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.841332  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.846228  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.846933  6977 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.847151  7215 raft_consensus.cc:2804] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.847657  7215 raft_consensus.cc:493] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.848042  7215 raft_consensus.cc:3060] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.847869  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.848676  7052 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.849850  7093 leader_election.cc:304] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.850935  7181 raft_consensus.cc:2804] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.851481  7181 raft_consensus.cc:493] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.852036  7181 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.852084  7094 leader_election.cc:304] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac6280f29ad410fb7865479848aca5f; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:13.853324  7054 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.859419  7215 raft_consensus.cc:515] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.860491  6978 raft_consensus.cc:2468] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:13.861728  7020 leader_election.cc:304] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
I20260709 13:13:13.862205  7215 leader_election.cc:290] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:13.862574  7093 leader_election.cc:304] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.862897  7215 raft_consensus.cc:2804] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.864590  7175 leader_election.cc:290] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.865212  7175 raft_consensus.cc:2804] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.865392  7172 tablet_bootstrap.cc:492] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.865731  7175 raft_consensus.cc:697] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:13.866025  7172 ts_tablet_manager.cc:1403] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.008s
I20260709 13:13:13.865969  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb750dd61ffc422596a4914ea6f0fe6c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:13.866837  7127 raft_consensus.cc:3060] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.866679  7175 consensus_queue.cc:237] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.867858  7181 raft_consensus.cc:515] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.869354  7172 raft_consensus.cc:359] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.870067  7172 raft_consensus.cc:385] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.870389  7172 raft_consensus.cc:740] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.870719  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.871306  6977 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.871173  7172 consensus_queue.cc:260] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.873711  7172 ts_tablet_manager.cc:1434] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:13.874715  7172 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:13.876359  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.877326  7054 raft_consensus.cc:2468] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.879091  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb750dd61ffc422596a4914ea6f0fe6c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.880012  6978 raft_consensus.cc:3060] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.881763  7172 tablet_bootstrap.cc:654] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.882269  7218 raft_consensus.cc:2749] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:13.864400  7215 raft_consensus.cc:697] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:13.885483  7215 consensus_queue.cc:237] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.887688  7093 leader_election.cc:304] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.890424  7218 raft_consensus.cc:2804] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.890983  7218 raft_consensus.cc:493] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.891448  7218 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.894445  7181 leader_election.cc:290] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.897492  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.898463  7054 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.902534  6977 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.904596  7094 leader_election.cc:304] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:13.906155  7175 raft_consensus.cc:2804] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.907013  7127 raft_consensus.cc:2468] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:13.907250  7175 raft_consensus.cc:697] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:13.908317  7175 consensus_queue.cc:237] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.908895  7218 raft_consensus.cc:515] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.910421  7020 leader_election.cc:304] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:13.911826  7218 leader_election.cc:290] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.912097  7214 raft_consensus.cc:2804] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.913187  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.913805  7214 raft_consensus.cc:697] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:13.915560  7218 consensus_queue.cc:1048] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:13.915717  7214 consensus_queue.cc:237] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.916730  6875 catalog_manager.cc:5697] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:13.917572  7094 leader_election.cc:343] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:13.918872  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.919500  7052 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.934574  7054 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.924242  6978 raft_consensus.cc:2468] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:13.934406  7052 raft_consensus.cc:2468] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.941967  7172 tablet_bootstrap.cc:492] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:13.942515  7172 ts_tablet_manager.cc:1403] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.023s
I20260709 13:13:13.943969  7093 leader_election.cc:304] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:13.945259  7172 raft_consensus.cc:359] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.946002  7172 raft_consensus.cc:385] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.946318  7172 raft_consensus.cc:740] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.947824  7172 consensus_queue.cc:260] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.946122  6877 catalog_manager.cc:5697] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.947600  7175 raft_consensus.cc:2804] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.950446  7172 ts_tablet_manager.cc:1434] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:13:13.958796  6874 catalog_manager.cc:5697] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.968314  7181 raft_consensus.cc:493] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.969113  7181 raft_consensus.cc:515] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.973053  6978 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.973097  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:13.973953  6977 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.975256  7094 leader_election.cc:304] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:13.976082  7218 raft_consensus.cc:2804] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:13.976435  7218 raft_consensus.cc:493] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.976967  7218 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.977496  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:13.978451  7053 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:13.965683  7175 raft_consensus.cc:697] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:13.983728  7175 consensus_queue.cc:237] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.985208  7218 raft_consensus.cc:515] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:13.976917  7181 leader_election.cc:290] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.982784  7219 consensus_queue.cc:1048] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:13.988108  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:13.988801  6978 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.989219  7218 leader_election.cc:290] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:13.989881  6874 catalog_manager.cc:5697] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.992548  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:13.993279  7053 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:13.996992  6978 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:13.998415  7094 leader_election.cc:304] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:13.999377  7218 raft_consensus.cc:2804] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:13.999856  7218 raft_consensus.cc:697] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.000669  7218 consensus_queue.cc:237] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.000816  7053 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:14.019160  6877 catalog_manager.cc:5697] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.031584  6877 catalog_manager.cc:5697] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.032104  7206 raft_consensus.cc:493] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.032749  7206 raft_consensus.cc:515] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.034960  7206 leader_election.cc:290] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.035614  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:14.036154  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:14.036348  7053 raft_consensus.cc:2393] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:14.037618  6945 leader_election.cc:304] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d; no voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:14.038276  7206 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.043817  7206 raft_consensus.cc:2749] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:14.064839  7206 raft_consensus.cc:493] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.065267  7206 raft_consensus.cc:515] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.067051  7206 leader_election.cc:290] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.067852  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:14.068014  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:14.068629  7053 raft_consensus.cc:2393] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:14.069675  6944 leader_election.cc:304] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d; no voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:14.070327  7206 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.075505  7206 raft_consensus.cc:2749] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:14.133792  7218 consensus_queue.cc:1048] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.144860  7175 consensus_queue.cc:1048] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.248596  7206 consensus_queue.cc:1048] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.263223  7206 consensus_queue.cc:1048] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:14.283087  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.283823  7127 raft_consensus.cc:606] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:14.289935  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf887671668b458a8c123ae642ea702d"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.290395  7127 raft_consensus.cc:606] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:14.295101  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3413014b59d9416aa098597e395214c8"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.295528  7127 raft_consensus.cc:606] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:14.303877  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.304307  7127 raft_consensus.cc:606] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:14.308144  7215 consensus_queue.cc:1048] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.310534  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.311154  7127 raft_consensus.cc:606] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:14.317440  7129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:14.318058  7129 raft_consensus.cc:606] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:14.319802  7214 consensus_queue.cc:1048] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.335739  7175 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.341535  7214 consensus_queue.cc:1048] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.347043  7214 consensus_queue.cc:1048] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.360046  7053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213044b3cc154dba981cac599832053e"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:53178
I20260709 13:13:14.360633  7053 raft_consensus.cc:606] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:14.368242  7175 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.380657  7219 raft_consensus.cc:993] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.381114  7175 raft_consensus.cc:1081] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.382682  7053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53160
I20260709 13:13:14.383252  7053 raft_consensus.cc:493] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.383615  7053 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.386819  7175 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.390625  7053 raft_consensus.cc:515] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.393031  7053 leader_election.cc:290] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.393383  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:14.394042  6977 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.394547  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.395112  7129 raft_consensus.cc:3055] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.395314  7129 raft_consensus.cc:740] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.395967  7129 consensus_queue.cc:260] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.396741  7129 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.404489  7181 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.407186  7129 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.409196  7181 consensus_queue.cc:1048] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:14.412829  7181 raft_consensus.cc:993] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.413316  7218 raft_consensus.cc:1081] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.415369  7020 leader_election.cc:304] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:14.416405  7214 raft_consensus.cc:2804] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.416937  7214 raft_consensus.cc:697] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:14.417397  6977 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.417745  7214 consensus_queue.cc:237] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.416342  6978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3413014b59d9416aa098597e395214c8"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:13:14.421564  6978 raft_consensus.cc:493] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.422019  6978 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.426105  7228 raft_consensus.cc:993] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.426602  7181 raft_consensus.cc:1081] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.428826  7053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53160
I20260709 13:13:14.430253  7053 raft_consensus.cc:493] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.430651  7053 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.431659  6978 raft_consensus.cc:515] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.435190  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.435755  7129 raft_consensus.cc:3055] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.436095  7129 raft_consensus.cc:740] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.436278  7181 consensus_queue.cc:1048] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.436949  7129 consensus_queue.cc:260] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.437934  7129 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.438153  7053 raft_consensus.cc:515] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.440213  7053 leader_election.cc:290] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.441291  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:14.441911  7052 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.441926  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.441291  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d5a38931bd4cf4b44185ce6f765430" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:14.442718  7127 raft_consensus.cc:3055] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.443114  7127 raft_consensus.cc:740] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.442785  6977 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.443890  7127 consensus_queue.cc:260] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.445029  7127 raft_consensus.cc:3060] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.448078  6875 catalog_manager.cc:5697] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.449050  7052 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.450341  6944 leader_election.cc:304] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:14.450788  6977 raft_consensus.cc:2468] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.451202  7206 raft_consensus.cc:2804] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.444994  7129 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.451663  6979 raft_consensus.cc:1240] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Rejecting Update request from peer aac6280f29ad410fb7865479848aca5f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:14.451768  7206 raft_consensus.cc:697] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:14.452054  7020 leader_election.cc:304] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:14.452828  7206 consensus_queue.cc:237] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.453608  7214 raft_consensus.cc:2804] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.454099  7214 raft_consensus.cc:697] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:14.451247  6978 leader_election.cc:290] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.455052  7214 consensus_queue.cc:237] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.454079  7127 raft_consensus.cc:2468] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.463424  6877 catalog_manager.cc:5697] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.470073  6875 catalog_manager.cc:5697] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.475319  7219 consensus_queue.cc:1048] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.488340  7181 consensus_queue.cc:1048] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.497793  7228 raft_consensus.cc:993] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.498256  7181 raft_consensus.cc:1081] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.499917  6978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf887671668b458a8c123ae642ea702d"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:13:14.500438  6978 raft_consensus.cc:493] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.500753  6978 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.505839  6978 raft_consensus.cc:515] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.508203  6978 leader_election.cc:290] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.508827  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.508440  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf887671668b458a8c123ae642ea702d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:14.509454  7127 raft_consensus.cc:3055] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.509554  7052 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.509850  7127 raft_consensus.cc:740] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.510751  7127 consensus_queue.cc:260] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.512037  7127 raft_consensus.cc:3060] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.517331  7219 raft_consensus.cc:993] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.517840  7219 raft_consensus.cc:1081] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:14.519130  7127 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.518815  7052 raft_consensus.cc:2468] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.519645  6978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:13:14.520368  6978 raft_consensus.cc:493] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.520407  6945 leader_election.cc:304] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:14.520911  6978 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.521379  7206 raft_consensus.cc:2804] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.521835  7206 raft_consensus.cc:697] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:14.522532  7206 consensus_queue.cc:237] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.527166  6978 raft_consensus.cc:515] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.528848  6978 leader_election.cc:290] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.529650  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:14.529155  6877 catalog_manager.cc:5697] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.529984  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e08e9a9f53c40068fbe6ec6a5154954" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.530217  7052 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.530833  7127 raft_consensus.cc:3055] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.531153  7127 raft_consensus.cc:740] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.531877  7127 consensus_queue.cc:260] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.533082  7127 raft_consensus.cc:3060] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.536476  7052 raft_consensus.cc:2468] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.537807  6944 leader_election.cc:304] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:14.538614  7206 raft_consensus.cc:2804] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.538830  7127 raft_consensus.cc:2468] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:14.539134  7206 raft_consensus.cc:697] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:14.540019  7206 consensus_queue.cc:237] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.545578  6877 catalog_manager.cc:5697] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.593643  7219 raft_consensus.cc:993] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.594163  7181 raft_consensus.cc:1081] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:14.595705  7052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53160
I20260709 13:13:14.596199  7052 raft_consensus.cc:493] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.596593  7052 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.601401  7052 raft_consensus.cc:515] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.602990  7052 leader_election.cc:290] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:14.603796  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:14.604101  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514af2f38baf42c28a096e07d44d74b6" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:14.604377  6978 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.604714  7127 raft_consensus.cc:3055] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.605019  7127 raft_consensus.cc:740] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.605674  7127 consensus_queue.cc:260] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.606611  7127 raft_consensus.cc:3060] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.609567  6978 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.610842  7020 leader_election.cc:304] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:14.611549  7214 raft_consensus.cc:2804] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.611569  7127 raft_consensus.cc:2468] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:14.612033  7214 raft_consensus.cc:697] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:14.612949  7214 consensus_queue.cc:237] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.619122  6877 catalog_manager.cc:5697] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.809319  7127 raft_consensus.cc:1275] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.810616  7214 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.818418  6978 raft_consensus.cc:1275] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.820648  7215 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.892704  7215 raft_consensus.cc:993] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:14.893215  7174 raft_consensus.cc:1081] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:14.894722  7127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213044b3cc154dba981cac599832053e"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48866
I20260709 13:13:14.895206  7127 raft_consensus.cc:493] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.895501  7127 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.900527  7127 raft_consensus.cc:515] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.902200  7127 leader_election.cc:290] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:14.902910  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:14.903275  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213044b3cc154dba981cac599832053e" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:14.903403  7052 raft_consensus.cc:1275] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.903590  6978 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.903944  7053 raft_consensus.cc:3055] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.904285  7053 raft_consensus.cc:740] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:14.904955  7206 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.905102  7053 consensus_queue.cc:260] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.906453  7053 raft_consensus.cc:3060] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.911121  6978 raft_consensus.cc:2468] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:14.912474  7094 leader_election.cc:304] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:14.913371  7181 raft_consensus.cc:2804] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.913846  7181 raft_consensus.cc:697] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:14.914224  7127 raft_consensus.cc:1275] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.914661  7181 consensus_queue.cc:237] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:14.915606  7206 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.920680  7053 raft_consensus.cc:2468] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:14.925558  6875 catalog_manager.cc:5697] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 1 to 2, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 2 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.032918  7127 raft_consensus.cc:1275] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.034250  7174 consensus_queue.cc:1048] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.041677  6978 raft_consensus.cc:1275] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.043457  7214 consensus_queue.cc:1048] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.053066  7127 raft_consensus.cc:1275] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.053467  6978 raft_consensus.cc:1275] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.054416  7215 consensus_queue.cc:1048] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:15.055229  7214 consensus_queue.cc:1048] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.057919  7053 raft_consensus.cc:1275] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.061009  7206 consensus_queue.cc:1048] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.074851  7127 raft_consensus.cc:1275] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.076176  7237 consensus_queue.cc:1048] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.095845  7127 raft_consensus.cc:1275] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.096994  7237 consensus_queue.cc:1048] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.104521  7053 raft_consensus.cc:1275] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.105914  7236 consensus_queue.cc:1048] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.511597  7053 raft_consensus.cc:1275] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.512826  7181 consensus_queue.cc:1048] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.522574  6978 raft_consensus.cc:1275] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.524128  7181 consensus_queue.cc:1048] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.386543  6875 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45794:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:17.388628  6875 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:17.436022  6964 tablet_service.cc:1511] Processing CreateTablet for tablet 00d8296c6d0c4d73b3e871b86723277d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:17.436866  7042 tablet_service.cc:1511] Processing CreateTablet for tablet 00d8296c6d0c4d73b3e871b86723277d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:17.437402  6964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d8296c6d0c4d73b3e871b86723277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.438203  7042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d8296c6d0c4d73b3e871b86723277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.439440  7115 tablet_service.cc:1511] Processing CreateTablet for tablet 00d8296c6d0c4d73b3e871b86723277d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:17.440699  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d8296c6d0c4d73b3e871b86723277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.444572  7038 tablet_service.cc:1511] Processing CreateTablet for tablet 051f183055e44e8cad47762978a50a02 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:17.445914  7038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051f183055e44e8cad47762978a50a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.446872  6966 tablet_service.cc:1511] Processing CreateTablet for tablet 051f183055e44e8cad47762978a50a02 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:17.448158  6966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051f183055e44e8cad47762978a50a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.448534  7118 tablet_service.cc:1511] Processing CreateTablet for tablet 051f183055e44e8cad47762978a50a02 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:17.449833  7118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051f183055e44e8cad47762978a50a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.451112  6968 tablet_service.cc:1511] Processing CreateTablet for tablet e8f277bf8fbb438fbeae0c890197f236 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:17.452373  6968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f277bf8fbb438fbeae0c890197f236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.457744  7036 tablet_service.cc:1511] Processing CreateTablet for tablet b51f43462ca246efbd875ed887500e66 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:17.457777  7040 tablet_service.cc:1511] Processing CreateTablet for tablet e8f277bf8fbb438fbeae0c890197f236 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:17.458457  7041 tablet_service.cc:1511] Processing CreateTablet for tablet b9b8db8111084632b9755559defe0a4d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:17.459160  7036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51f43462ca246efbd875ed887500e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.460212  7044 tablet_service.cc:1511] Processing CreateTablet for tablet ab44885d6bb241b0a452bd0cc9593186 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:17.460202  7041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b8db8111084632b9755559defe0a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.462719  7274 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.465560  7113 tablet_service.cc:1511] Processing CreateTablet for tablet e8f277bf8fbb438fbeae0c890197f236 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:17.466198  7116 tablet_service.cc:1511] Processing CreateTablet for tablet b9b8db8111084632b9755559defe0a4d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:17.467665  7044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44885d6bb241b0a452bd0cc9593186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.467497  6967 tablet_service.cc:1511] Processing CreateTablet for tablet b9b8db8111084632b9755559defe0a4d (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:17.468220  7112 tablet_service.cc:1511] Processing CreateTablet for tablet ab44885d6bb241b0a452bd0cc9593186 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:17.468878  6967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b8db8111084632b9755559defe0a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.468627  6965 tablet_service.cc:1511] Processing CreateTablet for tablet ab44885d6bb241b0a452bd0cc9593186 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:17.469901  6965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44885d6bb241b0a452bd0cc9593186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.470253  6969 tablet_service.cc:1511] Processing CreateTablet for tablet b51f43462ca246efbd875ed887500e66 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:17.471076  7113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f277bf8fbb438fbeae0c890197f236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.471521  6969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51f43462ca246efbd875ed887500e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.472581  7037 tablet_service.cc:1511] Processing CreateTablet for tablet c11b3fda33f04306b10cce00f07e8a26 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:17.473860  7037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11b3fda33f04306b10cce00f07e8a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.475844  6962 tablet_service.cc:1511] Processing CreateTablet for tablet c11b3fda33f04306b10cce00f07e8a26 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:17.476866  7040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f277bf8fbb438fbeae0c890197f236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.477145  6962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11b3fda33f04306b10cce00f07e8a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.479075  7112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab44885d6bb241b0a452bd0cc9593186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.467579  7114 tablet_service.cc:1511] Processing CreateTablet for tablet b51f43462ca246efbd875ed887500e66 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:17.480610  7114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51f43462ca246efbd875ed887500e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.483053  7116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b8db8111084632b9755559defe0a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.524057  7274 tablet_bootstrap.cc:654] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.524693  7111 tablet_service.cc:1511] Processing CreateTablet for tablet c11b3fda33f04306b10cce00f07e8a26 (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:17.526100  7111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11b3fda33f04306b10cce00f07e8a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.538374  6961 tablet_service.cc:1511] Processing CreateTablet for tablet acf3a227d94d474d86d1991a6efd3eeb (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:17.539815  6961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf3a227d94d474d86d1991a6efd3eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.566962  7275 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.567847  7274 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.572626  7274 ts_tablet_manager.cc:1403] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.010s
I20260709 13:13:17.577515  7275 tablet_bootstrap.cc:654] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.577178  7041 tablet_service.cc:1511] Processing CreateTablet for tablet acf3a227d94d474d86d1991a6efd3eeb (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:17.577211  7274 raft_consensus.cc:359] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.578372  7274 raft_consensus.cc:385] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.578749  7041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf3a227d94d474d86d1991a6efd3eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.578773  7274 raft_consensus.cc:740] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.580000  7274 consensus_queue.cc:260] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.582432  7274 ts_tablet_manager.cc:1434] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:17.583535  7274 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.590418  7274 tablet_bootstrap.cc:654] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:17.605334  6925 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:17.605543  7276 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.611157  7041 tablet_service.cc:1511] Processing CreateTablet for tablet d29c769b6dd64fc4829b28d6eeb9b27c (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:17.612965  6961 tablet_service.cc:1511] Processing CreateTablet for tablet d29c769b6dd64fc4829b28d6eeb9b27c (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:17.613108  7118 tablet_service.cc:1511] Processing CreateTablet for tablet d29c769b6dd64fc4829b28d6eeb9b27c (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:17.613567  7041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29c769b6dd64fc4829b28d6eeb9b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.615088  7118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29c769b6dd64fc4829b28d6eeb9b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.613778  7115 tablet_service.cc:1511] Processing CreateTablet for tablet acf3a227d94d474d86d1991a6efd3eeb (DEFAULT_TABLE table=soft_deleted_table [id=828644d65eb647979b9de62608a90f65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:17.617870  7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf3a227d94d474d86d1991a6efd3eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.618301  7274 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.619509  7274 ts_tablet_manager.cc:1403] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:13:17.619791  7276 tablet_bootstrap.cc:654] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.618978  7275 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.621359  7275 ts_tablet_manager.cc:1403] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.004s
I20260709 13:13:17.615088  6961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29c769b6dd64fc4829b28d6eeb9b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.625129  7275 raft_consensus.cc:359] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.626199  7275 raft_consensus.cc:385] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.629263  7275 raft_consensus.cc:740] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.628437  7274 raft_consensus.cc:359] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.630963  7274 raft_consensus.cc:385] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.631444  7274 raft_consensus.cc:740] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.632635  7274 consensus_queue.cc:260] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.636432  7274 ts_tablet_manager.cc:1434] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:17.637732  7274 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.630287  7275 consensus_queue.cc:260] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.640947  7275 ts_tablet_manager.cc:1434] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:13:17.641920  7275 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.654235  7276 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.654986  7276 ts_tablet_manager.cc:1403] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.004s
I20260709 13:13:17.658304  7276 raft_consensus.cc:359] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.658893  7274 tablet_bootstrap.cc:654] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.659137  7276 raft_consensus.cc:385] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.661106  7276 raft_consensus.cc:740] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.660620  7275 tablet_bootstrap.cc:654] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.664839  7276 consensus_queue.cc:260] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.666833  7274 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.667328  7276 ts_tablet_manager.cc:1434] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:17.667364  7274 ts_tablet_manager.cc:1403] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 13:13:17.668313  7276 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.671847  7274 raft_consensus.cc:359] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.674829  7276 tablet_bootstrap.cc:654] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.675145  7274 raft_consensus.cc:385] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.675622  7274 raft_consensus.cc:740] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.676719  7274 consensus_queue.cc:260] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.684017  7214 raft_consensus.cc:493] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.684495  7214 raft_consensus.cc:515] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.688545  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:17.691263  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
W20260709 13:13:17.693110  7020 leader_election.cc:343] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:17.694012  7020 leader_election.cc:343] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.694504  7020 leader_election.cc:304] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f
I20260709 13:13:17.686546  7214 leader_election.cc:290] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.705092  7214 raft_consensus.cc:2749] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.709482  7275 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.710109  7275 ts_tablet_manager.cc:1403] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.018s
I20260709 13:13:17.710294  7276 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.710765  7274 ts_tablet_manager.cc:1434] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.043s	user 0.018s	sys 0.021s
I20260709 13:13:17.710884  7276 ts_tablet_manager.cc:1403] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.012s
I20260709 13:13:17.712044  7274 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.713295  7275 raft_consensus.cc:359] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.714299  7275 raft_consensus.cc:385] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.714666  7275 raft_consensus.cc:740] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.715515  7275 consensus_queue.cc:260] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.716194  7276 raft_consensus.cc:359] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.717054  7276 raft_consensus.cc:385] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.717367  7276 raft_consensus.cc:740] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.718156  7276 consensus_queue.cc:260] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.719993  7274 tablet_bootstrap.cc:654] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.720489  7275 ts_tablet_manager.cc:1434] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:13:17.720593  7276 ts_tablet_manager.cc:1434] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:17.721601  7275 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.721701  7276 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.728817  7276 tablet_bootstrap.cc:654] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.730341  7275 tablet_bootstrap.cc:654] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.731952  7274 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.732612  7274 ts_tablet_manager.cc:1403] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:13:17.736661  7274 raft_consensus.cc:359] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.737861  7274 raft_consensus.cc:385] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.738351  7274 raft_consensus.cc:740] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.739564  7274 consensus_queue.cc:260] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.740486  7276 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.742060  7276 ts_tablet_manager.cc:1403] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:13:17.742868  7274 ts_tablet_manager.cc:1434] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:13:17.744170  7274 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.747063  7275 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.747673  7275 ts_tablet_manager.cc:1403] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 13:13:17.751245  7276 raft_consensus.cc:359] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.752030  7274 tablet_bootstrap.cc:654] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.751706  7275 raft_consensus.cc:359] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.752261  7276 raft_consensus.cc:385] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.752591  7275 raft_consensus.cc:385] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.752890  7276 raft_consensus.cc:740] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.753019  7275 raft_consensus.cc:740] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.754009  7276 consensus_queue.cc:260] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.755034  7275 consensus_queue.cc:260] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.756480  7276 ts_tablet_manager.cc:1434] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:13:17.757584  7276 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.764065  7276 tablet_bootstrap.cc:654] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.765055  7275 ts_tablet_manager.cc:1434] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:17.770810  7275 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.779831  7275 tablet_bootstrap.cc:654] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.793347  7275 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.794138  7275 ts_tablet_manager.cc:1403] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.003s
I20260709 13:13:17.798162  7275 raft_consensus.cc:359] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.799070  7275 raft_consensus.cc:385] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.799340  7275 raft_consensus.cc:740] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.800099  7275 consensus_queue.cc:260] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.801062  7274 tablet_bootstrap.cc:492] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.801626  7274 ts_tablet_manager.cc:1403] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.034s
I20260709 13:13:17.802513  7275 ts_tablet_manager.cc:1434] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:13:17.803805  7275 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.804889  7274 raft_consensus.cc:359] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.805802  7274 raft_consensus.cc:385] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.806154  7274 raft_consensus.cc:740] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.807078  7274 consensus_queue.cc:260] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.809911  7274 ts_tablet_manager.cc:1434] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:17.810897  7275 tablet_bootstrap.cc:654] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.811014  7274 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.811432  7276 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.812023  7276 ts_tablet_manager.cc:1403] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.014s
I20260709 13:13:17.815294  7276 raft_consensus.cc:359] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.816030  7276 raft_consensus.cc:385] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.816358  7276 raft_consensus.cc:740] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.817087  7276 consensus_queue.cc:260] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.819380  7276 ts_tablet_manager.cc:1434] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:17.820417  7276 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.824565  7274 tablet_bootstrap.cc:654] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.827800  7275 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.827919  7276 tablet_bootstrap.cc:654] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.828554  7275 ts_tablet_manager.cc:1403] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.013s
I20260709 13:13:17.832746  7275 raft_consensus.cc:359] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.833832  7275 raft_consensus.cc:385] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.834185  7275 raft_consensus.cc:740] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.835011  7275 consensus_queue.cc:260] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.836453  7260 raft_consensus.cc:493] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.836592  7274 tablet_bootstrap.cc:492] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.837268  7274 ts_tablet_manager.cc:1403] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:13:17.836925  7260 raft_consensus.cc:515] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.837440  7275 ts_tablet_manager.cc:1434] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:17.838546  7275 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.839203  7260 leader_election.cc:290] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.840288  7274 raft_consensus.cc:359] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.840713  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:17.841037  7274 raft_consensus.cc:385] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.841389  7274 raft_consensus.cc:740] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.842562  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:17.842365  7274 consensus_queue.cc:260] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.842902  7284 raft_consensus.cc:493] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.843209  7127 raft_consensus.cc:2468] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:17.843425  7284 raft_consensus.cc:515] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.845541  7284 leader_election.cc:290] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.846005  7275 tablet_bootstrap.cc:654] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.851851  7276 tablet_bootstrap.cc:492] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.847404  6945 leader_election.cc:304] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:17.854885  7276 ts_tablet_manager.cc:1403] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.000s
I20260709 13:13:17.855293  7260 raft_consensus.cc:2804] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.855739  7260 raft_consensus.cc:493] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.856099  7260 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.857762  7275 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:17.858309  7275 ts_tablet_manager.cc:1403] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:13:17.857905  7276 raft_consensus.cc:359] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.851145  7274 ts_tablet_manager.cc:1434] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:17.846175  7284 raft_consensus.cc:493] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.859792  7274 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.858642  7276 raft_consensus.cc:385] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.861466  7275 raft_consensus.cc:359] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.862142  7276 raft_consensus.cc:740] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.862272  7275 raft_consensus.cc:385] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.862713  7275 raft_consensus.cc:740] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.863152  7276 consensus_queue.cc:260] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.860208  7284 raft_consensus.cc:515] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.863528  7275 consensus_queue.cc:260] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.863991  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44885d6bb241b0a452bd0cc9593186" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:17.864684  6978 raft_consensus.cc:2468] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:17.865828  7284 leader_election.cc:290] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.868013  7260 raft_consensus.cc:515] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.870869  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:17.872610  7274 tablet_bootstrap.cc:654] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.874298  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:17.874596  7052 raft_consensus.cc:2468] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:17.874958  7127 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.876853  7276 ts_tablet_manager.cc:1434] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:13:17.878269  7276 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.884739  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44885d6bb241b0a452bd0cc9593186" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:17.885452  7129 raft_consensus.cc:2468] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:17.886848  7276 tablet_bootstrap.cc:654] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.889711  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:17.890255  7127 raft_consensus.cc:2468] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:17.896628  7276 tablet_bootstrap.cc:492] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:17.897362  7276 ts_tablet_manager.cc:1403] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:13:17.897888  7284 raft_consensus.cc:493] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.898401  7284 raft_consensus.cc:515] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.900365  7284 leader_election.cc:290] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.901233  7020 leader_election.cc:304] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:17.901506  7276 raft_consensus.cc:359] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.903738  7214 raft_consensus.cc:2804] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.904212  7214 raft_consensus.cc:493] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.904676  7214 raft_consensus.cc:3060] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.905699  7260 leader_election.cc:290] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.907488  6945 leader_election.cc:304] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:17.902573  7276 raft_consensus.cc:385] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.909607  7276 raft_consensus.cc:740] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.910598  7276 consensus_queue.cc:260] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.912225  7260 raft_consensus.cc:493] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.915587  7260 raft_consensus.cc:515] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.926875  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:17.927577  7052 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:17.929246  6944 leader_election.cc:304] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:17.917313  7299 raft_consensus.cc:2804] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.913795  7276 ts_tablet_manager.cc:1434] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:13:17.930540  7294 raft_consensus.cc:493] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.931213  7294 raft_consensus.cc:515] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.932986  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:17.933916  7299 raft_consensus.cc:697] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:17.931716  7276 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:17.920545  7214 raft_consensus.cc:515] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.934022  7127 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:17.933082  7260 leader_election.cc:290] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.932981  7298 raft_consensus.cc:2804] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.935516  7298 raft_consensus.cc:493] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.935901  7298 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.935992  7299 consensus_queue.cc:237] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.936592  7214 leader_election.cc:290] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.941474  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:17.942649  7127 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:17.943569  7275 ts_tablet_manager.cc:1434] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.085s	user 0.021s	sys 0.035s
I20260709 13:13:17.941875  7276 tablet_bootstrap.cc:654] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.943462  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44885d6bb241b0a452bd0cc9593186" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:17.944669  7274 tablet_bootstrap.cc:492] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:17.945009  7126 raft_consensus.cc:3060] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.945237  7274 ts_tablet_manager.cc:1403] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.033s
I20260709 13:13:17.948112  7275 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:17.948475  7274 raft_consensus.cc:359] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.949230  7274 raft_consensus.cc:385] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.949501  7274 raft_consensus.cc:740] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.950356  7274 consensus_queue.cc:260] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.953343  7274 ts_tablet_manager.cc:1434] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:17.955835  7126 raft_consensus.cc:2468] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:17.957463  7020 leader_election.cc:304] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:17.958504  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:17.958904  7020 leader_election.cc:304] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:17.960013  7284 raft_consensus.cc:2804] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.960144  7214 raft_consensus.cc:2804] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.960438  7284 raft_consensus.cc:493] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.960892  7284 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.956298  7274 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:17.954736  7298 raft_consensus.cc:515] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.956898  7275 tablet_bootstrap.cc:654] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.972322  7298 leader_election.cc:290] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.973078  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:17.980604  7294 leader_election.cc:290] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.984962  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:17.985965  7126 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.988457  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
W20260709 13:13:17.990226  7020 leader_election.cc:343] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.971740  7284 raft_consensus.cc:515] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:17.992067  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:17.992167  7052 raft_consensus.cc:2393] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate d805c8f29e394a3c9a22ebb16138e228 in this term.
I20260709 13:13:17.994963  7284 leader_election.cc:290] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:17.993323  6978 raft_consensus.cc:2393] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d805c8f29e394a3c9a22ebb16138e228 in current term 1: Already voted for candidate 7b492b4a613b413d9e2af5e042ff5a0d in this term.
I20260709 13:13:17.998107  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.002779  7214 raft_consensus.cc:697] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.004199  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab44885d6bb241b0a452bd0cc9593186" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.004068  7214 consensus_queue.cc:237] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.005092  6978 raft_consensus.cc:3060] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.007552  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.008177  6979 raft_consensus.cc:2468] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:18.002333  7126 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:18.012997  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.014993  6979 raft_consensus.cc:2393] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d805c8f29e394a3c9a22ebb16138e228 in current term 1: Already voted for candidate 7b492b4a613b413d9e2af5e042ff5a0d in this term.
I20260709 13:13:18.015729  7020 leader_election.cc:304] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.017820  7294 raft_consensus.cc:2749] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.017948  7020 leader_election.cc:304] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.019068  7294 raft_consensus.cc:2804] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.019450  7294 raft_consensus.cc:493] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.019387  7020 leader_election.cc:304] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.019985  7294 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.021822  7274 tablet_bootstrap.cc:654] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.026482  7284 raft_consensus.cc:2749] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.030006  7294 raft_consensus.cc:515] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.038040  7294 leader_election.cc:290] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.034224  6945 leader_election.cc:304] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.039654  7298 raft_consensus.cc:2804] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.040333  7298 raft_consensus.cc:697] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:18.041491  7298 consensus_queue.cc:237] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.035748  7299 raft_consensus.cc:493] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.044211  7299 raft_consensus.cc:515] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.045435  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.033198  7276 tablet_bootstrap.cc:492] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:18.046123  6874 catalog_manager.cc:5697] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.046188  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.049631  6978 raft_consensus.cc:2468] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.059533  7276 ts_tablet_manager.cc:1403] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.035s
I20260709 13:13:18.058390  6979 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.065802  6877 catalog_manager.cc:5697] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:18.068799  7020 leader_election.cc:343] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.071120  7275 tablet_bootstrap.cc:492] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:18.071920  7275 ts_tablet_manager.cc:1403] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.035s
I20260709 13:13:18.075934  7262 raft_consensus.cc:493] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.075518  7276 raft_consensus.cc:359] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.076740  7276 raft_consensus.cc:385] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.076674  7262 raft_consensus.cc:515] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.077350  7276 raft_consensus.cc:740] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.078437  7276 consensus_queue.cc:260] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.080193  7262 leader_election.cc:290] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.080875  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.081704  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:18.081939  6979 raft_consensus.cc:2468] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.084064  7020 leader_election.cc:304] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.084147  7052 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:18.084271  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:18.084923  7294 raft_consensus.cc:2804] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.084998  7053 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:18.085465  7294 raft_consensus.cc:697] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.086478  7262 raft_consensus.cc:493] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.086280  7294 consensus_queue.cc:237] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
W20260709 13:13:18.086355  7094 leader_election.cc:343] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.087018  7262 raft_consensus.cc:515] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.089032  7093 leader_election.cc:304] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:18.089236  7262 leader_election.cc:290] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.089824  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.090520  6977 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:18.090528  7299 leader_election.cc:290] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.089826  7262 raft_consensus.cc:2804] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.091711  7262 raft_consensus.cc:493] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.092207  7276 ts_tablet_manager.cc:1434] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:13:18.092135  7262 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.092590  7094 leader_election.cc:304] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:18.093058  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:18.093538  7301 raft_consensus.cc:2804] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.093721  7053 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 0.
I20260709 13:13:18.093969  7301 raft_consensus.cc:493] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.094352  7301 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.091933  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:18.095674  7276 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:18.098435  7214 raft_consensus.cc:493] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.098532  6944 leader_election.cc:304] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.099262  7214 raft_consensus.cc:515] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.101416  7214 leader_election.cc:290] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.103366  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:18.103477  7299 raft_consensus.cc:2804] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.104007  7299 raft_consensus.cc:493] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.104372  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.104408  7299 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.104935  7274 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:18.105068  6977 raft_consensus.cc:2468] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:18.105463  7274 ts_tablet_manager.cc:1403] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.025s
I20260709 13:13:18.103395  7301 raft_consensus.cc:515] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.106316  7020 leader_election.cc:304] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.106942  7126 raft_consensus.cc:2393] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:18.104032  7127 raft_consensus.cc:2468] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:18.108434  7275 raft_consensus.cc:359] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.109161  7275 raft_consensus.cc:385] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.109457  7275 raft_consensus.cc:740] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.110262  7275 consensus_queue.cc:260] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.112067  7301 leader_election.cc:290] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.112382  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.112646  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.113288  7053 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.109607  7214 raft_consensus.cc:2804] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.114060  7214 raft_consensus.cc:493] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.114439  7214 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.114850  7274 raft_consensus.cc:359] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.115541  7274 raft_consensus.cc:385] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.115813  7274 raft_consensus.cc:740] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.116333  7276 tablet_bootstrap.cc:654] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.119378  7262 raft_consensus.cc:515] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.121415  7053 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:18.124166  7274 consensus_queue.cc:260] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.126682  7093 leader_election.cc:304] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.122844  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.128022  6979 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.128067  7301 raft_consensus.cc:2804] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.120968  7299 raft_consensus.cc:515] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.132604  6977 raft_consensus.cc:2393] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac6280f29ad410fb7865479848aca5f in current term 1: Already voted for candidate 7b492b4a613b413d9e2af5e042ff5a0d in this term.
I20260709 13:13:18.135437  7299 leader_election.cc:290] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.137845  7053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.136620  7127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.136970  7301 raft_consensus.cc:697] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:18.139569  7301 consensus_queue.cc:237] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.123654  7275 ts_tablet_manager.cc:1434] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:13:18.144486  6979 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:18.144980  7275 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:18.146056  7094 leader_election.cc:304] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:18.127351  7274 ts_tablet_manager.cc:1434] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:13:18.146983  7314 raft_consensus.cc:2804] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.147569  7274 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: Bootstrap starting.
I20260709 13:13:18.138912  7053 raft_consensus.cc:2393] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b492b4a613b413d9e2af5e042ff5a0d in current term 1: Already voted for candidate aac6280f29ad410fb7865479848aca5f in this term.
I20260709 13:13:18.155670  7262 leader_election.cc:290] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.156999  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.156816  7214 raft_consensus.cc:515] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.157588  7052 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.160234  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.160866  6979 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.161285  7314 raft_consensus.cc:697] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:18.162807  7314 consensus_queue.cc:237] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.167454  7052 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 1.
I20260709 13:13:18.169844  7214 leader_election.cc:290] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.172683  6945 leader_election.cc:304] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d; no voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.174064  7275 tablet_bootstrap.cc:654] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.173838  7299 raft_consensus.cc:2749] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.171191  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.175257  7126 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.175704  7274 tablet_bootstrap.cc:654] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.185606  6979 raft_consensus.cc:2468] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.186983  7020 leader_election.cc:304] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.187911  7214 raft_consensus.cc:2804] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.188697  7214 raft_consensus.cc:697] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.189076  6875 catalog_manager.cc:5697] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.189549  7214 consensus_queue.cc:237] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.187695  7126 raft_consensus.cc:2468] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.204531  7276 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:18.205087  7276 ts_tablet_manager.cc:1403] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.110s	user 0.023s	sys 0.023s
I20260709 13:13:18.213395  7276 raft_consensus.cc:359] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.214314  7276 raft_consensus.cc:385] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.214658  7276 raft_consensus.cc:740] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.215559  7276 consensus_queue.cc:260] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.219074  6874 catalog_manager.cc:5697] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.221328  7276 ts_tablet_manager.cc:1434] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:13:18.222723  7276 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: Bootstrap starting.
I20260709 13:13:18.224033  7314 raft_consensus.cc:493] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.224561  7314 raft_consensus.cc:515] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.228231  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.229067  6977 raft_consensus.cc:2393] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac6280f29ad410fb7865479848aca5f in current term 1: Already voted for candidate d805c8f29e394a3c9a22ebb16138e228 in this term.
I20260709 13:13:18.230425  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:18.232772  7093 leader_election.cc:304] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac6280f29ad410fb7865479848aca5f; no voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.233662  7301 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.234297  7274 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: No bootstrap required, opened a new log
I20260709 13:13:18.234803  7274 ts_tablet_manager.cc:1403] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.016s
I20260709 13:13:18.226624  7314 leader_election.cc:290] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.237629  7274 raft_consensus.cc:359] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.238346  7274 raft_consensus.cc:385] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.238612  7274 raft_consensus.cc:740] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.239337  7274 consensus_queue.cc:260] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.241083  7301 raft_consensus.cc:2749] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.241799  7276 tablet_bootstrap.cc:654] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.246066  7275 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:18.246592  7275 ts_tablet_manager.cc:1403] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.020s
I20260709 13:13:18.248116  7274 ts_tablet_manager.cc:1434] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:18.242641  6875 catalog_manager.cc:5697] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 0 to 1, leader changed from <none> to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 1 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.249619  7275 raft_consensus.cc:359] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.251062  7275 raft_consensus.cc:385] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.251402  7275 raft_consensus.cc:740] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.252085  7275 consensus_queue.cc:260] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.253288  7276 tablet_bootstrap.cc:492] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: No bootstrap required, opened a new log
I20260709 13:13:18.253763  7276 ts_tablet_manager.cc:1403] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.007s
I20260709 13:13:18.252689  6874 catalog_manager.cc:5697] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.256443  7275 ts_tablet_manager.cc:1434] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:18.256420  7276 raft_consensus.cc:359] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.257161  7276 raft_consensus.cc:385] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.257457  7276 raft_consensus.cc:740] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.258183  7276 consensus_queue.cc:260] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.258204  6874 catalog_manager.cc:5697] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.260275  7275 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: Bootstrap starting.
I20260709 13:13:18.260368  7276 ts_tablet_manager.cc:1434] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:18.265954  7275 tablet_bootstrap.cc:654] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.269953  7275 tablet_bootstrap.cc:492] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: No bootstrap required, opened a new log
I20260709 13:13:18.270380  7275 ts_tablet_manager.cc:1403] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:18.273025  7275 raft_consensus.cc:359] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.273972  7275 raft_consensus.cc:385] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.274305  7275 raft_consensus.cc:740] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.274940  7275 consensus_queue.cc:260] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.276837  7275 ts_tablet_manager.cc:1434] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:18.280027  7214 raft_consensus.cc:493] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.280581  7214 raft_consensus.cc:515] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.282646  7214 leader_election.cc:290] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.284411  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" is_pre_election: true
I20260709 13:13:18.285118  6977 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:18.286826  7020 leader_election.cc:304] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.287420  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:18.287992  7126 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 0.
I20260709 13:13:18.288051  7305 raft_consensus.cc:2804] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.288507  7305 raft_consensus.cc:493] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.288829  7305 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.296221  7305 raft_consensus.cc:515] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.298094  7305 leader_election.cc:290] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.298938  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.299103  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.299512  6977 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.299743  7126 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.304436  6977 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.304868  7126 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 1.
I20260709 13:13:18.305508  7020 leader_election.cc:304] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.306392  7305 raft_consensus.cc:2804] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.306840  7305 raft_consensus.cc:697] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.307605  7305 consensus_queue.cc:237] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.316263  6874 catalog_manager.cc:5697] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 0 to 1, leader changed from <none> to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 1 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.404794  7052 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.407927  7305 consensus_queue.cc:1048] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.412207  7299 consensus_queue.cc:1048] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.425997  7305 consensus_queue.cc:1048] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.437892  7298 consensus_queue.cc:1048] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.453401  7298 raft_consensus.cc:493] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.453940  7298 raft_consensus.cc:515] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.456969  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228" is_pre_election: true
I20260709 13:13:18.457460  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f" is_pre_election: true
I20260709 13:13:18.457765  7052 raft_consensus.cc:2468] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:18.458211  7126 raft_consensus.cc:2468] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 0.
I20260709 13:13:18.456845  7298 leader_election.cc:290] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.459012  6944 leader_election.cc:304] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.459926  7298 raft_consensus.cc:2804] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.460325  7298 raft_consensus.cc:493] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.460634  7298 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.466524  7298 raft_consensus.cc:515] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.468194  7298 leader_election.cc:290] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.469096  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.469266  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.469849  7052 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.469919  7126 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.475178  7052 raft_consensus.cc:2468] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:18.475257  7126 raft_consensus.cc:2468] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 1.
I20260709 13:13:18.476434  6944 leader_election.cc:304] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.477150  7298 raft_consensus.cc:2804] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.477634  7298 raft_consensus.cc:697] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:18.478272  7298 consensus_queue.cc:237] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.486289  6875 catalog_manager.cc:5697] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 1 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.531512  7301 consensus_queue.cc:1048] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.540118  7305 consensus_queue.cc:1048] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.543673  7262 consensus_queue.cc:1048] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.549424  7305 consensus_queue.cc:1048] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.551681  7296 consensus_queue.cc:1048] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.576010  7298 consensus_queue.cc:1048] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.644586  7301 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.656435  7301 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.673643  7052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "051f183055e44e8cad47762978a50a02"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:53178
I20260709 13:13:18.674252  7052 raft_consensus.cc:606] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:18.679383  7127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:18.679899  7127 raft_consensus.cc:606] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:18.684767  7052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b51f43462ca246efbd875ed887500e66"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:53178
I20260709 13:13:18.685318  7052 raft_consensus.cc:606] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Received request to transfer leadership to TS 7b492b4a613b413d9e2af5e042ff5a0d
I20260709 13:13:18.694492  7284 consensus_queue.cc:1048] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.701797  7214 raft_consensus.cc:993] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:18.702232  7214 raft_consensus.cc:1081] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:18.702800  6977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:44132
I20260709 13:13:18.703459  6977 raft_consensus.cc:606] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.704468  6978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b51f43462ca246efbd875ed887500e66"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44126
I20260709 13:13:18.705018  6978 raft_consensus.cc:493] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.705341  6978 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.709476  7305 consensus_queue.cc:1048] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.713290  7126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:48874
I20260709 13:13:18.713189  6978 raft_consensus.cc:515] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.714129  7126 raft_consensus.cc:606] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.719177  6978 leader_election.cc:290] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.720669  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.722059  6978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
mode: GRACEFUL
new_leader_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:44132
I20260709 13:13:18.722656  6978 raft_consensus.cc:606] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Received request to transfer leadership to TS d805c8f29e394a3c9a22ebb16138e228
I20260709 13:13:18.723249  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51f43462ca246efbd875ed887500e66" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.723896  7052 raft_consensus.cc:3055] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.724241  7052 raft_consensus.cc:740] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.725033  7052 consensus_queue.cc:260] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.726293  7052 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.728360  7053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:53178
I20260709 13:13:18.728891  7053 raft_consensus.cc:606] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.736471  7052 raft_consensus.cc:2468] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:18.737504  6944 leader_election.cc:304] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.738240  7296 raft_consensus.cc:2804] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.738669  7296 raft_consensus.cc:697] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:18.739517  7296 consensus_queue.cc:237] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.745889  6877 catalog_manager.cc:5697] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.753577  7284 consensus_queue.cc:1048] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.763577  7305 consensus_queue.cc:1048] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.772797  7305 raft_consensus.cc:993] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:18.773284  7214 raft_consensus.cc:1081] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:18.774807  7127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48866
I20260709 13:13:18.775305  7127 raft_consensus.cc:493] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.775642  7127 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.780680  7127 raft_consensus.cc:515] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.782488  7127 leader_election.cc:290] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:18.782837  6978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.783116  7052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29c769b6dd64fc4829b28d6eeb9b27c" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.783481  6978 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.783834  7052 raft_consensus.cc:3055] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.784192  7052 raft_consensus.cc:740] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.784896  7052 consensus_queue.cc:260] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.785830  7052 raft_consensus.cc:3060] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.788093  6978 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:18.789340  7094 leader_election.cc:304] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:18.790176  7301 raft_consensus.cc:2804] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.790628  7301 raft_consensus.cc:697] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:18.790982  7052 raft_consensus.cc:2468] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:18.791494  7301 consensus_queue.cc:237] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.797899  6875 catalog_manager.cc:5697] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 1 to 2, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 2 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.919519  7262 raft_consensus.cc:993] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:18.919317  7296 consensus_queue.cc:1048] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.920077  7301 raft_consensus.cc:1081] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:18.921535  6978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:13:18.922055  6978 raft_consensus.cc:493] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.922379  6978 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.926168  7299 raft_consensus.cc:993] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:18.926637  7299 raft_consensus.cc:1081] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:18.928408  7053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53166
I20260709 13:13:18.928957  7053 raft_consensus.cc:493] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.929306  7053 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.931046  7260 consensus_queue.cc:1048] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.933645  6978 raft_consensus.cc:515] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.936558  6978 leader_election.cc:290] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.936522  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:18.937178  7054 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.937611  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f277bf8fbb438fbeae0c890197f236" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.938258  7126 raft_consensus.cc:3055] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.938060  7053 raft_consensus.cc:515] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.938628  7126 raft_consensus.cc:740] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:18.939512  7126 consensus_queue.cc:260] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.940547  7126 raft_consensus.cc:3060] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.941090  7053 leader_election.cc:290] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:18.941716  7129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:18.943773  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf3a227d94d474d86d1991a6efd3eeb" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:18.944042  7052 raft_consensus.cc:1240] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Rejecting Update request from peer 7b492b4a613b413d9e2af5e042ff5a0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:18.944252  6977 raft_consensus.cc:3055] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.944682  6977 raft_consensus.cc:740] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:18.945408  6977 consensus_queue.cc:260] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.946136  6977 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.951824  7054 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:18.953188  6944 leader_election.cc:304] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:18.953977  7260 raft_consensus.cc:2804] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.954450  7260 raft_consensus.cc:697] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:18.955294  7260 consensus_queue.cc:237] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.956332  6977 raft_consensus.cc:2468] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:18.957574  7126 raft_consensus.cc:2468] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:18.957607  7020 leader_election.cc:304] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, d805c8f29e394a3c9a22ebb16138e228; no voters: aac6280f29ad410fb7865479848aca5f
I20260709 13:13:18.958882  7214 raft_consensus.cc:2804] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.959353  7214 raft_consensus.cc:697] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:18.960093  7214 consensus_queue.cc:237] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:18.964285  6877 catalog_manager.cc:5697] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.968772  6874 catalog_manager.cc:5697] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.034165  7299 raft_consensus.cc:993] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:19.034601  7260 raft_consensus.cc:1081] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:19.036111  7054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53166
I20260709 13:13:19.036571  7054 raft_consensus.cc:493] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.036836  7054 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.042236  7054 raft_consensus.cc:515] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.044241  7054 leader_election.cc:290] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:19.044734  7301 raft_consensus.cc:993] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: : Instructing follower d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:19.045230  7301 raft_consensus.cc:1081] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Signalling peer d805c8f29e394a3c9a22ebb16138e228 to start an election
I20260709 13:13:19.045883  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:19.046015  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b8db8111084632b9755559defe0a4d" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:19.046749  7126 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.046793  6977 raft_consensus.cc:3055] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.047070  7054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
 from {username='slave'} at 127.0.0.1:53160
I20260709 13:13:19.047389  6977 raft_consensus.cc:740] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:19.047757  7054 raft_consensus.cc:493] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.048174  7054 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.048231  6977 consensus_queue.cc:260] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.049621  6977 raft_consensus.cc:3060] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.054795  6977 raft_consensus.cc:2468] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:19.054885  7126 raft_consensus.cc:2468] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:19.055225  7054 raft_consensus.cc:515] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.056151  7020 leader_election.cc:304] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:19.056983  7214 raft_consensus.cc:2804] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.057376  7054 leader_election.cc:290] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:19.057451  7214 raft_consensus.cc:697] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:19.058445  7214 consensus_queue.cc:237] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.059217  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:19.059401  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "d805c8f29e394a3c9a22ebb16138e228" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:19.059947  7126 raft_consensus.cc:3055] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.060014  6977 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.060514  7126 raft_consensus.cc:740] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:19.061548  7126 consensus_queue.cc:260] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.062930  7126 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.068598  6874 catalog_manager.cc:5697] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.069904  7126 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:19.070102  6977 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d805c8f29e394a3c9a22ebb16138e228 in term 2.
I20260709 13:13:19.071053  7020 leader_election.cc:304] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:19.071919  7214 raft_consensus.cc:2804] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.072606  7214 raft_consensus.cc:697] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Leader. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:19.073292  7214 consensus_queue.cc:237] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.082096  6874 catalog_manager.cc:5697] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 reported cstate change: term changed from 1 to 2, leader changed from aac6280f29ad410fb7865479848aca5f (127.28.152.3) to d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2). New cstate: current_term: 2 leader_uuid: "d805c8f29e394a3c9a22ebb16138e228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.165661  7305 raft_consensus.cc:993] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:19.166116  7214 raft_consensus.cc:1081] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Signalling peer 7b492b4a613b413d9e2af5e042ff5a0d to start an election
I20260709 13:13:19.167532  6977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "051f183055e44e8cad47762978a50a02"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
 from {username='slave'} at 127.0.0.1:44126
I20260709 13:13:19.168049  6977 raft_consensus.cc:493] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.168381  6977 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.175487  6977 raft_consensus.cc:515] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.176955  6977 leader_election.cc:290] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Requested vote from peers d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555), aac6280f29ad410fb7865479848aca5f (127.28.152.3:39811)
I20260709 13:13:19.177779  7054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:19.177999  7126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051f183055e44e8cad47762978a50a02" candidate_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aac6280f29ad410fb7865479848aca5f"
I20260709 13:13:19.178375  7054 raft_consensus.cc:3055] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.178596  7126 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.178783  7054 raft_consensus.cc:740] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:19.179580  7054 consensus_queue.cc:260] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.180523  7054 raft_consensus.cc:3060] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.183631  7126 raft_consensus.cc:2468] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:19.184659  6945 leader_election.cc:304] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:19.185418  7260 raft_consensus.cc:2804] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.185583  7054 raft_consensus.cc:2468] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b492b4a613b413d9e2af5e042ff5a0d in term 2.
I20260709 13:13:19.185961  7260 raft_consensus.cc:697] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Leader. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:19.187170  7260 consensus_queue.cc:237] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:19.193672  6874 catalog_manager.cc:5697] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d reported cstate change: term changed from 1 to 2, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1). New cstate: current_term: 2 leader_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.215411  7126 raft_consensus.cc:3060] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.220813  7126 raft_consensus.cc:1275] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.221994  7298 consensus_queue.cc:1048] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.224367  7054 raft_consensus.cc:1275] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.225713  7260 consensus_queue.cc:1048] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.245081  6977 raft_consensus.cc:1275] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.246407  7301 consensus_queue.cc:1048] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.254434  7054 raft_consensus.cc:1275] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.257038  7314 consensus_queue.cc:1048] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.480201  7054 raft_consensus.cc:1275] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.481539  7260 consensus_queue.cc:1048] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.489130  7126 raft_consensus.cc:1275] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.490409  7296 consensus_queue.cc:1048] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.496685  6977 raft_consensus.cc:1275] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.499248  7214 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.509299  7126 raft_consensus.cc:1275] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.511253  7126 raft_consensus.cc:3060] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.511817  7350 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.518904  7126 raft_consensus.cc:1275] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.520761  7350 consensus_queue.cc:1048] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.529141  6977 raft_consensus.cc:1275] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.530597  7214 consensus_queue.cc:1048] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.630851  7126 raft_consensus.cc:1275] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.632606  7350 consensus_queue.cc:1048] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.633872  6977 raft_consensus.cc:1275] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer d805c8f29e394a3c9a22ebb16138e228: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.636029  7350 consensus_queue.cc:1048] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.743216  7127 raft_consensus.cc:1275] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.744518  7296 consensus_queue.cc:1048] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.748337  7054 raft_consensus.cc:1275] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer 7b492b4a613b413d9e2af5e042ff5a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.749936  7296 consensus_queue.cc:1048] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.733523  6875 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45794:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:21.759075  6875 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45794:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:21.895538 29280 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:22.005272  7394 tablet.cc:1724] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.015086  7398 tablet.cc:1724] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.028049  7399 tablet.cc:1724] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.049346  7401 tablet.cc:1724] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.139925  7406 tablet.cc:1724] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.146721  7411 tablet.cc:1724] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:22.180418  7155 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:00d8296c6d0c4d73b3e871b86723277d)
W20260709 13:13:22.203735  7155 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:00d8296c6d0c4d73b3e871b86723277d)
I20260709 13:13:22.212957  7417 tablet.cc:1724] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.212888  7416 tablet.cc:1724] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.215687  7399 tablet.cc:1724] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:22.224426  7005 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:00d8296c6d0c4d73b3e871b86723277d)
I20260709 13:13:22.307843  7418 tablet.cc:1724] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.293064  7401 tablet.cc:1724] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.330869  7423 tablet.cc:1724] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.331166  7418 tablet.cc:1724] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.332321  7417 tablet.cc:1724] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.360778  7420 tablet.cc:1724] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.361358  7427 tablet.cc:1724] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:22.362048  7094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.1:42467, user_credentials={real_user=slave}} blocked reactor thread for 124590us
I20260709 13:13:22.370474  7398 tablet.cc:1724] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.375352  7416 tablet.cc:1724] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.381812  7417 tablet.cc:1724] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.385841  7401 tablet.cc:1724] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:22.398524  6945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:39811, user_credentials={real_user=slave}} blocked reactor thread for 278084us
I20260709 13:13:22.399400  7394 tablet.cc:1724] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.413092  7423 tablet.cc:1724] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.426461  6977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:37298
I20260709 13:13:22.429644  6977 raft_consensus.cc:606] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:22.428117  7427 tablet.cc:1724] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.428104  7411 tablet.cc:1724] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.446252  7399 tablet.cc:1724] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.448328  7420 tablet.cc:1724] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.453325  7365 raft_consensus.cc:993] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.453982  7365 raft_consensus.cc:1081] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.455940  7125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48872
I20260709 13:13:22.456629  7125 raft_consensus.cc:493] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.457118  7125 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.458410  7398 tablet.cc:1724] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:22.475548  7125 raft_consensus.cc:515] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.487627  7051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:22.487650  6979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d8296c6d0c4d73b3e871b86723277d" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:22.488582  7051 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.488626  6979 raft_consensus.cc:3055] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.489156  6979 raft_consensus.cc:740] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:22.490106  6979 consensus_queue.cc:260] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.491464  6979 raft_consensus.cc:3060] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.486410  7125 leader_election.cc:290] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:22.497823  7051 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:22.508212  7093 leader_election.cc:304] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:22.508144  7051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:58238
I20260709 13:13:22.509181  7051 raft_consensus.cc:606] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:22.509471  7426 raft_consensus.cc:2804] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.510071  7426 raft_consensus.cc:697] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:22.511083  7426 consensus_queue.cc:237] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.512013 29280 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:22.512977 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:22.520007  6979 raft_consensus.cc:2468] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 2.
I20260709 13:13:22.523912  6977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3413014b59d9416aa098597e395214c8"
dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:37298
I20260709 13:13:22.525859  6977 raft_consensus.cc:606] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:22.530879  7051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41"
dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
mode: GRACEFUL
new_leader_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:58238
I20260709 13:13:22.531709  7051 raft_consensus.cc:606] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Received request to transfer leadership to TS aac6280f29ad410fb7865479848aca5f
I20260709 13:13:22.532135  6875 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: soft_deleted_table [id=828644d65eb647979b9de62608a90f65] alter complete (version 1)
I20260709 13:13:22.535029 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:22.535648 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:22.539966  6875 catalog_manager.cc:5697] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 1 to 2, leader changed from 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 2 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.696084  7365 raft_consensus.cc:993] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.696717  7414 raft_consensus.cc:1081] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.698246  7126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3413014b59d9416aa098597e395214c8"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48872
I20260709 13:13:22.698750  7126 raft_consensus.cc:493] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.699059  7126 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.704576  7126 raft_consensus.cc:515] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.706681  7126 leader_election.cc:290] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:22.706972  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:22.707731  7051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3413014b59d9416aa098597e395214c8" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:22.707755  6977 raft_consensus.cc:3055] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:22.708470  7051 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.708427  6977 raft_consensus.cc:740] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b492b4a613b413d9e2af5e042ff5a0d, State: Running, Role: LEADER
I20260709 13:13:22.709542  6977 consensus_queue.cc:260] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.710826  6977 raft_consensus.cc:3060] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.716223  7051 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:22.717468  7093 leader_election.cc:304] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac6280f29ad410fb7865479848aca5f, d805c8f29e394a3c9a22ebb16138e228; no voters: 
I20260709 13:13:22.718279  7426 raft_consensus.cc:2804] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:22.718873  7426 raft_consensus.cc:697] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:22.719748  7426 consensus_queue.cc:237] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.718832  6977 raft_consensus.cc:2468] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:22.729626  6875 catalog_manager.cc:5697] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 2 to 3, leader changed from 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 3 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.819584  7385 raft_consensus.cc:993] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.820173  7368 raft_consensus.cc:1081] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.821533  7126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48866
I20260709 13:13:22.822002  7126 raft_consensus.cc:493] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.822290  7126 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.827574  7126 raft_consensus.cc:515] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.829135  7126 leader_election.cc:290] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:22.830065  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:22.830263  7051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11b3fda33f04306b10cce00f07e8a26" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:22.830878  6977 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.830960  7051 raft_consensus.cc:3055] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:22.831418  7051 raft_consensus.cc:740] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:22.832214  7051 consensus_queue.cc:260] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.833223  7051 raft_consensus.cc:3060] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.836581  6977 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:22.837882  7094 leader_election.cc:304] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:22.838516  7051 raft_consensus.cc:2468] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:22.838789  7426 raft_consensus.cc:2804] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:22.839422  7426 raft_consensus.cc:697] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:22.840669  7426 consensus_queue.cc:237] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.847607  6875 catalog_manager.cc:5697] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 2 to 3, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 3 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.955075  6977 raft_consensus.cc:1275] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:22.956425  7426 consensus_queue.cc:1048] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.966246  7051 raft_consensus.cc:1275] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:22.968369  7436 consensus_queue.cc:1048] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.979374  7368 raft_consensus.cc:993] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: : Instructing follower aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.979837  7368 raft_consensus.cc:1081] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Signalling peer aac6280f29ad410fb7865479848aca5f to start an election
I20260709 13:13:22.981431  7126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41"
dest_uuid: "aac6280f29ad410fb7865479848aca5f"
 from {username='slave'} at 127.0.0.1:48866
I20260709 13:13:22.981966  7126 raft_consensus.cc:493] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.982281  7126 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.987985  7126 raft_consensus.cc:515] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.990288  7126 leader_election.cc:290] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Requested vote from peers 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467), d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555)
I20260709 13:13:22.990425  6977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b492b4a613b413d9e2af5e042ff5a0d"
I20260709 13:13:22.991189  6977 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.991645  7051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25e4706d2442d49f2521a761f09f41" candidate_uuid: "aac6280f29ad410fb7865479848aca5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d805c8f29e394a3c9a22ebb16138e228"
I20260709 13:13:22.992288  7051 raft_consensus.cc:3055] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:22.992697  7051 raft_consensus.cc:740] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d805c8f29e394a3c9a22ebb16138e228, State: Running, Role: LEADER
I20260709 13:13:22.993695  7051 consensus_queue.cc:260] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:22.995200  7051 raft_consensus.cc:3060] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:22.998929  6977 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:23.000469  7094 leader_election.cc:304] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b492b4a613b413d9e2af5e042ff5a0d, aac6280f29ad410fb7865479848aca5f; no voters: 
I20260709 13:13:23.001438  7426 raft_consensus.cc:2804] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.001951  7426 raft_consensus.cc:697] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Becoming Leader. State: Replica: aac6280f29ad410fb7865479848aca5f, State: Running, Role: LEADER
I20260709 13:13:23.002871  7426 consensus_queue.cc:237] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } }
I20260709 13:13:23.005596  7051 raft_consensus.cc:2468] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac6280f29ad410fb7865479848aca5f in term 3.
I20260709 13:13:23.015591  6876 catalog_manager.cc:5697] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f reported cstate change: term changed from 2 to 3, leader changed from d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2) to aac6280f29ad410fb7865479848aca5f (127.28.152.3). New cstate: current_term: 3 leader_uuid: "aac6280f29ad410fb7865479848aca5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac6280f29ad410fb7865479848aca5f" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 39811 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.165082  6977 raft_consensus.cc:1275] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.166334  7426 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.175539  7051 raft_consensus.cc:1275] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.177037  7355 consensus_queue.cc:1048] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.291911  6979 raft_consensus.cc:1275] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:23.293517  7355 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:23.302663  7051 raft_consensus.cc:1275] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:23.304816  7426 consensus_queue.cc:1048] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.551172  6977 raft_consensus.cc:1275] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.552664  7426 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b492b4a613b413d9e2af5e042ff5a0d" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 42467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.563251  7051 raft_consensus.cc:1275] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Refusing update from remote peer aac6280f29ad410fb7865479848aca5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.567497  7426 consensus_queue.cc:1048] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805c8f29e394a3c9a22ebb16138e228" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.609850 29280 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:23.615499 29280 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:23.615943 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:23.623342 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:23.623926 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:24.655370 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
W20260709 13:13:24.669329  7020 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 13:13:24.675275  7020 consensus_peers.cc:597] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.691941 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:24.692709 29280 tablet_replica.cc:333] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.693622 29280 raft_consensus.cc:2243] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.694135 29280 raft_consensus.cc:2272] T d29c769b6dd64fc4829b28d6eeb9b27c P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.696338 29280 tablet_replica.cc:333] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.696964 29280 raft_consensus.cc:2243] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.697430 29280 raft_consensus.cc:2272] T c11b3fda33f04306b10cce00f07e8a26 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.699455 29280 tablet_replica.cc:333] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.700037 29280 raft_consensus.cc:2243] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.700850 29280 raft_consensus.cc:2272] T b51f43462ca246efbd875ed887500e66 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.702637 29280 tablet_replica.cc:333] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.703243 29280 raft_consensus.cc:2243] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.704135 29280 raft_consensus.cc:2272] T 051f183055e44e8cad47762978a50a02 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.706753 29280 tablet_replica.cc:333] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.707333 29280 raft_consensus.cc:2243] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.708138 29280 raft_consensus.cc:2272] T e8f277bf8fbb438fbeae0c890197f236 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.710829 29280 tablet_replica.cc:333] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.711544 29280 raft_consensus.cc:2243] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.712049 29280 raft_consensus.cc:2272] T 3413014b59d9416aa098597e395214c8 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.712628  7094 consensus_peers.cc:597] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.714478 29280 tablet_replica.cc:333] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.715194 29280 raft_consensus.cc:2243] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.715600 29280 raft_consensus.cc:2272] T 5c25e4706d2442d49f2521a761f09f41 P 7b492b4a613b413d9e2af5e042ff5a0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.717708 29280 tablet_replica.cc:333] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.718262 29280 raft_consensus.cc:2243] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.718816 29280 raft_consensus.cc:2272] T cb750dd61ffc422596a4914ea6f0fe6c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.720994 29280 tablet_replica.cc:333] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.721565 29280 raft_consensus.cc:2243] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.722020 29280 raft_consensus.cc:2272] T b9b8db8111084632b9755559defe0a4d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.724944 29280 tablet_replica.cc:333] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.725613 29280 raft_consensus.cc:2243] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.726720 29280 raft_consensus.cc:2272] T bf887671668b458a8c123ae642ea702d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.728772  7094 consensus_peers.cc:597] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.729841 29280 tablet_replica.cc:333] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.730558 29280 raft_consensus.cc:2243] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.731082 29280 raft_consensus.cc:2272] T 00d8296c6d0c4d73b3e871b86723277d P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.733161 29280 tablet_replica.cc:333] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.733711 29280 raft_consensus.cc:2243] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.734143 29280 raft_consensus.cc:2272] T 213044b3cc154dba981cac599832053e P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.736217 29280 tablet_replica.cc:333] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.736747 29280 raft_consensus.cc:2243] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.737180 29280 raft_consensus.cc:2272] T ab44885d6bb241b0a452bd0cc9593186 P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.739167 29280 tablet_replica.cc:333] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.739720 29280 raft_consensus.cc:2243] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.740170 29280 raft_consensus.cc:2272] T f8d5a38931bd4cf4b44185ce6f765430 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.742404 29280 tablet_replica.cc:333] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.743018 29280 raft_consensus.cc:2243] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.743518 29280 raft_consensus.cc:2272] T 514af2f38baf42c28a096e07d44d74b6 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.745901 29280 tablet_replica.cc:333] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.746428 29280 raft_consensus.cc:2243] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.746964 29280 raft_consensus.cc:2272] T acf3a227d94d474d86d1991a6efd3eeb P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.748842 29280 tablet_replica.cc:333] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.749377 29280 raft_consensus.cc:2243] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.750207 29280 raft_consensus.cc:2272] T 2e08e9a9f53c40068fbe6ec6a5154954 P 7b492b4a613b413d9e2af5e042ff5a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.752611 29280 tablet_replica.cc:333] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d: stopping tablet replica
I20260709 13:13:24.753095 29280 raft_consensus.cc:2243] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.754208 29280 raft_consensus.cc:2272] T 4ae2281b99c4466580928dd4f7a1ee5c P 7b492b4a613b413d9e2af5e042ff5a0d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.758067  7020 consensus_peers.cc:597] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:24.769023  7020 consensus_peers.cc:597] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:24.791474  7020 consensus_peers.cc:597] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:42467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.798418 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
W20260709 13:13:24.827831  7020 consensus_peers.cc:597] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:42467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.837884 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
W20260709 13:13:24.864270  7093 consensus_peers.cc:597] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f -> Peer d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555): Couldn't send request to peer d805c8f29e394a3c9a22ebb16138e228. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.873828 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:24.873770  7094 consensus_peers.cc:597] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:42467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.874852 29280 tablet_replica.cc:333] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.876005 29280 raft_consensus.cc:2243] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.876659 29280 raft_consensus.cc:2272] T d29c769b6dd64fc4829b28d6eeb9b27c P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.878684 29280 tablet_replica.cc:333] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.879326 29280 raft_consensus.cc:2243] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.879726 29280 raft_consensus.cc:2272] T b51f43462ca246efbd875ed887500e66 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.881593 29280 tablet_replica.cc:333] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.882299 29280 raft_consensus.cc:2243] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.882872 29280 raft_consensus.cc:2272] T 051f183055e44e8cad47762978a50a02 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.885078 29280 tablet_replica.cc:333] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.885653 29280 raft_consensus.cc:2243] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:24.885958  7093 consensus_peers.cc:597] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f -> Peer d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555): Couldn't send request to peer d805c8f29e394a3c9a22ebb16138e228. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.886058 29280 raft_consensus.cc:2272] T c11b3fda33f04306b10cce00f07e8a26 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.888413 29280 tablet_replica.cc:333] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.888981 29280 raft_consensus.cc:2243] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.889415 29280 raft_consensus.cc:2272] T bf887671668b458a8c123ae642ea702d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.891417 29280 tablet_replica.cc:333] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.891968 29280 raft_consensus.cc:2243] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.892690 29280 raft_consensus.cc:2272] T b9b8db8111084632b9755559defe0a4d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.894583 29280 tablet_replica.cc:333] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.895206 29280 raft_consensus.cc:2243] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.895978 29280 raft_consensus.cc:2272] T cb750dd61ffc422596a4914ea6f0fe6c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.897970 29280 tablet_replica.cc:333] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.898813 29280 raft_consensus.cc:2243] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.899260 29280 raft_consensus.cc:2272] T 5c25e4706d2442d49f2521a761f09f41 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.901152 29280 tablet_replica.cc:333] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.901708 29280 raft_consensus.cc:2243] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.902122 29280 raft_consensus.cc:2272] T e8f277bf8fbb438fbeae0c890197f236 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.903883 29280 tablet_replica.cc:333] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.904435 29280 raft_consensus.cc:2243] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.904835 29280 raft_consensus.cc:2272] T 3413014b59d9416aa098597e395214c8 P d805c8f29e394a3c9a22ebb16138e228 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.906795 29280 tablet_replica.cc:333] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.907317 29280 raft_consensus.cc:2243] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.907707 29280 raft_consensus.cc:2272] T 00d8296c6d0c4d73b3e871b86723277d P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.909715 29280 tablet_replica.cc:333] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.910238 29280 raft_consensus.cc:2243] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.910653 29280 raft_consensus.cc:2272] T 213044b3cc154dba981cac599832053e P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.912621 29280 tablet_replica.cc:333] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.913161 29280 raft_consensus.cc:2243] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.913940 29280 raft_consensus.cc:2272] T 514af2f38baf42c28a096e07d44d74b6 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.916473 29280 tablet_replica.cc:333] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.917160 29280 raft_consensus.cc:2243] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.917927 29280 raft_consensus.cc:2272] T ab44885d6bb241b0a452bd0cc9593186 P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.920437 29280 tablet_replica.cc:333] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.920971 29280 raft_consensus.cc:2243] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.921732 29280 raft_consensus.cc:2272] T f8d5a38931bd4cf4b44185ce6f765430 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.923792 29280 tablet_replica.cc:333] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.924266 29280 raft_consensus.cc:2243] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.925005 29280 raft_consensus.cc:2272] T acf3a227d94d474d86d1991a6efd3eeb P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.927013 29280 tablet_replica.cc:333] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.927486 29280 raft_consensus.cc:2243] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.927977 29280 raft_consensus.cc:2272] T 4ae2281b99c4466580928dd4f7a1ee5c P d805c8f29e394a3c9a22ebb16138e228 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.930253 29280 tablet_replica.cc:333] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228: stopping tablet replica
I20260709 13:13:24.930887 29280 raft_consensus.cc:2243] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.931416 29280 raft_consensus.cc:2272] T 2e08e9a9f53c40068fbe6ec6a5154954 P d805c8f29e394a3c9a22ebb16138e228 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.932618  7094 consensus_peers.cc:597] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:42467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:24.949175  7094 consensus_peers.cc:597] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f -> Peer 7b492b4a613b413d9e2af5e042ff5a0d (127.28.152.1:42467): Couldn't send request to peer 7b492b4a613b413d9e2af5e042ff5a0d. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:42467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.972306 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:13:25.011073 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
W20260709 13:13:25.033821  7093 consensus_peers.cc:597] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f -> Peer d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555): Couldn't send request to peer d805c8f29e394a3c9a22ebb16138e228. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:35555: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.034333  7093 consensus_peers.cc:597] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f -> Peer d805c8f29e394a3c9a22ebb16138e228 (127.28.152.2:35555): Couldn't send request to peer d805c8f29e394a3c9a22ebb16138e228. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:35555: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.037590 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:25.038452 29280 tablet_replica.cc:333] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.039505 29280 raft_consensus.cc:2243] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.040472 29280 raft_consensus.cc:2272] T d29c769b6dd64fc4829b28d6eeb9b27c P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.042469 29280 tablet_replica.cc:333] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.043054 29280 raft_consensus.cc:2243] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.043488 29280 raft_consensus.cc:2272] T 051f183055e44e8cad47762978a50a02 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.045347 29280 tablet_replica.cc:333] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.045890 29280 raft_consensus.cc:2243] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.046264 29280 raft_consensus.cc:2272] T b51f43462ca246efbd875ed887500e66 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.048209 29280 tablet_replica.cc:333] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.048681 29280 raft_consensus.cc:2243] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.049369 29280 raft_consensus.cc:2272] T c11b3fda33f04306b10cce00f07e8a26 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.051272 29280 tablet_replica.cc:333] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.051790 29280 raft_consensus.cc:2243] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.052165 29280 raft_consensus.cc:2272] T acf3a227d94d474d86d1991a6efd3eeb P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.054013 29280 tablet_replica.cc:333] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.054517 29280 raft_consensus.cc:2243] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.054976 29280 raft_consensus.cc:2272] T 2e08e9a9f53c40068fbe6ec6a5154954 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.057124 29280 tablet_replica.cc:333] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.057619 29280 raft_consensus.cc:2243] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.057996 29280 raft_consensus.cc:2272] T 4ae2281b99c4466580928dd4f7a1ee5c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.060019 29280 tablet_replica.cc:333] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.060562 29280 raft_consensus.cc:2243] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.060951 29280 raft_consensus.cc:2272] T b9b8db8111084632b9755559defe0a4d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.062935 29280 tablet_replica.cc:333] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.063402 29280 raft_consensus.cc:2243] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.064244 29280 raft_consensus.cc:2272] T 5c25e4706d2442d49f2521a761f09f41 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.066151 29280 tablet_replica.cc:333] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.066623 29280 raft_consensus.cc:2243] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.067080 29280 raft_consensus.cc:2272] T cb750dd61ffc422596a4914ea6f0fe6c P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.069114 29280 tablet_replica.cc:333] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.069665 29280 raft_consensus.cc:2243] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.070365 29280 raft_consensus.cc:2272] T 00d8296c6d0c4d73b3e871b86723277d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.072134 29280 tablet_replica.cc:333] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.072587 29280 raft_consensus.cc:2243] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.073351 29280 raft_consensus.cc:2272] T 213044b3cc154dba981cac599832053e P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.075434 29280 tablet_replica.cc:333] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.075891 29280 raft_consensus.cc:2243] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.076282 29280 raft_consensus.cc:2272] T bf887671668b458a8c123ae642ea702d P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.078207 29280 tablet_replica.cc:333] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.078709 29280 raft_consensus.cc:2243] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.079131 29280 raft_consensus.cc:2272] T ab44885d6bb241b0a452bd0cc9593186 P aac6280f29ad410fb7865479848aca5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.081055 29280 tablet_replica.cc:333] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.081610 29280 raft_consensus.cc:2243] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.082068 29280 raft_consensus.cc:2272] T f8d5a38931bd4cf4b44185ce6f765430 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.084198 29280 tablet_replica.cc:333] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.084724 29280 raft_consensus.cc:2243] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.085168 29280 raft_consensus.cc:2272] T 514af2f38baf42c28a096e07d44d74b6 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.087275 29280 tablet_replica.cc:333] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.087775 29280 raft_consensus.cc:2243] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.088213 29280 raft_consensus.cc:2272] T e8f277bf8fbb438fbeae0c890197f236 P aac6280f29ad410fb7865479848aca5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.089987 29280 tablet_replica.cc:333] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f: stopping tablet replica
I20260709 13:13:25.090452 29280 raft_consensus.cc:2243] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.091208 29280 raft_consensus.cc:2272] T 3413014b59d9416aa098597e395214c8 P aac6280f29ad410fb7865479848aca5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.130213 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:13:25.165766 29280 master.cc:562] Master@127.28.152.62:38151 shutting down...
I20260709 13:13:25.185485 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.186050 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.186379 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7208a4f915dd4ba6a10e8196fa8a6cf6: stopping tablet replica
I20260709 13:13:25.207226 29280 master.cc:584] Master@127.28.152.62:38151 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12836 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:25.267725 29280 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.152.62:45837
I20260709 13:13:25.268947 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.274897  7454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.275048  7453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.275975  7456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.278343 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:25.280519 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.280767 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.280932 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602805280915 us; error 0 us; skew 500 ppm
I20260709 13:13:25.281500 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.284005 29280 webserver.cc:533] Webserver started at http://127.28.152.62:33185/ using document root <none> and password file <none>
I20260709 13:13:25.284492 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.284689 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.284958 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.286027 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/master-0-root/instance:
uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.290310 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:13:25.293509  7461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.294278 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:25.294554 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/master-0-root
uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.294890 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.312072 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.313345 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.352442 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.62:45837
I20260709 13:13:25.352579  7512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.62:45837 every 8 connection(s)
I20260709 13:13:25.356415  7513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.367394  7513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: Bootstrap starting.
I20260709 13:13:25.372491  7513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.377036  7513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: No bootstrap required, opened a new log
I20260709 13:13:25.379411  7513 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER }
I20260709 13:13:25.379801  7513 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.380054  7513 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59f7a76dea4f23b7a0341ba18c2e2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.380709  7513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER }
I20260709 13:13:25.381174  7513 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:25.381376  7513 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:25.381687  7513 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.386777  7513 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER }
I20260709 13:13:25.387303  7513 leader_election.cc:304] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a59f7a76dea4f23b7a0341ba18c2e2f; no voters: 
I20260709 13:13:25.388497  7513 leader_election.cc:290] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:25.388887  7516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.390305  7516 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 1 LEADER]: Becoming Leader. State: Replica: 7a59f7a76dea4f23b7a0341ba18c2e2f, State: Running, Role: LEADER
I20260709 13:13:25.390996  7516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER }
I20260709 13:13:25.391498  7513 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:25.395371  7517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER } }
I20260709 13:13:25.396273  7517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.396322  7518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a59f7a76dea4f23b7a0341ba18c2e2f. Latest consensus state: current_term: 1 leader_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a59f7a76dea4f23b7a0341ba18c2e2f" member_type: VOTER } }
I20260709 13:13:25.397523  7518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.400919  7523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:25.408893  7523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:25.409860 29280 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:25.418358  7523 catalog_manager.cc:1383] Generated new cluster ID: 4a94a408eb3f4f12a4d868808a5c8f70
I20260709 13:13:25.418676  7523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:25.440325  7523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:25.441737  7523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:25.455974  7523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: Generated new TSK 0
I20260709 13:13:25.456596  7523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:25.477326 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.483415  7534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.484612  7535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.486195  7537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.487110 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:25.488170 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.488353 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.488572 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602805488552 us; error 0 us; skew 500 ppm
I20260709 13:13:25.489151 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.491433 29280 webserver.cc:533] Webserver started at http://127.28.152.1:44573/ using document root <none> and password file <none>
I20260709 13:13:25.491930 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.492126 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.492420 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.493580 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-0-root/instance:
uuid: "3fa3fc418061496f8d2451d22f920d3e"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.498164 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:25.501583  7542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.502413 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:25.502801 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-0-root
uuid: "3fa3fc418061496f8d2451d22f920d3e"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.503101 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.525436 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.526643 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.528164 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:25.530577 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:25.530879 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:25.531143 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:25.531347 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.571673 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.1:32989
I20260709 13:13:25.571790  7604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.1:32989 every 8 connection(s)
I20260709 13:13:25.577162 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.583973  7609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.585825  7610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.587515  7612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.587706 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:25.589599 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.589860 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.590070 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602805590049 us; error 0 us; skew 500 ppm
I20260709 13:13:25.590229  7605 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45837
I20260709 13:13:25.590731  7605 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:25.590765 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.591625  7605 heartbeater.cc:507] Master 127.28.152.62:45837 requested a full tablet report, sending...
I20260709 13:13:25.593710 29280 webserver.cc:533] Webserver started at http://127.28.152.2:41199/ using document root <none> and password file <none>
I20260709 13:13:25.594270  7478 ts_manager.cc:194] Registered new tserver with Master: 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989)
I20260709 13:13:25.594437 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.594794 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.595139 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.596705 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-1-root/instance:
uuid: "60fff4236c484ad28df300176902dd2e"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.596845  7478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39166
I20260709 13:13:25.601560 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:25.605166  7617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.606019 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:25.606323 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-1-root
uuid: "60fff4236c484ad28df300176902dd2e"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.606573 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.629110 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.630318 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.631937 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:25.634238 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:25.634419 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.634755 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:25.634909 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.674407 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.2:40979
I20260709 13:13:25.674520  7679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.2:40979 every 8 connection(s)
I20260709 13:13:25.679368 29280 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.686843  7683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.688398  7684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.690668  7686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.690758 29280 server_base.cc:1061] running on GCE node
I20260709 13:13:25.692252 29280 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.692493 29280 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.692739 29280 hybrid_clock.cc:648] HybridClock initialized: now 1783602805692708 us; error 0 us; skew 500 ppm
I20260709 13:13:25.692889  7680 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45837
I20260709 13:13:25.693387  7680 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:25.693526 29280 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.694324  7680 heartbeater.cc:507] Master 127.28.152.62:45837 requested a full tablet report, sending...
I20260709 13:13:25.696557 29280 webserver.cc:533] Webserver started at http://127.28.152.3:34781/ using document root <none> and password file <none>
I20260709 13:13:25.696908  7478 ts_manager.cc:194] Registered new tserver with Master: 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:25.697248 29280 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.697541 29280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.697875 29280 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.698822  7478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39178
I20260709 13:13:25.699472 29280 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-2-root/instance:
uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.704497 29280 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:25.707882  7691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.708699 29280 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:25.709052 29280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-2-root
uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-x7j4"
I20260709 13:13:25.709298 29280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfwGj8n/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602519121011-29280-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.732266 29280 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.733525 29280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.735038 29280 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:25.737264 29280 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:25.737453 29280 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.737749 29280 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:25.737890 29280 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.776935 29280 rpc_server.cc:307] RPC server started. Bound to: 127.28.152.3:44787
I20260709 13:13:25.777036  7753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.152.3:44787 every 8 connection(s)
I20260709 13:13:25.790506  7754 heartbeater.cc:344] Connected to a master server at 127.28.152.62:45837
I20260709 13:13:25.790979  7754 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:25.791725  7754 heartbeater.cc:507] Master 127.28.152.62:45837 requested a full tablet report, sending...
I20260709 13:13:25.793870  7478 ts_manager.cc:194] Registered new tserver with Master: 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:25.794535 29280 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014572928s
I20260709 13:13:25.795655  7478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39182
I20260709 13:13:25.819927  7478 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39186:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:25.822795  7478 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:25.904606  7645 tablet_service.cc:1511] Processing CreateTablet for tablet 03a01dffa20b428e822d1cb74b2dcef5 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.906162  7645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a01dffa20b428e822d1cb74b2dcef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.906344  7641 tablet_service.cc:1511] Processing CreateTablet for tablet fc40fa657d6e4b9c8c4c5896301f3ab1 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.907837  7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40fa657d6e4b9c8c4c5896301f3ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.908994  7643 tablet_service.cc:1511] Processing CreateTablet for tablet 2b68a2de8dde49f08099c0ecc6c06b0e (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.907866  7644 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbe69df51f8445e90a222f9d6743b40 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.911648  7715 tablet_service.cc:1511] Processing CreateTablet for tablet fc40fa657d6e4b9c8c4c5896301f3ab1 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.911831  7642 tablet_service.cc:1511] Processing CreateTablet for tablet 584f9bceeca44a67944bf6646cd6b181 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.911994  7718 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbe69df51f8445e90a222f9d6743b40 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.915907  7715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40fa657d6e4b9c8c4c5896301f3ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.913640  7716 tablet_service.cc:1511] Processing CreateTablet for tablet 584f9bceeca44a67944bf6646cd6b181 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.916715  7718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbe69df51f8445e90a222f9d6743b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.917471  7716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f9bceeca44a67944bf6646cd6b181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.913084  7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b68a2de8dde49f08099c0ecc6c06b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.918385  7640 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd5a02b7831439297eab38847ce2eb4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.919838  7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd5a02b7831439297eab38847ce2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.915608  7719 tablet_service.cc:1511] Processing CreateTablet for tablet 03a01dffa20b428e822d1cb74b2dcef5 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.919834  7714 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd5a02b7831439297eab38847ce2eb4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.922401  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a01dffa20b428e822d1cb74b2dcef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.913743  7717 tablet_service.cc:1511] Processing CreateTablet for tablet 2b68a2de8dde49f08099c0ecc6c06b0e (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.923722  7714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd5a02b7831439297eab38847ce2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.921017  7713 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.927111  7717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b68a2de8dde49f08099c0ecc6c06b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.927791  7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f9bceeca44a67944bf6646cd6b181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.928900  7712 tablet_service.cc:1511] Processing CreateTablet for tablet c4fc4e0ef7a1457d92676be63b406531 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.929004  7639 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.930323  7712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fc4e0ef7a1457d92676be63b406531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.931104  7713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.931887  7638 tablet_service.cc:1511] Processing CreateTablet for tablet c4fc4e0ef7a1457d92676be63b406531 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.930505  7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.934176  7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbe69df51f8445e90a222f9d6743b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.938426  7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fc4e0ef7a1457d92676be63b406531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.964582  7637 tablet_service.cc:1511] Processing CreateTablet for tablet 0af88fe5e4da42c59b4471e8d688c456 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.966094  7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af88fe5e4da42c59b4471e8d688c456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.974571  7711 tablet_service.cc:1511] Processing CreateTablet for tablet 0af88fe5e4da42c59b4471e8d688c456 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.976087  7711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af88fe5e4da42c59b4471e8d688c456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.976989  7570 tablet_service.cc:1511] Processing CreateTablet for tablet 03a01dffa20b428e822d1cb74b2dcef5 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:25.978377  7570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a01dffa20b428e822d1cb74b2dcef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.979651  7563 tablet_service.cc:1511] Processing CreateTablet for tablet c4fc4e0ef7a1457d92676be63b406531 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:25.979895  7569 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbe69df51f8445e90a222f9d6743b40 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:25.981797  7562 tablet_service.cc:1511] Processing CreateTablet for tablet 0af88fe5e4da42c59b4471e8d688c456 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:25.983776  7567 tablet_service.cc:1511] Processing CreateTablet for tablet 584f9bceeca44a67944bf6646cd6b181 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:25.985783  7566 tablet_service.cc:1511] Processing CreateTablet for tablet fc40fa657d6e4b9c8c4c5896301f3ab1 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:25.987730  7565 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd5a02b7831439297eab38847ce2eb4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:25.989661  7564 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4 (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:25.981904  7568 tablet_service.cc:1511] Processing CreateTablet for tablet 2b68a2de8dde49f08099c0ecc6c06b0e (DEFAULT_TABLE table=test-workload [id=e1e339806de7412dac22f7000cef781c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:25.991937  7563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fc4e0ef7a1457d92676be63b406531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.995957  7562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af88fe5e4da42c59b4471e8d688c456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.998502  7564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3a518e22bd4f7baa4c332e3d22f4a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.011091  7565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd5a02b7831439297eab38847ce2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.015156  7567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f9bceeca44a67944bf6646cd6b181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.019060  7566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc40fa657d6e4b9c8c4c5896301f3ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.026996  7568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b68a2de8dde49f08099c0ecc6c06b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.032087  7569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbe69df51f8445e90a222f9d6743b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.039563  7769 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.056833  7770 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.069204  7771 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.071940  7769 tablet_bootstrap.cc:654] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.080852  7770 tablet_bootstrap.cc:654] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.099756  7771 tablet_bootstrap.cc:654] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.106211  7769 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.106879  7769 ts_tablet_manager.cc:1403] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.008s
I20260709 13:13:26.112246  7770 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.112838  7770 ts_tablet_manager.cc:1403] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.011s
I20260709 13:13:26.112725  7769 raft_consensus.cc:359] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.113678  7769 raft_consensus.cc:385] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.114039  7769 raft_consensus.cc:740] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.114863  7769 consensus_queue.cc:260] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.116484  7771 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.116277  7770 raft_consensus.cc:359] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.117087  7771 ts_tablet_manager.cc:1403] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 13:13:26.117022  7680 heartbeater.cc:499] Master 127.28.152.62:45837 was elected leader, sending a full tablet report...
I20260709 13:13:26.117107  7770 raft_consensus.cc:385] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.117509  7769 ts_tablet_manager.cc:1434] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:13:26.117775  7770 raft_consensus.cc:740] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.118592  7769 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.118543  7770 consensus_queue.cc:260] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.120409  7771 raft_consensus.cc:359] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.121174  7771 raft_consensus.cc:385] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.121449  7771 raft_consensus.cc:740] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.122188  7771 consensus_queue.cc:260] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.126986  7769 tablet_bootstrap.cc:654] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.128026  7770 ts_tablet_manager.cc:1434] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:26.128799  7605 heartbeater.cc:499] Master 127.28.152.62:45837 was elected leader, sending a full tablet report...
I20260709 13:13:26.135322  7770 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.144250  7754 heartbeater.cc:499] Master 127.28.152.62:45837 was elected leader, sending a full tablet report...
I20260709 13:13:26.144694  7771 ts_tablet_manager.cc:1434] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.016s
I20260709 13:13:26.145269  7770 tablet_bootstrap.cc:654] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.145784  7771 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.152181  7769 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.152405  7771 tablet_bootstrap.cc:654] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.152824  7769 ts_tablet_manager.cc:1403] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 13:13:26.153901  7770 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.154445  7770 ts_tablet_manager.cc:1403] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:13:26.155957  7769 raft_consensus.cc:359] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.156724  7769 raft_consensus.cc:385] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.157011  7769 raft_consensus.cc:740] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.157449  7770 raft_consensus.cc:359] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.158227  7770 raft_consensus.cc:385] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.157953  7769 consensus_queue.cc:260] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.158525  7770 raft_consensus.cc:740] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.159513  7770 consensus_queue.cc:260] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.160161  7769 ts_tablet_manager.cc:1434] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:13:26.161142  7769 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.161880  7770 ts_tablet_manager.cc:1434] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:26.162906  7770 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.167712  7769 tablet_bootstrap.cc:654] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.169242  7770 tablet_bootstrap.cc:654] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.179968  7769 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.180490  7769 ts_tablet_manager.cc:1403] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:13:26.181013  7770 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.181582  7770 ts_tablet_manager.cc:1403] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:13:26.183472  7769 raft_consensus.cc:359] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.184285  7769 raft_consensus.cc:385] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.184581  7769 raft_consensus.cc:740] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.184505  7770 raft_consensus.cc:359] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.185370  7770 raft_consensus.cc:385] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.185676  7770 raft_consensus.cc:740] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.185707  7769 consensus_queue.cc:260] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.186757  7770 consensus_queue.cc:260] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.188030  7769 ts_tablet_manager.cc:1434] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:13:26.189076  7769 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.189235  7770 ts_tablet_manager.cc:1434] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:26.190279  7770 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.196312  7769 tablet_bootstrap.cc:654] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.196312  7770 tablet_bootstrap.cc:654] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.209944  7770 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.210237  7769 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.210445  7770 ts_tablet_manager.cc:1403] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:13:26.210920  7769 ts_tablet_manager.cc:1403] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:13:26.213433  7770 raft_consensus.cc:359] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.214238  7770 raft_consensus.cc:385] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.214041  7769 raft_consensus.cc:359] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.214615  7770 raft_consensus.cc:740] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.214974  7769 raft_consensus.cc:385] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.215345  7769 raft_consensus.cc:740] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.215515  7770 consensus_queue.cc:260] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.216104  7769 consensus_queue.cc:260] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.217679  7770 ts_tablet_manager.cc:1434] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:26.218400  7769 ts_tablet_manager.cc:1434] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:26.218546  7770 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.219521  7769 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.225625  7771 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.226222  7771 ts_tablet_manager.cc:1403] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.044s
I20260709 13:13:26.226596  7769 tablet_bootstrap.cc:654] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.229151  7771 raft_consensus.cc:359] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.229967  7771 raft_consensus.cc:385] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.230276  7771 raft_consensus.cc:740] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.225576  7770 tablet_bootstrap.cc:654] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.231184  7771 consensus_queue.cc:260] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.232079  7769 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.232661  7769 ts_tablet_manager.cc:1403] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:13:26.233485  7771 ts_tablet_manager.cc:1434] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:26.234512  7771 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.236442  7769 raft_consensus.cc:359] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.237490  7769 raft_consensus.cc:385] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.237854  7769 raft_consensus.cc:740] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.238926  7769 consensus_queue.cc:260] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.241570  7771 tablet_bootstrap.cc:654] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.242000  7769 ts_tablet_manager.cc:1434] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:26.243482  7769 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.252174  7769 tablet_bootstrap.cc:654] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.253360  7771 tablet_bootstrap.cc:492] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.253957  7771 ts_tablet_manager.cc:1403] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:13:26.257004  7771 raft_consensus.cc:359] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.257763  7771 raft_consensus.cc:385] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.257997  7770 tablet_bootstrap.cc:492] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.258071  7771 raft_consensus.cc:740] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.258543  7770 ts_tablet_manager.cc:1403] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.040s	user 0.003s	sys 0.029s
I20260709 13:13:26.258625  7769 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.259407  7769 ts_tablet_manager.cc:1403] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:13:26.259301  7771 consensus_queue.cc:260] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.261194  7770 raft_consensus.cc:359] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.261772  7770 raft_consensus.cc:385] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.262019  7770 raft_consensus.cc:740] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.262398  7769 raft_consensus.cc:359] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.262673  7770 consensus_queue.cc:260] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.263178  7769 raft_consensus.cc:385] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.263499  7769 raft_consensus.cc:740] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.264245  7769 consensus_queue.cc:260] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.266439  7769 ts_tablet_manager.cc:1434] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:26.267417  7769 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.268385  7771 ts_tablet_manager.cc:1434] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:26.271749  7770 ts_tablet_manager.cc:1434] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:13:26.271883  7771 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.273550  7769 tablet_bootstrap.cc:654] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.274084  7776 raft_consensus.cc:493] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.274574  7776 raft_consensus.cc:515] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.277184  7776 leader_election.cc:290] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.278582  7770 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.279700  7771 tablet_bootstrap.cc:654] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.287031  7770 tablet_bootstrap.cc:654] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.287128  7775 raft_consensus.cc:493] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.287714  7775 raft_consensus.cc:515] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.293133  7775 leader_election.cc:290] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.311815  7771 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.314631  7770 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.318325  7770 ts_tablet_manager.cc:1403] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.001s
I20260709 13:13:26.320600  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fc4e0ef7a1457d92676be63b406531" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.321376  7580 raft_consensus.cc:2468] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.322490  7770 raft_consensus.cc:359] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.322822  7621 leader_election.cc:304] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.323462  7770 raft_consensus.cc:385] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.323855  7770 raft_consensus.cc:740] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.324177  7776 raft_consensus.cc:493] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.324672  7776 raft_consensus.cc:515] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.324842  7770 consensus_queue.cc:260] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.327019  7776 leader_election.cc:290] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.323882  7775 raft_consensus.cc:2804] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.328436  7775 raft_consensus.cc:493] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.328866  7775 raft_consensus.cc:3060] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.339697  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fc4e0ef7a1457d92676be63b406531" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
W20260709 13:13:26.342061  7618 leader_election.cc:343] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.344548  7771 ts_tablet_manager.cc:1403] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.005s
I20260709 13:13:26.349946  7769 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.350521  7769 ts_tablet_manager.cc:1403] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.083s	user 0.030s	sys 0.049s
I20260709 13:13:26.353626  7769 raft_consensus.cc:359] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.354364  7769 raft_consensus.cc:385] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.354655  7769 raft_consensus.cc:740] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.355466  7769 consensus_queue.cc:260] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.339847  7775 raft_consensus.cc:515] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.357813  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f9bceeca44a67944bf6646cd6b181" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.358839  7655 raft_consensus.cc:2468] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:26.360860  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fc4e0ef7a1457d92676be63b406531" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.361734  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.362635  7655 raft_consensus.cc:2468] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
W20260709 13:13:26.362823  7618 leader_election.cc:343] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.360901  7776 raft_consensus.cc:493] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.364259  7776 raft_consensus.cc:515] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.365645  7543 leader_election.cc:304] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.366861  7543 leader_election.cc:304] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.367061  7776 leader_election.cc:290] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.367846  7776 raft_consensus.cc:2804] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.368439  7776 raft_consensus.cc:493] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.368870  7776 raft_consensus.cc:3060] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.369210  7771 raft_consensus.cc:359] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.370285  7771 raft_consensus.cc:385] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.371768  7775 leader_election.cc:290] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.372366  7775 raft_consensus.cc:493] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.372766  7775 raft_consensus.cc:515] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.376400  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fc4e0ef7a1457d92676be63b406531" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.376972  7580 raft_consensus.cc:3060] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.385488  7580 raft_consensus.cc:2468] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:26.387655  7800 raft_consensus.cc:2804] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.388322  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.389312  7579 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.390093  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.391006  7655 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:26.391311  7621 leader_election.cc:304] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:26.392752  7798 raft_consensus.cc:2804] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.393379  7798 raft_consensus.cc:697] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:26.394527  7798 consensus_queue.cc:237] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.395609  7770 ts_tablet_manager.cc:1434] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.076s	user 0.019s	sys 0.039s
I20260709 13:13:26.397552  7621 leader_election.cc:304] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.370636  7771 raft_consensus.cc:740] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.395432  7797 raft_consensus.cc:493] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.399241  7770 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.400823  7771 consensus_queue.cc:260] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
W20260709 13:13:26.404518  7526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:26.393178  7543 leader_election.cc:304] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.406623  7770 tablet_bootstrap.cc:654] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.399290  7797 raft_consensus.cc:515] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.408386  7802 raft_consensus.cc:2804] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.420285  7770 tablet_bootstrap.cc:492] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.418723  7726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.421296  7770 ts_tablet_manager.cc:1403] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.011s
I20260709 13:13:26.421380  7726 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:26.419364  7801 raft_consensus.cc:2804] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.422197  7801 raft_consensus.cc:493] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.418026  7727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.422646  7801 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.422922  7727 raft_consensus.cc:2468] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:26.417419  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f9bceeca44a67944bf6646cd6b181" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.425043  7770 raft_consensus.cc:359] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.425904  7770 raft_consensus.cc:385] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.426249  7770 raft_consensus.cc:740] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
W20260709 13:13:26.426563  7543 leader_election.cc:343] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.426826  7802 raft_consensus.cc:493] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.412710  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.409708  7776 raft_consensus.cc:515] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.427444  7802 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.427802  7729 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.429343  7776 leader_election.cc:290] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.388329  7800 raft_consensus.cc:493] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.429934  7800 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.427242  7770 consensus_queue.cc:260] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.431098  7775 leader_election.cc:290] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.436620  7771 ts_tablet_manager.cc:1434] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:13:26.442036  7770 ts_tablet_manager.cc:1434] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 13:13:26.442643  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f9bceeca44a67944bf6646cd6b181" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.443356  7770 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.443308  7655 raft_consensus.cc:3060] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.449404  7769 ts_tablet_manager.cc:1434] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.099s	user 0.023s	sys 0.065s
I20260709 13:13:26.450610  7769 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.451063  7655 raft_consensus.cc:2468] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:26.455523  7797 leader_election.cc:290] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.456730  7801 raft_consensus.cc:515] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.457647  7769 tablet_bootstrap.cc:654] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.459304  7770 tablet_bootstrap.cc:654] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.458495  7476 catalog_manager.cc:5697] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.459643  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.454160  7802 raft_consensus.cc:515] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.461746  7580 raft_consensus.cc:2393] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60fff4236c484ad28df300176902dd2e in current term 1: Already voted for candidate 3fa3fc418061496f8d2451d22f920d3e in this term.
I20260709 13:13:26.466815  7771 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.467469  7802 leader_election.cc:290] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.468849  7769 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.469347  7769 ts_tablet_manager.cc:1403] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:13:26.469638  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.470288  7729 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.471920  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f9bceeca44a67944bf6646cd6b181" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.472141  7769 raft_consensus.cc:359] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.472875  7769 raft_consensus.cc:385] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.472890  7801 leader_election.cc:290] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.473218  7769 raft_consensus.cc:740] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.474112  7769 consensus_queue.cc:260] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.476107  7770 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.476203  7769 ts_tablet_manager.cc:1434] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:26.476891  7770 ts_tablet_manager.cc:1403] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.007s
I20260709 13:13:26.477370  7769 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:26.479417  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.480085  7655 raft_consensus.cc:2468] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:26.479808  7770 raft_consensus.cc:359] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.480799  7770 raft_consensus.cc:385] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.481139  7770 raft_consensus.cc:740] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.481961  7770 consensus_queue.cc:260] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.482216  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.485775  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.486632  7770 ts_tablet_manager.cc:1434] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:26.483662  7769 tablet_bootstrap.cc:654] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.483633  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.487856  7770 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:26.487986  7655 raft_consensus.cc:2393] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fa3fc418061496f8d2451d22f920d3e in current term 1: Already voted for candidate 60fff4236c484ad28df300176902dd2e in this term.
I20260709 13:13:26.488266  7729 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
W20260709 13:13:26.487216  7543 leader_election.cc:343] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:26.489379  7543 leader_election.cc:343] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.489460  7618 leader_election.cc:304] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:26.490358  7543 leader_election.cc:304] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:26.490785  7801 raft_consensus.cc:2804] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.491145  7802 raft_consensus.cc:2804] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.491566  7543 leader_election.cc:304] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:26.491679  7802 raft_consensus.cc:697] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:26.492481  7797 raft_consensus.cc:2804] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.493021  7797 raft_consensus.cc:493] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.492705  7802 consensus_queue.cc:237] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.493528  7797 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.450289  7800 raft_consensus.cc:515] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.497190  7771 tablet_bootstrap.cc:654] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.498868  7543 leader_election.cc:304] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e
I20260709 13:13:26.499820  7776 raft_consensus.cc:2749] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.491634  7801 raft_consensus.cc:697] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:26.502826  7801 consensus_queue.cc:237] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.504751  7777 raft_consensus.cc:493] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.503840  7770 tablet_bootstrap.cc:654] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.505450  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.506096  7655 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.505563  7777 raft_consensus.cc:515] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.514938  7777 leader_election.cc:290] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:26.516033  7655 raft_consensus.cc:2468] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:26.518674  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.519388  7728 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.528955  7728 raft_consensus.cc:2468] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:26.501745  7800 leader_election.cc:290] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.531646  7798 raft_consensus.cc:493] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.532513  7798 raft_consensus.cc:515] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.536475  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.537357  7580 raft_consensus.cc:2468] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.539058  7621 leader_election.cc:304] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.539536  7770 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:26.540135  7775 raft_consensus.cc:2804] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.540274  7770 ts_tablet_manager.cc:1403] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 13:13:26.540716  7775 raft_consensus.cc:493] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.541235  7775 raft_consensus.cc:3060] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.543967  7770 raft_consensus.cc:359] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.544889  7770 raft_consensus.cc:385] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.545217  7770 raft_consensus.cc:740] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.546092  7770 consensus_queue.cc:260] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.548648  7770 ts_tablet_manager.cc:1434] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:26.531641  7543 leader_election.cc:304] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:26.551911  7802 raft_consensus.cc:2804] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.552600  7802 raft_consensus.cc:697] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:26.553052  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.553493  7802 consensus_queue.cc:237] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
W20260709 13:13:26.555230  7618 leader_election.cc:343] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.556200  7798 leader_election.cc:290] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.558519  7775 raft_consensus.cc:515] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.562845  7797 raft_consensus.cc:515] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.565671  7797 leader_election.cc:290] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.567281  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.568188  7580 raft_consensus.cc:3060] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.568890  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.569525  7655 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.573364  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.578212  7655 raft_consensus.cc:2468] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:26.569459  7771 tablet_bootstrap.cc:492] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.580165  7771 ts_tablet_manager.cc:1403] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.012s
I20260709 13:13:26.584235  7771 raft_consensus.cc:359] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.586117  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.592108  7771 raft_consensus.cc:385] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:26.592549  7618 leader_election.cc:343] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.586795  7775 leader_election.cc:290] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.588155  7769 tablet_bootstrap.cc:492] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:26.594169  7769 ts_tablet_manager.cc:1403] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.117s	user 0.035s	sys 0.071s
I20260709 13:13:26.594056  7543 leader_election.cc:304] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.595463  7802 raft_consensus.cc:2804] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:26.595582  7543 leader_election.cc:343] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:26.595952  7802 raft_consensus.cc:697] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:26.590446  7580 raft_consensus.cc:2468] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:26.596917  7802 consensus_queue.cc:237] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.597124  7769 raft_consensus.cc:359] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.597860  7769 raft_consensus.cc:385] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.597723  7621 leader_election.cc:304] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:26.598177  7769 raft_consensus.cc:740] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.598963  7775 raft_consensus.cc:2804] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.598861  7769 consensus_queue.cc:260] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.599092  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.599500  7775 raft_consensus.cc:697] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:26.599895  7579 raft_consensus.cc:2468] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:26.600926  7769 ts_tablet_manager.cc:1434] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:26.600697  7775 consensus_queue.cc:237] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.592492  7771 raft_consensus.cc:740] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.603672  7695 leader_election.cc:304] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:26.604592  7777 raft_consensus.cc:2804] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.604946  7777 raft_consensus.cc:493] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.605315  7777 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.602567  7771 consensus_queue.cc:260] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.607349  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.608245  7655 raft_consensus.cc:2468] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:26.613018  7801 raft_consensus.cc:493] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.613562  7801 raft_consensus.cc:515] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.615734  7801 leader_election.cc:290] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.615101  7476 catalog_manager.cc:5697] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.617267  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.617937  7728 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.618113  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.618798  7580 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.620839  7777 raft_consensus.cc:515] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.619381  7618 leader_election.cc:304] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.622610  7801 raft_consensus.cc:2804] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.623019  7801 raft_consensus.cc:493] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.623653  7801 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.622969  7798 raft_consensus.cc:493] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.627223  7798 raft_consensus.cc:515] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.629397  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.629595  7801 raft_consensus.cc:515] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.630002  7798 leader_election.cc:290] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.630879  7777 leader_election.cc:290] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:26.630085  7655 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.631608  7801 leader_election.cc:290] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.634075  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.635076  7729 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.635114  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:26.635968  7728 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.637256  7777 raft_consensus.cc:493] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.637356  7618 leader_election.cc:304] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.637737  7777 raft_consensus.cc:515] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.639881  7777 leader_election.cc:290] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989)
I20260709 13:13:26.640458  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.641372  7579 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:26.643512  7655 raft_consensus.cc:2468] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:26.644801  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.645685  7579 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.647428  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.648418  7578 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:26.649924  7695 leader_election.cc:304] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:26.651149  7777 raft_consensus.cc:2804] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.651590  7777 raft_consensus.cc:493] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.651917  7777 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.630436  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.663156  7798 raft_consensus.cc:2804] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:26.664002  7798 raft_consensus.cc:493] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.664753  7798 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.666942  7478 catalog_manager.cc:5697] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.669863  7478 catalog_manager.cc:5697] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.674806  7580 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.677176  7777 raft_consensus.cc:515] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.681571  7798 raft_consensus.cc:515] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.682340  7729 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:26.687724  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.691309  7798 leader_election.cc:290] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:26.692138  7577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:26.693552  7578 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.694005  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:26.694345  7579 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:26.694880  7728 raft_consensus.cc:2393] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60fff4236c484ad28df300176902dd2e in current term 1: Already voted for candidate 2d3a92cebfb5426b8060a3b7167c0bec in this term.
I20260709 13:13:26.695552  7621 leader_election.cc:304] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.695652  7692 leader_election.cc:304] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:26.696751  7798 raft_consensus.cc:2804] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.697587  7798 raft_consensus.cc:697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:26.698047  7618 leader_election.cc:304] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:26.698916  7801 raft_consensus.cc:2749] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:26.698459  7798 consensus_queue.cc:237] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.700588  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.700924  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:26.701493  7655 raft_consensus.cc:2393] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d3a92cebfb5426b8060a3b7167c0bec in current term 1: Already voted for candidate 60fff4236c484ad28df300176902dd2e in this term.
I20260709 13:13:26.702097  7578 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:26.705310  7695 leader_election.cc:304] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 60fff4236c484ad28df300176902dd2e
I20260709 13:13:26.707968  7771 ts_tablet_manager.cc:1434] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.127s	user 0.032s	sys 0.057s
I20260709 13:13:26.688642  7777 leader_election.cc:290] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989)
I20260709 13:13:26.712297  7771 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.708060  7819 raft_consensus.cc:2804] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.715693  7820 raft_consensus.cc:2804] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:26.716313  7820 raft_consensus.cc:697] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:26.717170  7820 consensus_queue.cc:237] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.719483  7771 tablet_bootstrap.cc:654] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.722177  7819 raft_consensus.cc:697] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:26.724011  7819 consensus_queue.cc:237] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.724917  7475 catalog_manager.cc:5697] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.721629  7580 raft_consensus.cc:2468] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:26.729530  7474 catalog_manager.cc:5697] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.738152  7771 tablet_bootstrap.cc:492] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.738816  7771 ts_tablet_manager.cc:1403] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.013s
I20260709 13:13:26.742004  7771 raft_consensus.cc:359] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.742796  7771 raft_consensus.cc:385] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.743111  7771 raft_consensus.cc:740] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.743885  7771 consensus_queue.cc:260] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.746404  7771 ts_tablet_manager.cc:1434] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:26.747478  7771 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.749734  7474 catalog_manager.cc:5697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.750427  7476 catalog_manager.cc:5697] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.752615  7476 catalog_manager.cc:5697] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.753736  7771 tablet_bootstrap.cc:654] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.759316  7771 tablet_bootstrap.cc:492] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.759804  7771 ts_tablet_manager.cc:1403] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:13:26.762108  7771 raft_consensus.cc:359] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.762692  7771 raft_consensus.cc:385] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.762956  7771 raft_consensus.cc:740] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.763582  7771 consensus_queue.cc:260] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.765450  7771 ts_tablet_manager.cc:1434] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:13:26.766407  7771 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.771065  7771 tablet_bootstrap.cc:654] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.775216  7771 tablet_bootstrap.cc:492] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.775609  7771 ts_tablet_manager.cc:1403] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:13:26.777613  7771 raft_consensus.cc:359] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.778107  7771 raft_consensus.cc:385] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.778348  7771 raft_consensus.cc:740] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.778925  7771 consensus_queue.cc:260] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.780416  7771 ts_tablet_manager.cc:1434] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.781461  7771 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:26.784189  7798 consensus_queue.cc:1048] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.786660  7771 tablet_bootstrap.cc:654] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.793351  7771 tablet_bootstrap.cc:492] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:26.793816  7771 ts_tablet_manager.cc:1403] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:13:26.796569  7771 raft_consensus.cc:359] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.797282  7771 raft_consensus.cc:385] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.797587  7771 raft_consensus.cc:740] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.798395  7771 consensus_queue.cc:260] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.799638  7729 raft_consensus.cc:3060] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.800660  7771 ts_tablet_manager.cc:1434] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:26.811357  7801 consensus_queue.cc:1048] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.877969  7729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:26.878532  7729 raft_consensus.cc:606] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:26.883735  7729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:26.884258  7729 raft_consensus.cc:606] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:26.896618  7655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
mode: GRACEFUL
new_leader_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:60568
I20260709 13:13:26.897203  7655 raft_consensus.cc:606] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Received request to transfer leadership to TS 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:26.918221  7580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
mode: GRACEFUL
new_leader_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:56790
I20260709 13:13:26.918852  7580 raft_consensus.cc:606] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Received request to transfer leadership to TS 60fff4236c484ad28df300176902dd2e
I20260709 13:13:26.927413  7580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
mode: GRACEFUL
new_leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:56790
I20260709 13:13:26.927975  7580 raft_consensus.cc:606] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Received request to transfer leadership to TS 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:26.975842  7819 raft_consensus.cc:493] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.976465  7819 raft_consensus.cc:515] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:26.978403  7819 leader_election.cc:290] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:26.979161  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:26.979485  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc40fa657d6e4b9c8c4c5896301f3ab1" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:26.979911  7580 raft_consensus.cc:2393] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d3a92cebfb5426b8060a3b7167c0bec in current term 1: Already voted for candidate 60fff4236c484ad28df300176902dd2e in this term.
I20260709 13:13:26.981065  7695 leader_election.cc:304] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec; no voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e
I20260709 13:13:26.981778  7819 raft_consensus.cc:3060] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.986809  7819 raft_consensus.cc:2749] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.007201  7729 raft_consensus.cc:3060] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.013880  7802 consensus_queue.cc:1048] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.025498  7800 consensus_queue.cc:1048] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.038829  7800 consensus_queue.cc:1048] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.045943  7802 raft_consensus.cc:993] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: : Instructing follower 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:27.046447  7802 raft_consensus.cc:1081] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Signalling peer 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:27.051610  7802 consensus_queue.cc:1048] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.051635  7654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:60554
I20260709 13:13:27.053283  7801 consensus_queue.cc:1048] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.053598  7654 raft_consensus.cc:493] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.057205  7654 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.059453  7802 consensus_queue.cc:1048] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.067081  7728 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.069979  7801 consensus_queue.cc:1048] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.071437  7654 raft_consensus.cc:515] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.073848  7654 leader_election.cc:290] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:27.077005  7726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:27.077389  7775 consensus_queue.cc:1048] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.078461  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3a518e22bd4f7baa4c332e3d22f4a4" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:27.079167  7579 raft_consensus.cc:3055] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.079492  7579 raft_consensus.cc:740] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:27.080276  7579 consensus_queue.cc:260] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.081429  7579 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.099141  7802 consensus_queue.cc:1048] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.107241  7775 consensus_queue.cc:1048] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.119514  7798 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.124401  7579 raft_consensus.cc:2468] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:27.125907  7621 leader_election.cc:304] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:27.131417  7797 raft_consensus.cc:993] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: : Instructing follower 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:27.131863  7797 raft_consensus.cc:1081] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Signalling peer 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:27.133754  7775 raft_consensus.cc:2804] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.134593  7775 raft_consensus.cc:697] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:27.135754  7775 consensus_queue.cc:237] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.136266  7725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:50210
I20260709 13:13:27.137109  7725 raft_consensus.cc:493] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.137603  7725 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.152118  7725 raft_consensus.cc:515] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.153640  7728 raft_consensus.cc:1240] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Rejecting Update request from peer 3fa3fc418061496f8d2451d22f920d3e for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.155696  7725 leader_election.cc:290] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:27.155848  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:27.156810  7579 raft_consensus.cc:3055] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.157249  7579 raft_consensus.cc:740] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:27.157805  7775 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.158304  7579 consensus_queue.cc:260] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.161092  7579 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.166405  7797 consensus_queue.cc:1175] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3fa3fc418061496f8d2451d22f920d3e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:27.169013  7579 raft_consensus.cc:2468] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:27.169673  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af88fe5e4da42c59b4471e8d688c456" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:27.170353  7655 raft_consensus.cc:3060] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.170454  7695 leader_election.cc:304] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:27.172644  7819 raft_consensus.cc:2804] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.173206  7819 raft_consensus.cc:697] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:27.174043  7819 consensus_queue.cc:237] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.177451  7655 raft_consensus.cc:2468] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:27.179661  7820 consensus_queue.cc:1048] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.182067  7475 catalog_manager.cc:5697] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 1 to 2, leader changed from 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1) to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 2 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.185024  7847 raft_consensus.cc:993] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: : Instructing follower 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.185598  7798 raft_consensus.cc:1081] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Signalling peer 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.187342  7580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:56778
I20260709 13:13:27.187913  7580 raft_consensus.cc:493] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.188293  7580 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.188686  7820 raft_consensus.cc:993] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.189150  7820 raft_consensus.cc:1081] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.191411  7578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:56786
I20260709 13:13:27.191975  7578 raft_consensus.cc:493] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.192345  7578 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.194761  7820 consensus_queue.cc:1048] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.202541  7580 raft_consensus.cc:515] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.203037  7578 raft_consensus.cc:515] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.204288  7579 raft_consensus.cc:1240] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Rejecting Update request from peer 2d3a92cebfb5426b8060a3b7167c0bec for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.204877  7580 leader_election.cc:290] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:27.207476  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:27.207764  7820 consensus_queue.cc:1059] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.208660  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:27.209046  7777 raft_consensus.cc:3055] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.209375  7578 leader_election.cc:290] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:27.209492  7777 raft_consensus.cc:740] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:27.208217  7725 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.210876  7777 consensus_queue.cc:260] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.212049  7777 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.213449  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:27.214098  7655 raft_consensus.cc:3055] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.214412  7655 raft_consensus.cc:740] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:27.215261  7655 consensus_queue.cc:260] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.216575  7655 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.216876  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a01dffa20b428e822d1cb74b2dcef5" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:27.209338  7654 raft_consensus.cc:3060] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.218605  7725 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:27.204288  7474 catalog_manager.cc:5697] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 1 to 2, leader changed from 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1) to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 2 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.220553  7543 leader_election.cc:304] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:27.221781  7797 raft_consensus.cc:2804] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.222246  7797 raft_consensus.cc:697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:27.223083  7797 consensus_queue.cc:237] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.223685  7655 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:27.227947  7728 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:27.229089  7820 consensus_queue.cc:1048] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.231519  7654 raft_consensus.cc:2468] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:27.233023  7543 leader_election.cc:304] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:27.233970  7797 raft_consensus.cc:2804] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.234726  7797 raft_consensus.cc:697] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:27.235864  7797 consensus_queue.cc:237] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.244028  7820 raft_consensus.cc:993] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.244501  7819 raft_consensus.cc:1081] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:27.246418  7580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:56786
I20260709 13:13:27.247064  7580 raft_consensus.cc:493] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.247453  7580 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.247524  7475 catalog_manager.cc:5697] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.249922  7823 consensus_queue.cc:1048] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.249576  7475 catalog_manager.cc:5697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 1 to 2, leader changed from 60fff4236c484ad28df300176902dd2e (127.28.152.2) to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.255838  7580 raft_consensus.cc:515] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.260272  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:27.260914  7725 raft_consensus.cc:3055] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.261291  7725 raft_consensus.cc:740] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:27.262117  7725 consensus_queue.cc:260] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.262439  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbe69df51f8445e90a222f9d6743b40" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:27.263286  7725 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.270828  7580 leader_election.cc:290] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:27.271962  7725 raft_consensus.cc:2468] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:27.273129  7543 leader_election.cc:304] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 60fff4236c484ad28df300176902dd2e
I20260709 13:13:27.273955  7797 raft_consensus.cc:2804] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.274497  7797 raft_consensus.cc:697] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:27.275271  7797 consensus_queue.cc:237] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:27.281840  7476 catalog_manager.cc:5697] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.608174  7725 raft_consensus.cc:3060] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.613833  7725 raft_consensus.cc:1275] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.615358  7798 consensus_queue.cc:1048] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.621191  7725 raft_consensus.cc:1275] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.623028  7580 raft_consensus.cc:1275] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.624019  7578 raft_consensus.cc:1275] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.624706  7820 consensus_queue.cc:1048] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.625952  7847 consensus_queue.cc:1048] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.626781  7797 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.635875  7654 raft_consensus.cc:1275] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.637439  7820 consensus_queue.cc:1048] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.644758  7654 raft_consensus.cc:1275] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.649082  7854 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.655056  7725 raft_consensus.cc:1275] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.656571  7854 consensus_queue.cc:1048] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.668247  7655 raft_consensus.cc:3060] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.676029  7655 raft_consensus.cc:1275] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.677191  7853 consensus_queue.cc:1048] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.809258  7655 raft_consensus.cc:1275] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.810647  7853 consensus_queue.cc:1048] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.818714  7725 raft_consensus.cc:1275] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.820878  7853 consensus_queue.cc:1048] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.954977  7476 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40550:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:29.957262  7476 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:30.003767  7569 tablet_service.cc:1511] Processing CreateTablet for tablet fff2a1c84b864afca828828c50a70e2f (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:30.005107  7569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2a1c84b864afca828828c50a70e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.004904  7644 tablet_service.cc:1511] Processing CreateTablet for tablet fff2a1c84b864afca828828c50a70e2f (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:30.006211  7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2a1c84b864afca828828c50a70e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.009042  7711 tablet_service.cc:1511] Processing CreateTablet for tablet fff2a1c84b864afca828828c50a70e2f (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:30.010447  7711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2a1c84b864afca828828c50a70e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.010155  7570 tablet_service.cc:1511] Processing CreateTablet for tablet e4db1d9b10ee44f181b66e840b2d7bd1 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:30.011619  7570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4db1d9b10ee44f181b66e840b2d7bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.015810  7566 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd8eb6977547478df57c21bd0ffb24 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:30.017171  7566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd8eb6977547478df57c21bd0ffb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.018006  7641 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd8eb6977547478df57c21bd0ffb24 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:30.019325  7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd8eb6977547478df57c21bd0ffb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.019202  7715 tablet_service.cc:1511] Processing CreateTablet for tablet d5bd8eb6977547478df57c21bd0ffb24 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:30.009043  7637 tablet_service.cc:1511] Processing CreateTablet for tablet e4db1d9b10ee44f181b66e840b2d7bd1 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:30.021062  7715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5bd8eb6977547478df57c21bd0ffb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.021692  7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4db1d9b10ee44f181b66e840b2d7bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.019690  7716 tablet_service.cc:1511] Processing CreateTablet for tablet e4db1d9b10ee44f181b66e840b2d7bd1 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:30.023641  7716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4db1d9b10ee44f181b66e840b2d7bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.034639  7565 tablet_service.cc:1511] Processing CreateTablet for tablet d78314637ac3456ea43ece29232fef39 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:30.036079  7565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78314637ac3456ea43ece29232fef39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.045956  7645 tablet_service.cc:1511] Processing CreateTablet for tablet d78314637ac3456ea43ece29232fef39 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:30.047377  7645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78314637ac3456ea43ece29232fef39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.048318  7568 tablet_service.cc:1511] Processing CreateTablet for tablet 74e95fb064374a6d9ca96ebc1c9496a0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:30.049625  7568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e95fb064374a6d9ca96ebc1c9496a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.056156  7564 tablet_service.cc:1511] Processing CreateTablet for tablet 7072dfea0ab148ebb198477db540c1c0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:30.057608  7564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7072dfea0ab148ebb198477db540c1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.057318  7712 tablet_service.cc:1511] Processing CreateTablet for tablet d78314637ac3456ea43ece29232fef39 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:30.058727  7712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d78314637ac3456ea43ece29232fef39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.061475  7868 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.061623  7719 tablet_service.cc:1511] Processing CreateTablet for tablet 74e95fb064374a6d9ca96ebc1c9496a0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:30.063125  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e95fb064374a6d9ca96ebc1c9496a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.066274  7563 tablet_service.cc:1511] Processing CreateTablet for tablet 745d7cf3ea5941f3ae94c654bc48ad7e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:30.067823  7563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745d7cf3ea5941f3ae94c654bc48ad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.068356  7644 tablet_service.cc:1511] Processing CreateTablet for tablet 74e95fb064374a6d9ca96ebc1c9496a0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:30.069631  7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e95fb064374a6d9ca96ebc1c9496a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.070936  7640 tablet_service.cc:1511] Processing CreateTablet for tablet 7072dfea0ab148ebb198477db540c1c0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:30.071215  7642 tablet_service.cc:1511] Processing CreateTablet for tablet 745d7cf3ea5941f3ae94c654bc48ad7e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:30.072245  7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7072dfea0ab148ebb198477db540c1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.073061  7567 tablet_service.cc:1511] Processing CreateTablet for tablet 7d46fcb0110c45c3a03aeb35eae20dc2 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:30.074352  7567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d46fcb0110c45c3a03aeb35eae20dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.074110  7718 tablet_service.cc:1511] Processing CreateTablet for tablet 745d7cf3ea5941f3ae94c654bc48ad7e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:30.075428  7718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745d7cf3ea5941f3ae94c654bc48ad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.077236  7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745d7cf3ea5941f3ae94c654bc48ad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.096346  7562 tablet_service.cc:1511] Processing CreateTablet for tablet be6936cae24c4f4fb6c16a06ec94ae9e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:30.097256  7643 tablet_service.cc:1511] Processing CreateTablet for tablet 7d46fcb0110c45c3a03aeb35eae20dc2 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:30.097744  7562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6936cae24c4f4fb6c16a06ec94ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.098598  7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d46fcb0110c45c3a03aeb35eae20dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.100508  7717 tablet_service.cc:1511] Processing CreateTablet for tablet 7d46fcb0110c45c3a03aeb35eae20dc2 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:30.100593  7715 tablet_service.cc:1511] Processing CreateTablet for tablet 7072dfea0ab148ebb198477db540c1c0 (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:30.101945  7717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d46fcb0110c45c3a03aeb35eae20dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.103681  7639 tablet_service.cc:1511] Processing CreateTablet for tablet be6936cae24c4f4fb6c16a06ec94ae9e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:30.105101  7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6936cae24c4f4fb6c16a06ec94ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.103668  7713 tablet_service.cc:1511] Processing CreateTablet for tablet be6936cae24c4f4fb6c16a06ec94ae9e (DEFAULT_TABLE table=soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:30.103822  7868 tablet_bootstrap.cc:654] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.145702  7713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be6936cae24c4f4fb6c16a06ec94ae9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.173717  7715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7072dfea0ab148ebb198477db540c1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:30.197333  7870 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.212136  7869 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.216799  7868 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.217334  7868 ts_tablet_manager.cc:1403] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.000s
I20260709 13:13:30.219954  7868 raft_consensus.cc:359] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.220522  7868 raft_consensus.cc:385] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.220855  7868 raft_consensus.cc:740] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.221712  7868 consensus_queue.cc:260] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.223435  7869 tablet_bootstrap.cc:654] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.224299  7868 ts_tablet_manager.cc:1434] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:30.225466  7868 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.243474  7870 tablet_bootstrap.cc:654] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.251313  7868 tablet_bootstrap.cc:654] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.258391  7869 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.258945  7869 ts_tablet_manager.cc:1403] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.022s
I20260709 13:13:30.259195  7868 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.259778  7868 ts_tablet_manager.cc:1403] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:13:30.260267  7870 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.260743  7870 ts_tablet_manager.cc:1403] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.003s
I20260709 13:13:30.261904  7869 raft_consensus.cc:359] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.262753  7869 raft_consensus.cc:385] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.262580  7868 raft_consensus.cc:359] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.263139  7869 raft_consensus.cc:740] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.262910  7870 raft_consensus.cc:359] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.263443  7868 raft_consensus.cc:385] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.263824  7870 raft_consensus.cc:385] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.263895  7868 raft_consensus.cc:740] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.264155  7870 raft_consensus.cc:740] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.264142  7869 consensus_queue.cc:260] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.264820  7868 consensus_queue.cc:260] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.266790  7869 ts_tablet_manager.cc:1434] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:30.267300  7868 ts_tablet_manager.cc:1434] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:30.267935  7869 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.268316  7868 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.265173  7870 consensus_queue.cc:260] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.272300  7870 ts_tablet_manager.cc:1434] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:30.273655  7870 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.275142  7869 tablet_bootstrap.cc:654] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.275480  7868 tablet_bootstrap.cc:654] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.284849  7870 tablet_bootstrap.cc:654] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.289913  7868 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.289927  7869 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.290606  7868 ts_tablet_manager.cc:1403] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:13:30.290670  7869 ts_tablet_manager.cc:1403] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.001s
I20260709 13:13:30.293926  7869 raft_consensus.cc:359] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.294175  7868 raft_consensus.cc:359] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.294741  7869 raft_consensus.cc:385] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.294963  7868 raft_consensus.cc:385] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.295117  7869 raft_consensus.cc:740] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.295367  7868 raft_consensus.cc:740] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.296092  7869 consensus_queue.cc:260] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.296264  7868 consensus_queue.cc:260] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.298440  7869 ts_tablet_manager.cc:1434] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:30.298669  7868 ts_tablet_manager.cc:1434] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:30.299564  7869 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.300312  7868 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.306641  7869 tablet_bootstrap.cc:654] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.308440  7870 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.309005  7870 ts_tablet_manager.cc:1403] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260709 13:13:30.312628  7868 tablet_bootstrap.cc:654] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.316788  7869 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.316105  7870 raft_consensus.cc:359] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.317194  7870 raft_consensus.cc:385] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.317307  7869 ts_tablet_manager.cc:1403] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:13:30.317533  7870 raft_consensus.cc:740] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.318377  7870 consensus_queue.cc:260] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.320644  7870 ts_tablet_manager.cc:1434] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:30.320466  7869 raft_consensus.cc:359] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.321259  7869 raft_consensus.cc:385] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.321616  7869 raft_consensus.cc:740] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.322175  7870 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.322410  7869 consensus_queue.cc:260] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.324944  7868 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.325474  7868 ts_tablet_manager.cc:1403] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:13:30.328500  7868 raft_consensus.cc:359] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.329173  7868 raft_consensus.cc:385] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.329465  7868 raft_consensus.cc:740] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.330191  7868 consensus_queue.cc:260] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.331907  7868 ts_tablet_manager.cc:1434] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:30.332921  7868 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.332981  7869 ts_tablet_manager.cc:1434] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:13:30.336524  7869 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.339371  7868 tablet_bootstrap.cc:654] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.340195  7870 tablet_bootstrap.cc:654] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.343750  7869 tablet_bootstrap.cc:654] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.355320  7870 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.355942  7870 ts_tablet_manager.cc:1403] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.004s
I20260709 13:13:30.356002  7869 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.356676  7869 ts_tablet_manager.cc:1403] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:13:30.359293  7870 raft_consensus.cc:359] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.359516  7869 raft_consensus.cc:359] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.360237  7870 raft_consensus.cc:385] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.360287  7869 raft_consensus.cc:385] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.360709  7870 raft_consensus.cc:740] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.360757  7869 raft_consensus.cc:740] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.361740  7870 consensus_queue.cc:260] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.361740  7869 consensus_queue.cc:260] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.363631  7868 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.364185  7868 ts_tablet_manager.cc:1403] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.010s
I20260709 13:13:30.364378  7870 ts_tablet_manager.cc:1434] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:30.364482  7869 ts_tablet_manager.cc:1434] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:30.365700  7869 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.365742  7870 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.367219  7868 raft_consensus.cc:359] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.368012  7868 raft_consensus.cc:385] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.368335  7868 raft_consensus.cc:740] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.369083  7868 consensus_queue.cc:260] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.371469  7868 ts_tablet_manager.cc:1434] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:13:30.372588  7868 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.374923  7869 tablet_bootstrap.cc:654] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.376288  7870 tablet_bootstrap.cc:654] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.379623  7868 tablet_bootstrap.cc:654] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.393577  7870 tablet_bootstrap.cc:492] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.394116  7870 ts_tablet_manager.cc:1403] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 13:13:30.397215  7870 raft_consensus.cc:359] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.397779  7870 raft_consensus.cc:385] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.398018  7870 raft_consensus.cc:740] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.398680  7870 consensus_queue.cc:260] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.400928  7870 ts_tablet_manager.cc:1434] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:30.402503  7870 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.405174  7869 tablet_bootstrap.cc:492] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.405661  7869 ts_tablet_manager.cc:1403] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.016s
I20260709 13:13:30.408939  7868 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.409122  7870 tablet_bootstrap.cc:654] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.408809  7869 raft_consensus.cc:359] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.409572  7868 ts_tablet_manager.cc:1403] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 13:13:30.409624  7869 raft_consensus.cc:385] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.410171  7869 raft_consensus.cc:740] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.411115  7869 consensus_queue.cc:260] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.413861  7869 ts_tablet_manager.cc:1434] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:13:30.415177  7869 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.416846  7868 raft_consensus.cc:359] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.418135  7868 raft_consensus.cc:385] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.418603  7868 raft_consensus.cc:740] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.419670  7868 consensus_queue.cc:260] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.423143  7868 ts_tablet_manager.cc:1434] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:13:30.423604  7869 tablet_bootstrap.cc:654] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.424504  7868 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
W20260709 13:13:30.464936  7526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:30.481746  7856 raft_consensus.cc:493] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.483286  7856 raft_consensus.cc:515] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.488230  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:30.488770  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.489882  7655 raft_consensus.cc:2468] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
W20260709 13:13:30.491689  7695 leader_election.cc:343] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.493180  7870 tablet_bootstrap.cc:492] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.493393  7692 leader_election.cc:304] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:30.494477  7870 ts_tablet_manager.cc:1403] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.008s
I20260709 13:13:30.486338  7856 leader_election.cc:290] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.495980  7889 raft_consensus.cc:2804] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.488788  7868 tablet_bootstrap.cc:654] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.496915  7889 raft_consensus.cc:493] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.498406  7889 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.502259  7870 raft_consensus.cc:359] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.503870  7870 raft_consensus.cc:385] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.504401  7870 raft_consensus.cc:740] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.506367  7870 consensus_queue.cc:260] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.514775  7889 raft_consensus.cc:515] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.517807  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
W20260709 13:13:30.519436  7695 leader_election.cc:343] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.519223  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.520231  7889 leader_election.cc:290] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.520267  7655 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.528384  7869 tablet_bootstrap.cc:492] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.528733  7870 ts_tablet_manager.cc:1434] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.034s	user 0.013s	sys 0.001s
I20260709 13:13:30.529477  7869 ts_tablet_manager.cc:1403] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.009s
I20260709 13:13:30.534647  7870 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.535072  7868 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.536190  7868 ts_tablet_manager.cc:1403] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.019s
I20260709 13:13:30.539507  7655 raft_consensus.cc:2468] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:30.540887  7889 raft_consensus.cc:493] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.541363  7871 raft_consensus.cc:493] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.540186  7868 raft_consensus.cc:359] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.548552  7868 raft_consensus.cc:385] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.549022  7868 raft_consensus.cc:740] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.548578  7889 raft_consensus.cc:515] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.548715  7871 raft_consensus.cc:515] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.549952  7868 consensus_queue.cc:260] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.551419  7889 leader_election.cc:290] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.553045  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e95fb064374a6d9ca96ebc1c9496a0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:30.551824  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:30.547065  7869 raft_consensus.cc:359] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.547698  7692 leader_election.cc:304] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:30.554162  7578 raft_consensus.cc:2468] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:30.554206  7580 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:30.551627  7871 leader_election.cc:290] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.547499  7870 tablet_bootstrap.cc:654] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.556684  7868 ts_tablet_manager.cc:1434] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:13:30.556633  7695 leader_election.cc:304] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:30.553086  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e95fb064374a6d9ca96ebc1c9496a0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.558275  7725 raft_consensus.cc:2468] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:30.558894  7868 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.560022  7856 raft_consensus.cc:2804] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.561252  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.561635  7871 raft_consensus.cc:493] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.562211  7655 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:30.562422  7871 raft_consensus.cc:515] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.563040  7869 raft_consensus.cc:385] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.563495  7869 raft_consensus.cc:740] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.560200  7889 raft_consensus.cc:2804] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.564849  7871 leader_election.cc:290] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.565083  7889 raft_consensus.cc:493] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.565502  7889 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.560037  7618 leader_election.cc:304] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.564385  7869 consensus_queue.cc:260] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.567857  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.568100  7868 tablet_bootstrap.cc:654] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.568708  7725 raft_consensus.cc:2468] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 0.
I20260709 13:13:30.569730  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:30.570045  7853 raft_consensus.cc:493] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.571080  7621 leader_election.cc:343] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.570912  7853 raft_consensus.cc:515] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.574302  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78314637ac3456ea43ece29232fef39" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.575138  7655 raft_consensus.cc:2468] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.576354  7853 leader_election.cc:290] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.576785  7543 leader_election.cc:304] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.577565  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78314637ac3456ea43ece29232fef39" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.577936  7853 raft_consensus.cc:2804] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.578451  7725 raft_consensus.cc:2468] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.578647  7853 raft_consensus.cc:493] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.579527  7853 raft_consensus.cc:3060] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.581660  7870 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.582261  7870 ts_tablet_manager.cc:1403] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.005s
I20260709 13:13:30.579571  7618 leader_election.cc:304] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:30.583735  7868 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.584192  7868 ts_tablet_manager.cc:1403] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:13:30.589675  7870 raft_consensus.cc:359] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.590643  7870 raft_consensus.cc:385] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.591056  7870 raft_consensus.cc:740] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.604179  7893 raft_consensus.cc:493] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.600459  7856 raft_consensus.cc:697] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:30.606870  7775 raft_consensus.cc:2804] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.607385  7775 raft_consensus.cc:493] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.607813  7775 raft_consensus.cc:3060] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.605700  7893 raft_consensus.cc:515] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.611203  7889 raft_consensus.cc:515] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.609203  7856 consensus_queue.cc:237] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.615842  7871 raft_consensus.cc:2804] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.616511  7871 raft_consensus.cc:493] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.617015  7871 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.623361  7853 raft_consensus.cc:515] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.626754  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78314637ac3456ea43ece29232fef39" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.594975  7870 consensus_queue.cc:260] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.627480  7655 raft_consensus.cc:3060] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.627398  7869 ts_tablet_manager.cc:1434] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 13:13:30.636569  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:30.637593  7578 raft_consensus.cc:2468] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:30.632113  7868 raft_consensus.cc:359] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.638228  7868 raft_consensus.cc:385] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.638680  7868 raft_consensus.cc:740] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.640530  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:30.641767  7579 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.647162  7868 consensus_queue.cc:260] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.650270  7775 raft_consensus.cc:515] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
W20260709 13:13:30.654388  7618 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.152.3:44787, user_credentials={real_user=slave}} blocked reactor thread for 74901.2us
I20260709 13:13:30.658571  7775 leader_election.cc:290] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.664268  7579 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:30.664474  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.666627  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e95fb064374a6d9ca96ebc1c9496a0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.656349  7893 leader_election.cc:290] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.674150  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d78314637ac3456ea43ece29232fef39" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.668525  7869 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.674954  7729 raft_consensus.cc:3060] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.651778  7871 raft_consensus.cc:515] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.674465  7725 raft_consensus.cc:3060] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.670384  7868 ts_tablet_manager.cc:1434] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.004s
I20260709 13:13:30.679363  7695 leader_election.cc:304] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:30.680040  7868 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: Bootstrap starting.
I20260709 13:13:30.680397  7893 raft_consensus.cc:2804] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.680812  7893 raft_consensus.cc:493] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.681159  7893 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.685993  7725 raft_consensus.cc:2468] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:30.669740  7870 ts_tablet_manager.cc:1434] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.015s
I20260709 13:13:30.694555  7618 leader_election.cc:304] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.688120  7871 leader_election.cc:290] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.689177  7896 raft_consensus.cc:493] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.690749  7692 leader_election.cc:343] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.660552  7655 raft_consensus.cc:2468] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.693179  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.698382  7728 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.694958  7870 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.701354  7868 tablet_bootstrap.cc:654] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.703164  7902 raft_consensus.cc:493] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.703456  7695 leader_election.cc:304] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:30.704612  7899 raft_consensus.cc:2804] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.703819  7902 raft_consensus.cc:515] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.708055  7902 leader_election.cc:290] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.708351  7870 tablet_bootstrap.cc:654] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.709676  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e95fb064374a6d9ca96ebc1c9496a0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:30.697209  7889 leader_election.cc:290] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.697532  7869 tablet_bootstrap.cc:654] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.698132  7896 raft_consensus.cc:515] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.712502  7579 raft_consensus.cc:3060] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.714509  7896 leader_election.cc:290] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.711949  7853 leader_election.cc:290] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.705200  7543 leader_election.cc:304] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.705662  7899 raft_consensus.cc:697] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:30.696169  7775 raft_consensus.cc:2804] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.686628  7729 raft_consensus.cc:2468] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.695544  7893 raft_consensus.cc:515] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.711369  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:30.717471  7899 consensus_queue.cc:237] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.719213  7580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
W20260709 13:13:30.725103  7621 leader_election.cc:343] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.719754  7853 raft_consensus.cc:2804] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.719623  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.719213  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.727597  7725 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.727043  7655 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.728482  7728 raft_consensus.cc:2468] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:30.728744  7853 raft_consensus.cc:697] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:30.726007  7775 raft_consensus.cc:697] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:30.730545  7853 consensus_queue.cc:237] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.731104  7543 leader_election.cc:304] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.732676  7893 leader_election.cc:290] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.725570  7580 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:30.733654  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:30.733826  7898 raft_consensus.cc:2804] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.734310  7578 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.736275  7898 raft_consensus.cc:493] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.736382  7695 leader_election.cc:304] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:30.741648  7898 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.742214  7899 raft_consensus.cc:2804] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.742622  7899 raft_consensus.cc:493] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.743016  7899 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.743949  7579 raft_consensus.cc:2468] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 1.
I20260709 13:13:30.746865  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.747830  7653 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.730628  7775 consensus_queue.cc:237] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.753058  7899 raft_consensus.cc:515] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.756037  7869 tablet_bootstrap.cc:492] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.762631  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.763398  7654 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 0.
I20260709 13:13:30.764813  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:30.764755  7618 leader_election.cc:304] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:30.765542  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.760799  7869 ts_tablet_manager.cc:1403] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.092s	user 0.002s	sys 0.015s
I20260709 13:13:30.767637  7899 leader_election.cc:290] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:30.772001  7903 raft_consensus.cc:2804] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.774132  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
W20260709 13:13:30.783506  7692 leader_election.cc:343] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.785518  7903 raft_consensus.cc:697] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:30.787874  7868 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: No bootstrap required, opened a new log
I20260709 13:13:30.788358  7868 ts_tablet_manager.cc:1403] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent bootstrapping tablet: real 0.109s	user 0.025s	sys 0.018s
I20260709 13:13:30.788003  7903 consensus_queue.cc:237] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.785974  7654 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.793923  7870 tablet_bootstrap.cc:492] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.794533  7870 ts_tablet_manager.cc:1403] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.016s
I20260709 13:13:30.794557  7653 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:30.799467  7870 raft_consensus.cc:359] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.800321  7870 raft_consensus.cc:385] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.800688  7870 raft_consensus.cc:740] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.800783  7476 catalog_manager.cc:5697] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.801666  7870 consensus_queue.cc:260] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.804250  7478 catalog_manager.cc:5697] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.805876  7870 ts_tablet_manager.cc:1434] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:30.805490  7654 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:30.807688  7692 leader_election.cc:304] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.808439  7902 raft_consensus.cc:493] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.808776  7899 raft_consensus.cc:2804] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.809020  7902 raft_consensus.cc:515] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.809437  7899 raft_consensus.cc:697] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:30.810210  7870 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.810434  7899 consensus_queue.cc:237] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.816243  7902 leader_election.cc:290] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.819180  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.819921  7870 tablet_bootstrap.cc:654] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.818332  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.814512  7898 raft_consensus.cc:515] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
W20260709 13:13:30.821837  7543 leader_election.cc:343] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.820564  7728 raft_consensus.cc:2468] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.822760  7579 raft_consensus.cc:2393] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d3a92cebfb5426b8060a3b7167c0bec in current term 1: Already voted for candidate 3fa3fc418061496f8d2451d22f920d3e in this term.
I20260709 13:13:30.823906  7898 leader_election.cc:290] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.824223  7543 leader_election.cc:304] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 60fff4236c484ad28df300176902dd2e
I20260709 13:13:30.825543  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.821290  7578 raft_consensus.cc:2468] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 1.
I20260709 13:13:30.831102  7902 raft_consensus.cc:2804] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.830860  7869 raft_consensus.cc:359] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.832334  7869 raft_consensus.cc:385] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.831718  7902 raft_consensus.cc:493] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.833442  7902 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.833650  7654 raft_consensus.cc:2393] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fa3fc418061496f8d2451d22f920d3e in current term 1: Already voted for candidate 2d3a92cebfb5426b8060a3b7167c0bec in this term.
I20260709 13:13:30.834240  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.836639  7868 raft_consensus.cc:359] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.837538  7868 raft_consensus.cc:385] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.837823  7868 raft_consensus.cc:740] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.838529  7543 leader_election.cc:304] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e
I20260709 13:13:30.835976  7869 raft_consensus.cc:740] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.841192  7869 consensus_queue.cc:260] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.844542  7868 consensus_queue.cc:260] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.840665  7898 raft_consensus.cc:2749] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.848516  7868 ts_tablet_manager.cc:1434] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:13:30.849920  7869 ts_tablet_manager.cc:1434] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.003s
I20260709 13:13:30.851846  7869 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.852341  7695 leader_election.cc:304] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 60fff4236c484ad28df300176902dd2e
I20260709 13:13:30.854946  7870 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.855710  7870 ts_tablet_manager.cc:1403] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.000s
I20260709 13:13:30.854815  7899 raft_consensus.cc:2804] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.856961  7899 raft_consensus.cc:697] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:30.858577  7869 tablet_bootstrap.cc:654] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.858896  7870 raft_consensus.cc:359] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.860632  7870 raft_consensus.cc:385] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.860239  7899 consensus_queue.cc:237] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.860978  7870 raft_consensus.cc:740] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.853828  7902 raft_consensus.cc:515] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.862650  7475 catalog_manager.cc:5697] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.865374  7902 leader_election.cc:290] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.866078  7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.866405  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.866415  7870 consensus_queue.cc:260] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.867295  7728 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.865190  7475 catalog_manager.cc:5697] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 1 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.866784  7654 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.869601  7870 ts_tablet_manager.cc:1434] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:30.871138  7870 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: Bootstrap starting.
I20260709 13:13:30.872408  7869 tablet_bootstrap.cc:492] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.872911  7869 ts_tablet_manager.cc:1403] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:13:30.875608  7902 raft_consensus.cc:493] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.875797  7869 raft_consensus.cc:359] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.876219  7902 raft_consensus.cc:515] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.879369  7869 raft_consensus.cc:385] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.879683  7869 raft_consensus.cc:740] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.880576  7728 raft_consensus.cc:2468] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.880968  7902 leader_election.cc:290] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.881934  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4db1d9b10ee44f181b66e840b2d7bd1" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.884011  7870 tablet_bootstrap.cc:654] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.882138  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4db1d9b10ee44f181b66e840b2d7bd1" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.880442  7869 consensus_queue.cc:260] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.884544  7543 leader_election.cc:304] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:30.884632  7729 raft_consensus.cc:2468] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.883558  7654 raft_consensus.cc:2468] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.885715  7898 raft_consensus.cc:2804] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.886206  7898 raft_consensus.cc:697] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:30.886324  7869 ts_tablet_manager.cc:1434] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:13:30.887137  7898 consensus_queue.cc:237] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.888339  7869 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: Bootstrap starting.
I20260709 13:13:30.892885  7653 raft_consensus.cc:2468] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 0.
I20260709 13:13:30.895781  7543 leader_election.cc:304] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.897111  7853 raft_consensus.cc:2804] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.897588  7853 raft_consensus.cc:493] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.898005  7853 raft_consensus.cc:3060] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.898649  7869 tablet_bootstrap.cc:654] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.920202  7853 raft_consensus.cc:515] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.936746  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4db1d9b10ee44f181b66e840b2d7bd1" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:30.937590  7653 raft_consensus.cc:3060] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.947875  7853 leader_election.cc:290] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.948119  7729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4db1d9b10ee44f181b66e840b2d7bd1" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:30.949095  7729 raft_consensus.cc:3060] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.956851  7476 catalog_manager.cc:5697] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.961815  7870 tablet_bootstrap.cc:492] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: No bootstrap required, opened a new log
I20260709 13:13:30.961839  7869 tablet_bootstrap.cc:492] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: No bootstrap required, opened a new log
I20260709 13:13:30.962498  7653 raft_consensus.cc:2468] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.966136  7869 ts_tablet_manager.cc:1403] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.023s
I20260709 13:13:30.966172  7870 ts_tablet_manager.cc:1403] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: Time spent bootstrapping tablet: real 0.096s	user 0.039s	sys 0.044s
I20260709 13:13:30.965266  7729 raft_consensus.cc:2468] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 1.
I20260709 13:13:30.967659  7543 leader_election.cc:304] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:30.969578  7870 raft_consensus.cc:359] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.969796  7869 raft_consensus.cc:359] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.970371  7870 raft_consensus.cc:385] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.970526  7869 raft_consensus.cc:385] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.970762  7870 raft_consensus.cc:740] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.971968  7898 raft_consensus.cc:493] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.972141  7853 raft_consensus.cc:2804] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.972060  7870 consensus_queue.cc:260] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.972579  7898 raft_consensus.cc:515] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.972903  7853 raft_consensus.cc:697] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:30.973848  7853 consensus_queue.cc:237] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.974427  7870 ts_tablet_manager.cc:1434] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:30.975807  7898 leader_election.cc:290] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:30.975977  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:30.977049  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:30.977867  7728 raft_consensus.cc:2393] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fa3fc418061496f8d2451d22f920d3e in current term 1: Already voted for candidate 60fff4236c484ad28df300176902dd2e in this term.
I20260709 13:13:30.970906  7869 raft_consensus.cc:740] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.979642  7869 consensus_queue.cc:260] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:30.980221  7543 leader_election.cc:304] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e
I20260709 13:13:30.981376  7853 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.981623  7869 ts_tablet_manager.cc:1434] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:13:30.981575  7478 catalog_manager.cc:5697] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.984011  7478 catalog_manager.cc:5697] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.988692  7853 raft_consensus.cc:2749] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.988612  7478 catalog_manager.cc:5697] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 1 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.006129  7853 raft_consensus.cc:493] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.007364  7853 raft_consensus.cc:515] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.010469  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fff4236c484ad28df300176902dd2e" is_pre_election: true
I20260709 13:13:31.011157  7853 leader_election.cc:290] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.011296  7653 raft_consensus.cc:2393] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fa3fc418061496f8d2451d22f920d3e in current term 1: Already voted for candidate 2d3a92cebfb5426b8060a3b7167c0bec in this term.
I20260709 13:13:31.011699  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:31.007298  7476 catalog_manager.cc:5697] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 1 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.013183  7543 leader_election.cc:304] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e
I20260709 13:13:31.013922  7853 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.020805  7853 raft_consensus.cc:2749] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.128121  7899 consensus_queue.cc:1048] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.140575  7899 consensus_queue.cc:1048] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.161043  7653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
mode: GRACEFUL
new_leader_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:60568
I20260709 13:13:31.161710  7653 raft_consensus.cc:606] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Received request to transfer leadership to TS 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:31.170022  7728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:31.170552  7728 raft_consensus.cc:606] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:31.178860  7899 consensus_queue.cc:1048] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.180732  7728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:31.181207  7728 raft_consensus.cc:606] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 60fff4236c484ad28df300176902dd2e
I20260709 13:13:31.189723  7728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:31.190284  7728 raft_consensus.cc:606] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 60fff4236c484ad28df300176902dd2e
I20260709 13:13:31.190938  7893 consensus_queue.cc:1048] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.198274  7728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
mode: GRACEFUL
new_leader_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:50220
I20260709 13:13:31.198904  7728 raft_consensus.cc:606] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Received request to transfer leadership to TS 60fff4236c484ad28df300176902dd2e
I20260709 13:13:31.201879  7893 raft_consensus.cc:993] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.202404  7893 raft_consensus.cc:1081] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.203857  7853 consensus_queue.cc:1048] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.204041  7653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:60562
I20260709 13:13:31.204748  7653 raft_consensus.cc:493] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.205116  7653 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.215910  7901 consensus_queue.cc:1048] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.217630  7653 raft_consensus.cc:515] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.219377  7578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
mode: GRACEFUL
new_leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:56790
I20260709 13:13:31.220079  7578 raft_consensus.cc:606] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Received request to transfer leadership to TS 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:31.224809  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:31.225827  7578 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.226339  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745d7cf3ea5941f3ae94c654bc48ad7e" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:31.225286  7653 leader_election.cc:290] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.226974  7728 raft_consensus.cc:3055] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.227319  7728 raft_consensus.cc:740] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:31.228204  7728 consensus_queue.cc:260] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.229238  7728 raft_consensus.cc:3060] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.236995  7728 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:31.238620  7618 leader_election.cc:304] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:31.240082  7903 raft_consensus.cc:2804] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.240633  7903 raft_consensus.cc:697] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:31.241434  7578 raft_consensus.cc:2468] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:31.241923  7903 consensus_queue.cc:237] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.250201  7478 catalog_manager.cc:5697] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 2 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.252175  7899 consensus_queue.cc:1048] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.263058  7893 consensus_queue.cc:1048] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.269054  7903 raft_consensus.cc:493] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.269526  7903 raft_consensus.cc:515] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.272390  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa3fc418061496f8d2451d22f920d3e" is_pre_election: true
I20260709 13:13:31.273180  7578 raft_consensus.cc:2393] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60fff4236c484ad28df300176902dd2e in current term 1: Already voted for candidate 2d3a92cebfb5426b8060a3b7167c0bec in this term.
I20260709 13:13:31.274260  7903 leader_election.cc:290] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.275404  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" is_pre_election: true
I20260709 13:13:31.275769  7856 raft_consensus.cc:993] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.276329  7893 raft_consensus.cc:1081] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.276995  7618 leader_election.cc:304] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:31.277765  7903 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.278890  7654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:60562
I20260709 13:13:31.279510  7654 raft_consensus.cc:493] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.279852  7654 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.284695  7903 raft_consensus.cc:2749] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.288605  7654 raft_consensus.cc:515] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.291128  7654 leader_election.cc:290] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.292382  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:31.293201  7728 raft_consensus.cc:3055] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.293828  7728 raft_consensus.cc:740] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:31.294083  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d46fcb0110c45c3a03aeb35eae20dc2" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:31.294678  7578 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.294843  7728 consensus_queue.cc:260] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.296201  7728 raft_consensus.cc:3060] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.302743  7578 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:31.303963  7621 leader_election.cc:304] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:31.304867  7903 raft_consensus.cc:2804] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.305418  7893 consensus_queue.cc:1048] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.305608  7903 raft_consensus.cc:697] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:31.306327  7728 raft_consensus.cc:2468] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:31.306604  7903 consensus_queue.cc:237] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.313687  7856 raft_consensus.cc:993] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.314116  7856 raft_consensus.cc:1081] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 60fff4236c484ad28df300176902dd2e to start an election
I20260709 13:13:31.320142  7653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
 from {username='slave'} at 127.0.0.1:60562
I20260709 13:13:31.320811  7653 raft_consensus.cc:493] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.320145  7478 catalog_manager.cc:5697] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 2 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.321182  7653 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.323508  7871 consensus_queue.cc:1048] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.331697  7893 consensus_queue.cc:1048] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.331993  7901 consensus_queue.cc:1048] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.336166  7871 raft_consensus.cc:993] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: : Instructing follower 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:31.340171  7938 raft_consensus.cc:1081] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Signalling peer 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:31.344542  7653 raft_consensus.cc:515] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.348254  7579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:31.350773  7580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:56778
I20260709 13:13:31.351454  7580 raft_consensus.cc:493] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.351820  7580 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.357484  7728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7072dfea0ab148ebb198477db540c1c0" candidate_uuid: "60fff4236c484ad28df300176902dd2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:31.358242  7728 raft_consensus.cc:3055] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.358574  7728 raft_consensus.cc:740] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:31.359659  7728 consensus_queue.cc:260] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.360121  7653 leader_election.cc:290] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.360057  7871 consensus_queue.cc:1048] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.360657  7728 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.363428  7580 raft_consensus.cc:515] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.365602  7580 leader_election.cc:290] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.366324  7871 consensus_queue.cc:1048] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.367030  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:31.367635  7655 raft_consensus.cc:3055] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.367940  7655 raft_consensus.cc:740] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:31.368858  7655 consensus_queue.cc:260] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.370218  7655 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.370317  7938 consensus_queue.cc:1048] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.371960  7725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2a1c84b864afca828828c50a70e2f" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:31.376137  7901 consensus_queue.cc:1048] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:31.398252  7655 raft_consensus.cc:2468] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:31.399832  7543 leader_election.cc:304] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:31.400854  7901 raft_consensus.cc:2804] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.401117  7728 raft_consensus.cc:2468] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fff4236c484ad28df300176902dd2e in term 2.
I20260709 13:13:31.401396  7901 raft_consensus.cc:697] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:31.405509  7901 consensus_queue.cc:237] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.409504  7618 leader_election.cc:304] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 60fff4236c484ad28df300176902dd2e; no voters: 3fa3fc418061496f8d2451d22f920d3e
I20260709 13:13:31.411456  7871 raft_consensus.cc:2804] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.411950  7871 raft_consensus.cc:697] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Becoming Leader. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:31.412691  7901 raft_consensus.cc:993] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: : Instructing follower 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:31.413332  7898 raft_consensus.cc:1081] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Signalling peer 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:31.414223  7898 consensus_queue.cc:1048] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.412762  7871 consensus_queue.cc:237] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.421140  7727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:50210
I20260709 13:13:31.421900  7727 raft_consensus.cc:493] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.422348  7727 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.436453  7727 raft_consensus.cc:515] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.440812  7578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:31.441529  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be6936cae24c4f4fb6c16a06ec94ae9e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:31.442363  7655 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.435811  7475 catalog_manager.cc:5697] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 1 to 2, leader changed from 60fff4236c484ad28df300176902dd2e (127.28.152.2) to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.441609  7578 raft_consensus.cc:3055] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.447275  7578 raft_consensus.cc:740] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:31.448215  7578 consensus_queue.cc:260] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.449316  7578 raft_consensus.cc:3060] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.452580  7727 leader_election.cc:290] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:31.455710  7478 catalog_manager.cc:5697] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 60fff4236c484ad28df300176902dd2e (127.28.152.2). New cstate: current_term: 2 leader_uuid: "60fff4236c484ad28df300176902dd2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.457026  7578 raft_consensus.cc:2468] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:31.458799  7695 leader_election.cc:304] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:31.459081  7655 raft_consensus.cc:2468] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:31.459707  7893 raft_consensus.cc:2804] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.460203  7893 raft_consensus.cc:697] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:31.461009  7893 consensus_queue.cc:237] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.461943  7901 consensus_queue.cc:1048] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.484552  7476 catalog_manager.cc:5697] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 1 to 2, leader changed from 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1) to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 2 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.728394  7899 raft_consensus.cc:993] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: : Instructing follower 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:31.728868  7893 raft_consensus.cc:1081] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Signalling peer 3fa3fc418061496f8d2451d22f920d3e to start an election
I20260709 13:13:31.730247  7578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
 from {username='slave'} at 127.0.0.1:56786
I20260709 13:13:31.730751  7578 raft_consensus.cc:493] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.731048  7578 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.736022  7578 raft_consensus.cc:515] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.737574  7578 leader_election.cc:290] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Requested vote from peers 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979), 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3:44787)
I20260709 13:13:31.738415  7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:31.738757  7727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5bd8eb6977547478df57c21bd0ffb24" candidate_uuid: "3fa3fc418061496f8d2451d22f920d3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
I20260709 13:13:31.739006  7655 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.739385  7727 raft_consensus.cc:3055] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.739745  7727 raft_consensus.cc:740] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:31.740659  7727 consensus_queue.cc:260] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.742712  7727 raft_consensus.cc:3060] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.745507  7655 raft_consensus.cc:2468] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:31.746570  7543 leader_election.cc:304] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa3fc418061496f8d2451d22f920d3e, 60fff4236c484ad28df300176902dd2e; no voters: 
I20260709 13:13:31.747323  7901 raft_consensus.cc:2804] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.747756  7901 raft_consensus.cc:697] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Leader. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:31.748413  7727 raft_consensus.cc:2468] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa3fc418061496f8d2451d22f920d3e in term 2.
I20260709 13:13:31.748529  7901 consensus_queue.cc:237] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:31.755761  7478 catalog_manager.cc:5697] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e reported cstate change: term changed from 1 to 2, leader changed from 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3) to 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1). New cstate: current_term: 2 leader_uuid: "3fa3fc418061496f8d2451d22f920d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.799347  7727 raft_consensus.cc:3060] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.804737  7727 raft_consensus.cc:1275] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.806036  7902 consensus_queue.cc:1048] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.812870  7578 raft_consensus.cc:1275] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.813701  7580 raft_consensus.cc:1275] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.814752  7944 consensus_queue.cc:1048] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.819407  7945 consensus_queue.cc:1048] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.822836  7655 raft_consensus.cc:1275] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.825306  7727 raft_consensus.cc:1275] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.828809  7901 consensus_queue.cc:1048] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:31.829761  7871 consensus_queue.cc:1048] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.834996  7725 raft_consensus.cc:1275] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.835675  7729 raft_consensus.cc:1275] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.840991  7938 consensus_queue.cc:1048] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.844228  7938 consensus_queue.cc:1048] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.857563  7655 raft_consensus.cc:1275] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.858386  7580 raft_consensus.cc:3060] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.859652  7899 consensus_queue.cc:1048] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.866731  7580 raft_consensus.cc:1275] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 60fff4236c484ad28df300176902dd2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.868265  7871 consensus_queue.cc:1048] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.870934  7578 raft_consensus.cc:1275] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.872738  7856 consensus_queue.cc:1048] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.223114  7729 raft_consensus.cc:1275] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.224363  7902 consensus_queue.cc:1048] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.233692  7655 raft_consensus.cc:1275] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 3fa3fc418061496f8d2451d22f920d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.235872  7902 consensus_queue.cc:1048] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.223534  7476 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40550:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:34.244910  7476 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40550:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:34.309552 29280 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.350191  7984 tablet.cc:1724] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.369465  7991 tablet.cc:1724] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.440704  7985 tablet.cc:1724] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:34.460037  7967 log.cc:927] Time spent T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:13:34.409267  7986 tablet.cc:1724] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.509054  8002 tablet.cc:1724] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:34.507931  7543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.152.3:44787, user_credentials={real_user=slave}} blocked reactor thread for 75411.2us
I20260709 13:13:34.527326  7984 tablet.cc:1724] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.547694  8004 tablet.cc:1724] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.559816  7999 tablet.cc:1724] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:34.578846  7996 log.cc:927] Time spent T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:13:34.593425  7998 log.cc:927] Time spent T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:13:34.599713  7991 tablet.cc:1724] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.617550  8008 tablet.cc:1724] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.530861  8000 tablet.cc:1724] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.638213  8005 tablet.cc:1724] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:34.647369  8001 log.cc:927] Time spent T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:34.675469  7580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e"
dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
mode: GRACEFUL
new_leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:43152
I20260709 13:13:34.676204  7580 raft_consensus.cc:606] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Received request to transfer leadership to TS 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:34.704782  7980 raft_consensus.cc:993] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: : Instructing follower 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:34.690660  7985 tablet.cc:1724] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.705379  7980 raft_consensus.cc:1081] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Signalling peer 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:34.694177  7984 tablet.cc:1724] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.707619  7999 tablet.cc:1724] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.681694  7986 tablet.cc:1724] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.712844  7991 tablet.cc:1724] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.747773  7728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:50210
I20260709 13:13:34.748385  7728 raft_consensus.cc:493] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.748737  7728 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.758916  8002 tablet.cc:1724] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.769246  8004 tablet.cc:1724] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.773104  7984 tablet.cc:1724] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.779373  8000 tablet.cc:1724] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.780138  8009 tablet.cc:1724] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.772765  7986 tablet.cc:1724] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.783303  7728 raft_consensus.cc:515] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:34.791935  7728 leader_election.cc:290] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 3 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:34.797313  7576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:34.798053  7576 raft_consensus.cc:3055] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.798383  7576 raft_consensus.cc:740] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fa3fc418061496f8d2451d22f920d3e, State: Running, Role: LEADER
I20260709 13:13:34.799250  7576 consensus_queue.cc:260] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:34.800585  7576 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.803182  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b68a2de8dde49f08099c0ecc6c06b0e" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:34.803864  7653 raft_consensus.cc:3060] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.807243  8008 tablet.cc:1724] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.816994  8020 tablet.cc:1724] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.819370  7655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4"
dest_uuid: "60fff4236c484ad28df300176902dd2e"
mode: GRACEFUL
new_leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:38192
I20260709 13:13:34.827394  7655 raft_consensus.cc:606] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Received request to transfer leadership to TS 2d3a92cebfb5426b8060a3b7167c0bec
I20260709 13:13:34.827082  8008 tablet.cc:1724] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.825793  7576 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 3.
I20260709 13:13:34.829141 29280 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:34.829698 29280 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:34.832264  7695 leader_election.cc:304] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:34.833436  8013 raft_consensus.cc:2804] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.833896  8013 raft_consensus.cc:697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 3 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:34.834779  8013 consensus_queue.cc:237] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:34.846117  7653 raft_consensus.cc:2468] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 3.
I20260709 13:13:34.848874  8002 tablet.cc:1724] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:34.859519  7478 catalog_manager.cc:5697] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 2 to 3, leader changed from 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1) to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 3 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.872781  7475 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: soft_deleted_table [id=93ddd7c0ca9c44bd84932bbf8b7272c4] alter complete (version 1)
I20260709 13:13:35.372475  8015 raft_consensus.cc:993] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: : Instructing follower 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:35.372879  7988 raft_consensus.cc:1081] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Signalling peer 2d3a92cebfb5426b8060a3b7167c0bec to start an election
I20260709 13:13:35.374439  7728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4"
dest_uuid: "2d3a92cebfb5426b8060a3b7167c0bec"
 from {username='slave'} at 127.0.0.1:50194
I20260709 13:13:35.375008  7728 raft_consensus.cc:493] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.375298  7728 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.380648  7728 raft_consensus.cc:515] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:35.382669  7728 leader_election.cc:290] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Requested vote from peers 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989), 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979)
I20260709 13:13:35.383419  7576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa3fc418061496f8d2451d22f920d3e"
I20260709 13:13:35.383651  7653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd5a02b7831439297eab38847ce2eb4" candidate_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60fff4236c484ad28df300176902dd2e"
I20260709 13:13:35.384021  7576 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.384289  7653 raft_consensus.cc:3055] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.384651  7653 raft_consensus.cc:740] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60fff4236c484ad28df300176902dd2e, State: Running, Role: LEADER
I20260709 13:13:35.385375  7653 consensus_queue.cc:260] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:35.386422  7653 raft_consensus.cc:3060] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.389278  7576 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:35.390455  7695 leader_election.cc:304] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a92cebfb5426b8060a3b7167c0bec, 3fa3fc418061496f8d2451d22f920d3e; no voters: 
I20260709 13:13:35.391299  8013 raft_consensus.cc:2804] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.391870  7653 raft_consensus.cc:2468] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3a92cebfb5426b8060a3b7167c0bec in term 2.
I20260709 13:13:35.392347  8013 raft_consensus.cc:697] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Becoming Leader. State: Replica: 2d3a92cebfb5426b8060a3b7167c0bec, State: Running, Role: LEADER
I20260709 13:13:35.393378  8013 consensus_queue.cc:237] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } }
I20260709 13:13:35.400343  7476 catalog_manager.cc:5697] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec reported cstate change: term changed from 1 to 2, leader changed from 60fff4236c484ad28df300176902dd2e (127.28.152.2) to 2d3a92cebfb5426b8060a3b7167c0bec (127.28.152.3). New cstate: current_term: 2 leader_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3a92cebfb5426b8060a3b7167c0bec" member_type: VOTER last_known_addr { host: "127.28.152.3" port: 44787 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.412427  7653 raft_consensus.cc:1275] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 3 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.413681  8013 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.417063  7576 raft_consensus.cc:1275] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 3 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.418787  8013 consensus_queue.cc:1048] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.799675  7655 raft_consensus.cc:1275] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.800839  8033 consensus_queue.cc:1048] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fff4236c484ad28df300176902dd2e" member_type: VOTER last_known_addr { host: "127.28.152.2" port: 40979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.810319  7576 raft_consensus.cc:1275] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Refusing update from remote peer 2d3a92cebfb5426b8060a3b7167c0bec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.811893  8033 consensus_queue.cc:1048] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa3fc418061496f8d2451d22f920d3e" member_type: VOTER last_known_addr { host: "127.28.152.1" port: 32989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.885818 29280 tablet_server.cc:179] TabletServer@127.28.152.1:0 shutting down...
I20260709 13:13:35.917208 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:35.918082 29280 tablet_replica.cc:333] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.918980 29280 raft_consensus.cc:2243] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.919785 29280 raft_consensus.cc:2272] T d5bd8eb6977547478df57c21bd0ffb24 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.921819 29280 tablet_replica.cc:333] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.922433 29280 raft_consensus.cc:2243] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.922938 29280 raft_consensus.cc:2272] T 74e95fb064374a6d9ca96ebc1c9496a0 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.924857 29280 tablet_replica.cc:333] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.925408 29280 raft_consensus.cc:2243] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.925832 29280 raft_consensus.cc:2272] T 7072dfea0ab148ebb198477db540c1c0 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.927769 29280 tablet_replica.cc:333] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.928293 29280 raft_consensus.cc:2243] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.929019 29280 raft_consensus.cc:2272] T e4db1d9b10ee44f181b66e840b2d7bd1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.930734 29280 tablet_replica.cc:333] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.931337 29280 raft_consensus.cc:2243] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.932101 29280 raft_consensus.cc:2272] T 03a01dffa20b428e822d1cb74b2dcef5 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.934285 29280 tablet_replica.cc:333] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.934962 29280 raft_consensus.cc:2243] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.935369 29280 raft_consensus.cc:2272] T 2b68a2de8dde49f08099c0ecc6c06b0e P 3fa3fc418061496f8d2451d22f920d3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.937855 29280 tablet_replica.cc:333] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.938416 29280 raft_consensus.cc:2243] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.938906 29280 raft_consensus.cc:2272] T be6936cae24c4f4fb6c16a06ec94ae9e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.940577 29280 tablet_replica.cc:333] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.941115 29280 raft_consensus.cc:2243] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.941546 29280 raft_consensus.cc:2272] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.943483 29280 tablet_replica.cc:333] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.944059 29280 raft_consensus.cc:2243] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.944478 29280 raft_consensus.cc:2272] T 7dd5a02b7831439297eab38847ce2eb4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.946928 29280 tablet_replica.cc:333] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.947484 29280 raft_consensus.cc:2243] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.948348 29280 raft_consensus.cc:2272] T 3fbe69df51f8445e90a222f9d6743b40 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.950790 29280 tablet_replica.cc:333] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.951339 29280 raft_consensus.cc:2243] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.951773 29280 raft_consensus.cc:2272] T 745d7cf3ea5941f3ae94c654bc48ad7e P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.953691 29280 tablet_replica.cc:333] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.954226 29280 raft_consensus.cc:2243] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.954638 29280 raft_consensus.cc:2272] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.956633 29280 tablet_replica.cc:333] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.957155 29280 raft_consensus.cc:2243] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.957890 29280 raft_consensus.cc:2272] T d78314637ac3456ea43ece29232fef39 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.960004 29280 tablet_replica.cc:333] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.960542 29280 raft_consensus.cc:2243] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.960976 29280 raft_consensus.cc:2272] T c4fc4e0ef7a1457d92676be63b406531 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.963271 29280 tablet_replica.cc:333] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
W20260709 13:13:35.963899  7695 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:13:35.963935 29280 raft_consensus.cc:2243] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.965399 29280 raft_consensus.cc:2272] T 584f9bceeca44a67944bf6646cd6b181 P 3fa3fc418061496f8d2451d22f920d3e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:35.966993  7695 consensus_peers.cc:597] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:35.968005 29280 tablet_replica.cc:333] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.968575 29280 raft_consensus.cc:2243] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.968968 29280 raft_consensus.cc:2272] T 0af88fe5e4da42c59b4471e8d688c456 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.970958 29280 tablet_replica.cc:333] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.971401 29280 raft_consensus.cc:2243] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.972081 29280 raft_consensus.cc:2272] T fff2a1c84b864afca828828c50a70e2f P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.973814 29280 tablet_replica.cc:333] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e: stopping tablet replica
I20260709 13:13:35.974342 29280 raft_consensus.cc:2243] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.974898 29280 raft_consensus.cc:2272] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 3fa3fc418061496f8d2451d22f920d3e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:35.980980  7695 consensus_peers.cc:597] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.007210 29280 tablet_server.cc:196] TabletServer@127.28.152.1:0 shutdown complete.
W20260709 13:13:36.013953  7621 consensus_peers.cc:597] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:32989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.042522 29280 tablet_server.cc:179] TabletServer@127.28.152.2:0 shutting down...
I20260709 13:13:36.066618 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.067323 29280 tablet_replica.cc:333] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.067927 29280 raft_consensus.cc:2243] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.068737 29280 raft_consensus.cc:2272] T 7072dfea0ab148ebb198477db540c1c0 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.070659 29280 tablet_replica.cc:333] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.071290 29280 raft_consensus.cc:2243] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.072027 29280 raft_consensus.cc:2272] T 74e95fb064374a6d9ca96ebc1c9496a0 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.073872 29280 tablet_replica.cc:333] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.074394 29280 raft_consensus.cc:2243] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.074862 29280 raft_consensus.cc:2272] T be6936cae24c4f4fb6c16a06ec94ae9e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.076551 29280 tablet_replica.cc:333] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.077086 29280 raft_consensus.cc:2243] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.077804 29280 raft_consensus.cc:2272] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.079695 29280 tablet_replica.cc:333] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.080225 29280 raft_consensus.cc:2243] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.080667 29280 raft_consensus.cc:2272] T 7dd5a02b7831439297eab38847ce2eb4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.083539 29280 tablet_replica.cc:333] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.084100 29280 raft_consensus.cc:2243] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.084573 29280 raft_consensus.cc:2272] T 3fbe69df51f8445e90a222f9d6743b40 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.086449 29280 tablet_replica.cc:333] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.087025 29280 raft_consensus.cc:2243] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.087463 29280 raft_consensus.cc:2272] T d5bd8eb6977547478df57c21bd0ffb24 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.089303 29280 tablet_replica.cc:333] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.089830 29280 raft_consensus.cc:2243] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.090250 29280 raft_consensus.cc:2272] T 0af88fe5e4da42c59b4471e8d688c456 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.092260 29280 tablet_replica.cc:333] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.092923 29280 raft_consensus.cc:2243] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.093346 29280 raft_consensus.cc:2272] T e4db1d9b10ee44f181b66e840b2d7bd1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.095088 29280 tablet_replica.cc:333] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.095613 29280 raft_consensus.cc:2243] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.096086 29280 raft_consensus.cc:2272] T 03a01dffa20b428e822d1cb74b2dcef5 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.098095 29280 tablet_replica.cc:333] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.098584 29280 raft_consensus.cc:2243] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.099052 29280 raft_consensus.cc:2272] T d78314637ac3456ea43ece29232fef39 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.100867 29280 tablet_replica.cc:333] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.101373 29280 raft_consensus.cc:2243] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.102136 29280 raft_consensus.cc:2272] T c4fc4e0ef7a1457d92676be63b406531 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.104408 29280 tablet_replica.cc:333] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.104902 29280 raft_consensus.cc:2243] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.105362 29280 raft_consensus.cc:2272] T 584f9bceeca44a67944bf6646cd6b181 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.107921 29280 tablet_replica.cc:333] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.108733 29280 raft_consensus.cc:2243] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.109313 29280 raft_consensus.cc:2272] T 2b68a2de8dde49f08099c0ecc6c06b0e P 60fff4236c484ad28df300176902dd2e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.111681  7695 consensus_peers.cc:597] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:32989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.112848 29280 tablet_replica.cc:333] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.113826 29280 raft_consensus.cc:2243] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.114358 29280 raft_consensus.cc:2272] T fff2a1c84b864afca828828c50a70e2f P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.114611  7621 consensus_peers.cc:597] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:32989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.116475 29280 tablet_replica.cc:333] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.117002 29280 raft_consensus.cc:2243] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.117700 29280 raft_consensus.cc:2272] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.119742 29280 tablet_replica.cc:333] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.120188 29280 raft_consensus.cc:2243] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.120865 29280 raft_consensus.cc:2272] T 745d7cf3ea5941f3ae94c654bc48ad7e P 60fff4236c484ad28df300176902dd2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.122782 29280 tablet_replica.cc:333] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e: stopping tablet replica
I20260709 13:13:36.123235 29280 raft_consensus.cc:2243] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.123939 29280 raft_consensus.cc:2272] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 60fff4236c484ad28df300176902dd2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.156366  7692 consensus_peers.cc:597] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec -> Peer 60fff4236c484ad28df300176902dd2e (127.28.152.2:40979): Couldn't send request to peer 60fff4236c484ad28df300176902dd2e. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.2:40979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.163067 29280 tablet_server.cc:196] TabletServer@127.28.152.2:0 shutdown complete.
I20260709 13:13:36.194293 29280 tablet_server.cc:179] TabletServer@127.28.152.3:0 shutting down...
W20260709 13:13:36.204072  7695 consensus_peers.cc:597] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec -> Peer 3fa3fc418061496f8d2451d22f920d3e (127.28.152.1:32989): Couldn't send request to peer 3fa3fc418061496f8d2451d22f920d3e. Status: Network error: Client connection negotiation failed: client connection to 127.28.152.1:32989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.227833 29280 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.228642 29280 tablet_replica.cc:333] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.229270 29280 raft_consensus.cc:2243] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.229784 29280 raft_consensus.cc:2272] T 7072dfea0ab148ebb198477db540c1c0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.231779 29280 tablet_replica.cc:333] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.232383 29280 raft_consensus.cc:2243] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.232784 29280 raft_consensus.cc:2272] T 74e95fb064374a6d9ca96ebc1c9496a0 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.234817 29280 tablet_replica.cc:333] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.235319 29280 raft_consensus.cc:2243] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.235698 29280 raft_consensus.cc:2272] T d5bd8eb6977547478df57c21bd0ffb24 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.237509 29280 tablet_replica.cc:333] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.237987 29280 raft_consensus.cc:2243] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.238749 29280 raft_consensus.cc:2272] T 0af88fe5e4da42c59b4471e8d688c456 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.240573 29280 tablet_replica.cc:333] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.241043 29280 raft_consensus.cc:2243] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.241394 29280 raft_consensus.cc:2272] T 584f9bceeca44a67944bf6646cd6b181 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.243563 29280 tablet_replica.cc:333] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.244065 29280 raft_consensus.cc:2243] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.244437 29280 raft_consensus.cc:2272] T d78314637ac3456ea43ece29232fef39 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.246126 29280 tablet_replica.cc:333] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.246588 29280 raft_consensus.cc:2243] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.247001 29280 raft_consensus.cc:2272] T c4fc4e0ef7a1457d92676be63b406531 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.248867 29280 tablet_replica.cc:333] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.249322 29280 raft_consensus.cc:2243] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.249997 29280 raft_consensus.cc:2272] T 2b68a2de8dde49f08099c0ecc6c06b0e P 2d3a92cebfb5426b8060a3b7167c0bec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.252866 29280 tablet_replica.cc:333] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.253358 29280 raft_consensus.cc:2243] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.253726 29280 raft_consensus.cc:2272] T fff2a1c84b864afca828828c50a70e2f P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.255728 29280 tablet_replica.cc:333] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.256225 29280 raft_consensus.cc:2243] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.256596 29280 raft_consensus.cc:2272] T 8c3a518e22bd4f7baa4c332e3d22f4a4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.258396 29280 tablet_replica.cc:333] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.258927 29280 raft_consensus.cc:2243] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.259302 29280 raft_consensus.cc:2272] T 745d7cf3ea5941f3ae94c654bc48ad7e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.261045 29280 tablet_replica.cc:333] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.261504 29280 raft_consensus.cc:2243] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.261885 29280 raft_consensus.cc:2272] T fc40fa657d6e4b9c8c4c5896301f3ab1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.263725 29280 tablet_replica.cc:333] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.264187 29280 raft_consensus.cc:2243] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.264866 29280 raft_consensus.cc:2272] T be6936cae24c4f4fb6c16a06ec94ae9e P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.266474 29280 tablet_replica.cc:333] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.266981 29280 raft_consensus.cc:2243] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.267349 29280 raft_consensus.cc:2272] T 7d46fcb0110c45c3a03aeb35eae20dc2 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.269110 29280 tablet_replica.cc:333] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.269562 29280 raft_consensus.cc:2243] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.269961 29280 raft_consensus.cc:2272] T 3fbe69df51f8445e90a222f9d6743b40 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.271801 29280 tablet_replica.cc:333] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.272219 29280 raft_consensus.cc:2243] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.272936 29280 raft_consensus.cc:2272] T 7dd5a02b7831439297eab38847ce2eb4 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.275081 29280 tablet_replica.cc:333] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.275512 29280 raft_consensus.cc:2243] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.275871 29280 raft_consensus.cc:2272] T e4db1d9b10ee44f181b66e840b2d7bd1 P 2d3a92cebfb5426b8060a3b7167c0bec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.277458 29280 tablet_replica.cc:333] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec: stopping tablet replica
I20260709 13:13:36.277859 29280 raft_consensus.cc:2243] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.278241 29280 raft_consensus.cc:2272] T 03a01dffa20b428e822d1cb74b2dcef5 P 2d3a92cebfb5426b8060a3b7167c0bec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.317062 29280 tablet_server.cc:196] TabletServer@127.28.152.3:0 shutdown complete.
I20260709 13:13:36.348336 29280 master.cc:562] Master@127.28.152.62:45837 shutting down...
I20260709 13:13:36.369621 29280 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.370134 29280 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.370442 29280 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7a59f7a76dea4f23b7a0341ba18c2e2f: stopping tablet replica
I20260709 13:13:36.391378 29280 master.cc:584] Master@127.28.152.62:45837 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11175 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24012 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (297158 ms total)
[  PASSED  ] 8 tests.
I20260709 13:13:36.445966 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 414 messages since previous log ~14 seconds ago
I20260709 13:13:36.446220 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:13:36.446444 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 404 messages since previous log ~14 seconds ago
I20260709 13:13:36.446645 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:36.446875 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:36.447074 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 2 messages since previous log ~131 seconds ago
I20260709 13:13:36.447289 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 1 messages since previous log ~189 seconds ago
I20260709 13:13:36.447494 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~143 seconds ago
I20260709 13:13:36.447759 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:13:36.448060 29280 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 123 messages since previous log ~32 seconds ago
